Under the label ‘Things I wish I’d written’, because they express a point I’ve been wanting make for ages, is this post from The F-Word blog on that hateful phrase ‘can’t you take a joke?‘
When someone says this to you, it isn’t because you had a sense of humour failure, it’s because they’re being hostile.
Boudica Marginalia 
I agree with that completely.