Actually, to me, there is no difference. I’ve known men who’ve been randomly grabbed by women at parties (no as often as women I know, but it happens) and they weren’t all happy go lucky about it. Most men probably don’t care, but it’s perfectly possible to feel violated by any person, regardless of gender or size or supposed power differentials.