The only valid reasons to kick someone are if they're not actually playing, or if they're being giant douchebags. So I'd say the people kicking are the ones who deserve to be kicked. This is why vote kick isn't always a good idea. It's great on paper, until you realize how pathetic humanity is and how it'll abuse anything.