I shave mine, mostly for hygiene purposes. I do not think it matters. I think it's weird though that some men who don't shave their own body hair would be super judge-y towards women who don't, hypocrite much?
Yeah I think it's socialization for the most part (gender-specific or otherwise).