From your link:
2017 estimated population 253,634,894
Male 6,016,739
So 4.7% of the male population was arrested in relation to a crime. (Let's discount the fact that arrest doesn't equal guilty, shall we? Also, what you linked isn't even only violent crimes, but I don't feel like doing the math, so we'll give you the full count)
As long as you're arguing that women should be wary 5% of the time, I agree with you. Just because violent crimes are more likely to be committed by men, doesn't mean you should be afraid of men, because the VAST majority of men aren't violent.