Women take the responsibility of evading attack seriously. It is a difficult job. The dangerous men are not visibly identifiable, have no distinguishable traits, fit no particular group. We know they can be fathers, brothers, husbands, teachers, doctors. They can be small, large, rich, poor, black or white. The only thing they have in common is that they are men who rape and batter women.
To say that every man is a potential rapist is not to say that every man rapes. It is a caution against falsely categorizing men and taking unwitting risks as a result.