I think thee in lies a problem. We are either granting the State incredible levels of power to dictate who our friends, relations and associates are, which is itself a massive hazard. What is the border of discriminatory behavior? If we restrict it entirely, than freedom of association is basically dead. And thus when the Feminist bleats on that she is entitled to you finding her fat ass self attractive or a Trans activist argues not dating and fucking her is discrimination, well, then they have a point.
Or the "Bake the Cake Bigot!" crowd.