You're very heavily downplaying the cultural aspect. As a northern European, to me a black skin colour is just clearly visible proof that someone is from a completely different culture and thus we don't share interests. Skin colour isn't the decisive factor, it's just a symptom.