It's an issue when you let racist thoughts affect your preconceived thoughts of people and actually act on it.
I recognize I might have some racist tendencies in my thoughts, but the fact is I notice them and do my best to not let them take over my thinking. It's unfortunate society still so strongly, more or less, encourages racism, by being racist itself.