I'm white, so no, I don't really see it as too racist. I definitely understand your point though, I see my wording as rather harsh and jaded. But a lot of the uproar I see about "political correctness" is when a white person says something that he could have said 20 years ago without a comment, and now he doesn't understand why he can't use the same language that was accepted in a different era.
I think "political correctness" can absolutely go too far sometimes. For example, I heard a story about a professor that got a formal complaint lodged against him saying he couldn't use the word "violate" (As in, "he violated the law") because it was offending a rape victim in the class. But I believe this is only the majority of "politically correctness" cases. In large, most of what I see are minorities feeling genuinely insulted and left out and people getting offended that they now have to include everyone.