Elitist is a title someone ~chooses~ to wear. You know when you're an elitist and should be proud of that. However, someone who comes down on other, unrelated players, criticizes their playing, yells at them, loses patience with them, lets them know how they "should" be doing things... this is not an elitist. This is an asshole.
As long as you're not guilty of the latter, let them throw the word around. Makes me smile.