It's not just a WoW thing. If you have a strong interest in anything that isn't sports, you'll be made fun of by someone. Even people who are "overly into" sports are seen as a bit weird. The kicker is that everyone has something "weird" about them, and most people are just trying desperately to pass themselves off as normal.
Anyone who makes fun of you for something you enjoy is just insecure about their own life, and is best ignored.