Well for most of the games life you had to do rated PvP to get the best PvP gear.
WoD and MoP may have been the only exceptions, the rest limited you to honor gear which got trashed by conquest gear.
And if casuals are the overwhelming majority the forums claim, most of the people you fight would be in same gear and situation as you.