Ashenvale was "contested" only because it was invaded, in Warcraft 3 it was a night elven zone. It also was recognized as a night elven zone by the horde itself (not that it stopped them from invading it anyway). And later after SoO horde officially withdrew all claims to it in return for Alliance withdrawing claims on Azshara.
Besides, proximity to a capital hardly matters when talking about territory ownership.