It sucks, but I must admit I've gotten used to it in the last 10 years.
To the point where, if they opened Australian realms and for whatever reason we had to ditch our current characters, I wouldn't do it. I would certainly roll a character on the Aussie server, but I would not be willing to drop my main.