if your using the fact the trolls broke the aqir empire as justification for the trolls being the rightful rulers of azeroth then the fact the elves broke the troll empires justifies them as azeroth's rightful rulers.
then again none of this matters cause azeroth still belongs to the titans, as in if they wished the whole planet would cease to be.