They have their own alternate realm that they originate from, but each Old God was said to have a citadel on Azeroth during the time of their rule.
The city of Ny'alotha might be one such 'base' - that would make an excellent final tier raid, an all-out assault on the house of an Old God.
For all we know, their ancient wars are the Old God equivalent of a game of chess.