Its based on population of region, not server. The shards that alliances are in are also semi balanced, so when you see alliance its likely at the same numbers as you are on horde.
Basically alliance gets 30% bonus for being in balanced shard while horde gets 10% bonus with a chance of getting an empty of alliance shard. The system would be better if bonus was shard specific.