The irony here is regardless of the status of this banner, there was still High Elven siege equipment. You don't get that without a siegeworks, which also means a settlement. He has simply picked the low hanging fruit to attack while ignoring the more substantial evidence provided in-game, that being a contingent of siege equipment led by Vereesa Windrunner, a High Elf of the Silver Covenant.