Yes, but the Forsaken army cleared out Shadowfang keep nearly a decade before the invasion happened, and the Worgen just kept coming. Now from Gilneas. Which was the reason for the invasion. But if you're trying to go back to the source of the curse, Shadowfang keep was originally part of Gilneas, not Lordaeron.
Justification doesn't mean you have to agree with it.