Aye, I don't understand this meself...
If Bolvar is "good" he wouldn't be making more scourge... so couldn't the scourge be systematically killed off ? Couldn't Bolvar just have them destroy themselves, etc. ?
Just a stupid plot convenience because we know he's "bad" now, and we'll probably fight him at some point... in a 5-man dungeon.