Being banished from a group doesnt give them permission to join their enemies. Staying neutral and out of the conflict would have been the right thing to do. They were banished because they did something very wrong and completely against blood elf society.
So, you are saying that every criminal punished for a crime has a right to turn against the society who punished them?