The Wall will go down. Bran will cross the wall and because he bears the Mark of the NK, it will get destroyed.
The show never said the wall was magic, until Benjen talked about it. Saying the dead can't go through it, so if it doesn't go down the whites can't go through. Therefore it will go down. And Castle Black with it. Goodbye glorious Edd