Looks like you can walk into it just fine if you're able- you just get the No Man's Land buff still.
I logged out before the shattering on the abandoned camp on the opposite side of Frostwhisper Gorge overlooking the sea, because I thought there was some nice symbolism in it. Funny enough, I log in on the opposite side, and find out I can walk in just a little bit before I get ported back out. Expected, but neat.