Some of the promotional material seemed to imply the entrance portal to The Eternal Palace was a rock formation in a cave that opened to show us the palace structure behind it, i would assume that is what it is. I would love if it is yet another subzone in Nazjatar you can fully explore though, would look amazing.