Technically, Ben wasn't a Skywalker anyway, he was a Solo. I mean, yeah, he actually has Skywalker blood, but do we know if Leia took Han's last name when they married? Did they even marry? My point is, depending on circumstances, if we're being technical, Ben was a Solo.
I do have some questions now, though, which I'm sure Disney will never answer.
Rey is a Palpatine. So Sidious at some point sired a child, and that child sired Rey. Was Palpatine's son or daughter a powerless nobody? I mean, the child of Sidious seems like they'd be pretty strong him/herself if the grandchild is strong. Seems like it would have been something interesting to explore if they had only brainstormed this all from the beginning instead of making it up as they go along.