Not having the perks of being in the EU while not being in the EU is not being punished. It's called not being part of the club/
As for Switzerland/Norway/Iceland. It's pretty much "Follow the EU rules and have no say in how it is run if you want to have full access to our market and not be a member."