If I'm not mistaken then the rest of the archipelago Cape Verde belongs is part of the EU on account of being part of Spain and Portugal.
They are far out at sea and where uninhabited prior to discovery by Europeans and were part of Portugal until recently.
Also, they are tiny.
I think they could be allowed to join if they meet the other requirements.