Nah. It would be hard to separate myself from the feeling of being in the husband's position and it was my wife having an affair.
And besides, I find women who are already taken to be a huge turn-off. Whether they are married or just in a relationship. If you're not single, I'm not interested.