In my job I do a decent amount of work in some nice exclusive areas where houses cost 10-20 times what mine is worth. One customer today just openly admitted that people charge them more because of the neighborhood.
I do not charge more and notice that a lot of the time they are actually really nice to you, on several occasions giving me tips of $50-100.
Is it wrong to charge someone more for the exact same item or service just because they have a huge house and or $100K + car in the driveway?