First off, I don't eat meat regardless, I don't really care if people eat meat though, to each their own. However, of all the different types of meats available for consumption, lamb and veal are what I feel uncomfortable with. Eating the meat of a baby animal not yet weened of their mother's milk strikes me as insensitive, regardless of how tasty it is. Prior to a vegetarian lifestyle, I still refused to eat it. Particularly in the U.S., lamb and veal is the topic of some morale issues within the food industry (Lets ignore that Americans refer to the meat of all ages of sheep as "lamb" we don't use the term mutton). Culturally, it doesn't have a huge impact on American diets and from personal experience, its pretty hard to find outside of an ethnic foods restaurant.
Yeah, it may be tasty, but when does self-guilt and morality play into the fact that you're consuming something that barely had a chance at life?