Job of being Wall Street executive is not known for selecting those with loads of empathy; some sociopathic and dominating tendencies can be more helpful for successful career there.
As such, plenty of them can be quite right worrying that they can look like an asshole - or perfectly aware that they are.