You're aware that the United States is more than just White People, right?
But if you want to go with that argument he won the educated white vote by 3% (45% to 48%)
He also won the uneducated white vote by 37% (29% to 66%)
Clinton won the white college graduate female vote by 7% (51% to 44%)
She also won the non-white college graduate female vote by 53% (74% to 21%)
Clinton did win the $30,000 and less income bracket (53% to 40%) and also the $30,000-$49,999 (52% to 41%) which accounts for a pretty decent portion of the American Workforce. 51% make less than $30,000/year as is.
There was a very small differential in the income brackets between $50,000-$99,999 which favored Trump by 3% (49% to 46%) and from $100,000-$199,999 by a mere 1% (48% to 47%)
So tell me where in this vast majority you claim is there not going to be significant damage to the other people who voted for Trump?
http://www.cnn.com/election/results/exit-polls