No, he assaulted an Vietnamese man at 17, and some black children when he was 15. It's also worth noting he was a PCP junkie at the time and involved in gang-related activity. It was racially motivated, he admitted it, and has expressed remorse/shame/all the proper genuflections for years. He met with and apologized to the Vietnamese man.
There was another case when he was 21, in 1992, him and a friend beat up a black neighbor, but this was settled out of court between the two parties when Wahlberg said the black man used a racial epithet against Wahlberg's friend, causing the violent altercation.
He was a junkie scumbag in his youth, but if he has changed I don't think it's fair to call him a racist. If a criminal does change, they do deserve a chance.