Their "influence", individually, is negligible. And while it becomes more influential with more attention and focus from more people, that's how society works. It's how fashion works. It's how memes work. It's why popular music is popular. Etc.
And the statement wasn't "harmless". Claiming that is just an attempt to downplay it. It may not be SUPER bad, but it's not "harmless", either.
He was asked to apologize, didn't, and quit his job when they apologized for him. He wasn't forced out of anything, and he could've just apologized and this would've gone away. You're blowing this WAY out of proportion for some reason that isn't clear to me.
Again; if you don't want a public response to your statements, you have the right to keep them private. Once you've made a public statement, the public is free to respond, because that's what freedom of speech is.