People just want Colbert fired because they're bitter. He's actually a pretty funny guy for someone who's basically wrong about every political instinct hes ever had.
Conservatives should really go to bat for him so when their funny people get in trouble theres some precedent.