Would you say statues to Hitler, Stalin, or Pol Pot placed in public squares to be celebrated would be "offensive"?
What place do statues celebrating Confederate traitors who lost a rebellion aimed at preserving slavery, erected decades or even a century after the failed insurrection and the Confederate's death as a warning to local communities of color, have in polite society? These statues were almost all erected long after the Civil War, and their erection (hehehe) usually aligns with pushback on the civil rights movement and other pushes for equality.
Racists like statues celebrating other racists, shocking. That doesn't mean that it should be acceptable. Because a local group of neo-nazi's may want a statue of Hitler isn't cause to throw up our hands and say, "Well, it's history and they wanted it so I guess there's nothing we can do."
Believe it or not, that's been the push to remove them for decades. Take them out of public spaces where they are presented without historical context and put them in a museum where they can be presented with historical context.
Who is this guy?! What did he do!? Why is he on a horse? Questions which the statue in public does not answer as far as I know, but information that can be presented in context in a museum. This went up in 1998 I believe, so hardly timely or a piece of "history".
They have no place being celebrated in public.