Pretty much this.
It becomes even more arbitrary when you realize that no entire group is going to deem something like this as offensive. No single group of people think as a collective.
It's the reason why only white anchors are on TV are saying the "Team from Washington" while everyone else says the Redskins.
Context matters.