I say people care about aesthetics.
Sometimes they care about aesthetics because of how they contribute to (or detract from) immersion.
But you can just as easily care about aesthetics without regard for immersion. Proof: stuff that completely breaks immersion for pure aesthetics, like silly meta humor cosmetics or whatever.
Suggesting that people care for aesthetics ONLY because of and to the extent it relates to immersion is simply incorrect.