It does. Customization is a huge part of the game and this spec restriction unreasonably limits it.
I was like you back in Wrath or something but over time I started to use mounts based on their visuals and how well they fit whatever transmog I'm currently wearing. Still, to each their own.