So you walk around wearing a cable-knit sweater and no pants?
You wear skirts and dresses on the regular, if you're a dude?
You throw on a sheet and wear it as a toga to go grocery shopping?
In pretty much every single case where people say "I wear whatever I want", what they really mean is "I wear whatever I want within the accepted range my culture suggests is acceptable, which I've internalized so thoroughly I don't see it as restrictive any more."