It depends, if you live alone and isolate yourself then you really have no reason to be paranoid about anything simply because nobody cares about what you do in your life and who you are. If you have a large group of friends and family you regularly socialize with then some people could feel offended with what you do (doesn't matter if it's loud music or not). Social anxiety people that isolate themselves literally already solved the issue. If nobody knows/cares about you, nothing you do matters from a social perspective, you are meaningless and so is your anxiety that very moment.
And if you argue that strangers still could complain about the loud music that just means it's about the noise, regardless of what music you perform or listen to. You could be jamming on dishes and they mean the world to you, but the stranger doesn't associate you or your personality with it, he just hates the noise regardless what or who it creates.