So you see, it doesn't work both ways. 25m will always be much easier to execute in-raid than 10m. There may be a bit more logistical (i.e. outside of raid) planning required but just remember, there is a reason that they have no 10m version of LFR
In the end, you should play how you want to play and not really worry about how other people feel. If 25m feels right for you then stick with it. Some people just like more of a challenge.