Actually, if you queue for any of the earlier tiers on the weekends, the queue is shorter than for SoO. I've been going into T14 raids to burn my Elder Charms and the wait is generally 15-20 minutes.
It's probably a combination of LFR'ers being dicks to tanks and SoO being a little tough for someone in relatively shit gear.