Yeah, I've had issues with Consolidate Buffs every once in a while.
I don't think there are many players that LIKE the function, so I'm not entirely sure why Blizz decided to make it in the first place.
Releasing it when it has this obnoxious tendency to bug into "on" mode doesn't really help either =/
But yeah, so far I haven't really figured out what causes it or any way to prevent the bug.
However, turning the feature on and then back off tends to cause the bug to fix itself.