the OP mentioned 'turn the buff off' isn't an option, but he mentioned one of the lesser reasons.
you have to satisfy the 9 / 24 other people in your raid, if even 7 of them want to use the buff, guess what, why keep them angry, it isn't an option because in casual guilds only 1-3 members would care about doing it with the buff off, the other people will just want the loots that take 5*x% less effort.