I meant specifically for the negative debuff. The positive haste buff is easy to deal with. The negative haste buff with metronome can be a pain to deal with, I sometimes struggle to weave LS with movement and low metronome stacks.
They don't affect the buff directly but Whispers does affect the GCD, much like Anomaly does, which is what makes weaving problematic at my current haste level.