2sec off swiftmend has hardly any use in PvP. If you can freely use swiftmend you shouldn't have any problem keeping people up. The problem is usually your rejuvenation getting spampurged and you end up spamming only HT with no hots.
Also when you take 2&2 you can skip the mastery / crit pieces completely and only take Haste / spirit ones.