You dont gain any more mana while not casting than you do casting, so that point is invalid. Also, if you have time to sit there not casting in a fight to regen, then you have no excuse not to use TC and gain more mana back while also providing, albeit very minor, DPS to the raid.