Thing is, aver you get 50 percent on level 2 spells, and 25 percent extra damage, you ca stop bothering with it and go smithing. Because frankly, the daedric and dragon armour are worth it. You can also go to enchanting - 5 points give you 100 increased effect, while level 100 perk allows for two enchants at same time.