The more I think about it the more it seems like the Fire Mastery isn't as good as the Frost or Arcane Mastery. It's adding damage to smallest part of your DPS. Your direct damage spells do the majority of you DPS but the mastery for fire only helps your indirect damage. The Mastery for Frost and Arcane apply to your direct damage spells.