Yeah, the special moves are the only thing that is magic damage. Their normal melees are physical damage, which of course ramps up over the course of the fight as their haste increases for the head you don't kill.