Voidwalker loses aggro when the pet gets feared/moves too far away from the pull point. Just have to move the pet back to the spawn point before the next fear, but sometimes even that isnt enough when the fear makes it bolt in a straight line away. Doesnt happen often though.