To be fair, AP is not so much the issue. It's actually quite easy to farm anyway. Even while working 10-ish hours a day, I manage to get a new paragon point in the offspec weapons every day.
Legendaries are quite a different story. But the irony was noticable when I started to get envious of people having prydaz while having destro belt / bracers myself