You can reach this part of the quest by solely using Raid Finder. Sure, you will have some valor gear at that point, but the difference in gear might still be relatively big, depending on your luck with the runestone drops etc.
With a 510 ilvl or something like that, he definitely can be challenging.