This is kinda what I imagined. Not to mention I'm sure the Jedi that survived found a lot of dead Jedi light sabers and had to keep them secret, keep them safe.
It would be a pretty cool story line to have a one-off where a jedi searches for fallen members of the order after the purge, collecting their sabers along the way. Maybe using the force to actuall see past events, like echoes of battle. Kinda a story of Jedi holocaust history. Not to mention there would be a crazy Jedi armory from it.