Your average office worker doesn't work even remotely as hard as, say, a maid for a house cleaning company. We've also got jokers at the top that spend most of their time tweeting nonsense and taking vacations who don't work nearly as hard as a construction worker.
Hard work alone will not take you closer to the top. Hard work and skill are factors, but the greatest factor is simply luck.