it just shows you can lift a bigger payload

This is the primary hurdle. The Soviets failed to put a man on the moon because they couldn't create an engine with enough thrust. To this day, the thrust on the Saturn V has not been matched or surpassed, and its engines are a lost art.