Perhaps way, way back in human history, when our forebears were still fleeing saber-toothed tigers, natural selection for athletic prowess came into play.
Maybe natural selection got rid of alll the weak people.