 Wilhelm was born in 1922, long thought to have been 1923.He was one of eleven children born to poor tenant farmers John and Ethel (née Stanley) Wilhelm in Huntersville, North Carolina.He played baseball at Cornelius High School in Cornelius, North Carolina.