Harry L. Morrison was born on October 7, 1932, in Arlington, Virginia. As a child, he attended primary school in divisions 10-13 in Washington, D.C., as the Virginia public school system was segregated.