 Fowler was born in Lambeth, South London on 10 December 1926.As a "near illiterate newspaper boy" making eight shillings a week, he told film historian Brian McFarlane, he was invited on to radio to speak about his life in wartime London.In 1951, Fowler married actress Joan Dowling, who committed suicide in 1954.