Ayrton was brought up as Jewish but was agnostic by her teens. She adopted the name "Hertha", first given as a nickname by her friend Ottilie Blind, after the eponymous heroine of a poem by Algernon Charles Swinburne that criticised organised religion.