 "Holy Ghost" is the first Modern Baseball album that was not recorded by the band themselves—instead, the members obtained the help of Joe Reinhart (Hop Along, Algernon Cadwallader).The album was recorded at Headroom Studios in Philadelphia.