 "In for a Penny" was released on 7" vinyl by Polydor Records in the UK, Ireland, Germany, France, Belgium, Sweden, the Netherlands, Spain, Portugal, Scandinavia, Yugoslavia, Australia and Japan.The B-side, "Can You Just Imagine", was exclusive to the single and would later appear on the band's 2007 compilation "B-Sides".No music video was filmed to promote the single.