 Written singlehandedly by Jett, who also handles lead vocal duties on the song, "Take It or Leave It" challenges the title track in terms of strength and power with its "thunderous" drumming from West, who begins the song with a drum fill, and "powerful" guitar playing by both Ford and Jett.Barry Myers praised it as "possible single material" while Fowley referred to it as "pure Runaways", although Fox dismissed it as "one of my least favorite Runaways songs".Alex Henderson nonetheless deemed it a "classic" in his review for Allmusic, along with the songs "Neon Angels On the Road to Ruin" and "I Love Playin' with Fire", while Jett noted that it "always went over really well" with audiences when it was played live.