 "My, Oh My" is a mid-tempo song with a traditional production featuring banjo, fiddle, and cowbell.The song's narrator notices how everything changes so rapidly, and remembers when there was empty land where there are now parking lots and stores.The song is performed completely in duet form by both members of The Wreckers (Branch and Harp), as opposed to other songs where they alternate between verses ("Leave the Pieces") or one member has lead vocals on a certain song (Harp on "Tennessee").