 Simmons would go on to produce the album version of the song, while pop producer Guy Roche would go on to produce the single version of the song.Written by Diane Warren, "The One I Gave My Heart To" is a power ballad with more prominent pop influences, which are more apparent in the single version, in contrast to her previous works which are more leaning towards R&B and hip hop.The song is composed in the key of G major and follows the verse-chorus form with Aaliyah doing improvisations at the ad-libbed last verse, marking the climax of the song.