 Amarante and Moretti had met in 2006, at a festival in Lisbon where both their bands were performing, and the idea came up to start a new musical project unrelated to their respective bands.When Amarante came to work in Los Angeles with Devendra Banhart on his 2007 album "Smokey Rolls Down Thunder Canyon" they renewed the acquaintance and started making music, then Binki was brought on board.Little Joy was signed to Rough Trade Records label.