The shadow minister without portfolio acknowledged there were challenges facing his party having "come out of a pretty tumultuous 18 months" with the general election defeat, two leadership contests and the EU referendum.