The note, which was carried by an aide to a Conservative party vice-chairman after a meeting in No 10, says it is "unlikely" that Britain will be given the chance to remain in the Single Market after it leaves the EU.