Lord Hill, a Tory former cabinet minister, warned the negotiations would be "difficult" with the current state of relations between the UK and the remaining 27 member states resembling a "dialogue of the deaf".