The EU referendum had caused a "significant realignment" in British politics with Labour facing a "dramatic" drop in its support as Leave voters back the Tories and Remain voters back the Liberal Democrats.