Labor caucus has unanimously rejected the lifetime ban, with leader Bill Shorten arguing it was “ridiculous” to stop refugees coming to Australia as tourists years after they were resettled in another country.