The wonderful setting alone is worth the an old abbey incorporating the massive remains of the city's third-century Roman baths, the Thermes de Cluny.
The old abbey contains some rather small first-century Roman baths which are not worth seeing.