In summer it's a bit of a tourist trap, but take a look at the cacti and tropical flowers (plus ruins of a 14th-century castle) in the Jardin Exotique.
The ruined castle was built by soldiers to defend against encroaching armies.