The citadel, built by Vauban, offers great views and is home to several museums, including the fascinating Musee Comtese, full of local artifacts; an Insectarium; an Aquarium; and a Noctarium, an exhibit of local nocturnal animals.
The citadel doesn't have any museums, just a library.