The castle itself is not that thrilling, even if part of it hosts a museum. The really interesting part was to climb the city wall and enjoy the views over the Cité and the surroundings. Here you can see Ville Basse with Point Vieux nearest, and Pont Neuf is further afield.