Although not the oldest house at the island, as the hotel I stayed at, The Island Inn, boasts to be the oldest building on the island, dating from 1901.