St. Augustine Church, as the sign says, is the oldest on the island.