With its sense of history and authenticity, the Admiral’s Inn is a fascinating place