Located at what would later be numbered 61 Street, the inn was a key part of the town’s social and commercial world for centuries.