The Admiral, Downtown Historic District