A lesser-known village 60 miles east of Manhattan is a relaxing getaway. Watch boats along the waterfront, unwind on beaches, and learn some nautical history.