speaking as a native New Englander this is what i would suggest:
Fleece activewear if you plan on spending any time out on deck.
Lightweight gloves if your hands tend to get chilled
Sweater twinsets are a fav of mine for casual dinners, lightweight yet just enough warmth.
If you don't like sweaters then go for a blazer.
lightweight slicker or raincoat of some kind that you can throw over your fleece sweatshirt.