Oliver Platt, who plays Uncle Jimmy on the show, dines often on North Haven, while Abby Elliott, who plays Sugar, has long come to a family home at Cundys Harbor in Harpswell.