The boat, with two men and two women aboard, was pinned against the rocks just off Dana Strand Beach when a large wave swept everyone overboard. Three of them were later found safely on the beach.
Mark Benet, a 46-year-old resident of Orange, was pulled from the water and rushed to a local hospital, where he later died.
Officials say none of the boaters were wearing life jackets or floatation devices.