New England and Long Island whalemen first settled Cape May on the Delaware Bay shore about 1685. Joseph Willdin and his wife, Hannah Gorham, a grandchild of Mayflower Pilgrim John Howland, came to the sandy bluff called Town Bank.