Fort Lyttelton was begun in 1755 by George Croghan and was named by Governor Morris after Sir George Lyttelton, then the Chancellor of the Exchequer. It was garrisoned at various times by Provincial and regular troops, as well as local volunteers in 1763. By 1764 it was reported in ruins.