Built in 1812, Little Cedar Grove Baptist Church is the oldest church building still on its original location in the state. Its interior shows rifle openings in the walls, a balcony, and a raised pulpit, and a burial plot adjoins the church.