Built in 1854 and designed by A.J. Downing, the Capt. Brown House is among the earliest Carpenter Gothic wood-frame structures in the state. It was built by Josiah Prentiss Brown, a miner, 49er, local banker, multi-term state legislator, and commander of the Yuba Light Infantry, Co. E, 1st Batt., 4th Brgd. Ca. Nat. Guard, which had 80 members and a local armory. Commissioned by Gen. J.C. Fremont and familiarly known throughout Northern California as Captain Brown, he became the longest standing officer in the Guard after 20 years of service. He was initiated into ECV on May 19th, 1856.