Twin Oaks was designed by Frederick Douglass so that "As a free man I could look back across the bay to the land where I was born a slave" and was built by Charles Remond Douglass in 1895.