Henry Family at East Door of Castle, by Unknown (Titian R. Peale?), 1862, Smithsonian Archives - History Div, Secretary Joseph Henry (1846-1878) with his wife Harriet and three daughters, Caroline, Mary and Helen, standing in the east doorway to the Smithsonian Institution Building, c. 1862. Henry was the first Secretary of the Smithsonian, and he and his family resided in the east wing of the Smithsonian Institution Building..