Joseph Henry's Daughter Caroline, by Addis, R.W. (Washington, D.C.), c. 1855, Smithsonian Archives - History Div, Harriet Alexander and Joseph Henry's daughter Caroline (1839-1920). Joseph Henry (1797-1878), was a physicist and the first Secretary of the Smithsonian Institution from 1846 to 1878. She was the youngest of the Henry's four children..