Joseph Henry's Daughters Caroline & Mary, by Unknown, c. 1855, Smithsonian Archives - History Div, Joseph Henry's daughters Caroline (1839-1920) & Mary Anna (1834-1903). Joseph Henry (1797-1878) was a physicist and the first Secretary of the Smithsonian Institution from 1846 to 1878. This photograph shows Caroline seated, resting her arm on a table, and Mary standing to her right..