Museum of the United States Patent Office, by , 1856, Smithsonian Archives - History Div, Engraving of the Museum of the United States Patent Office, with visitors viewing the exhibits. The Patent Office Building later became the home for the National Collection of Fine Arts, now the National Museum of American Art and the National Portrait Gallery..