Smithsonian Institution Archives
  • Collections
  • Services
  • Smithsonian History
  • About
  • Education
  • Blog
  • Forums
  • Press
  • Audiences
  • Donate

The Bigger Picture: Visual Archives and the Smithsonian

Challenges of Appraising Records in the Digital Age

by Jennifer Wright on October 12, 2012

Blogs across the Smithsonian will give an inside look at the Institution’s archival collections and practices during a month long blogathon in celebration of October’s American Archives Month. See additional posts from our other participating blogs, as well as related events and resources, on the Smithsonian’s Archives Month website.

This 13" laptop contained approximately 6 GB of files to be transferred to the Archives.  Courtesy of Jennifer Wright.

For over a decade now, I've been responsible for appraising records and personal papers.  This is the process by which archivists determine what materials should become part of the permanent collections of the archives.  At the Smithsonian Institution Archives, our decisions are based upon our collection policies, records disposition schedules, and deeds of gift.  Before we make these decisions though, we need to learn more about the materials in question, either by getting more information from the owner or creator, or by physically examining the materials.

In the past, a physical inspection of records often meant entering an office, file room, attic, or basement, and opening drawers and boxes.  While appraising records, I would sometimes make piles of the materials that should be transferred to the Archives,  materials that should be destroyed, and  materials that I had more questions about.  Sometimes I would also use post-it notes to label everything.  To learn more about the materials, all I needed to do was to look at folder or box labels and thumb through some of their contents.  Someone who was familiar with the records would often be there to help answer questions.

Over the last few years though, I've been asked to appraise electronic files with increasing frequency.  Suddenly, I'm not perusing filing cabinets but sitting in front of a computer systematically clicking through folders.  Or I'm putting disk after disk into a drive.  Files are not always intuitively named, particularly if they were created at a time when file names could only be eight character long.  This results in me needing to open the files to see what they are, but compatible hardware and software are not always immediately available.  An organized folder structure allows me to make educated guesses about the contents of the files, but it's not uncommon to find a single generic folder to which all of the files have been saved.

A rainbow of floppy diskettes. It is difficult to find current PCs with 3.5-inch drives to read these.I was recently asked by a donor of personal papers if we wanted any of the files on an old laptop.  I brought Lynda Schmitz Fuhrig, our Electronic Records Archivist, with me to assist in the process of transferring the files to our own servers.  When we arrived, the first thing we found was a pile of 3.5" floppy disks.  Although they were labeled, I still needed to bring them back to the office in order to verify their contents.

We then tackled the laptop.  Initially it appeared that there was very little of interest to the Archives.  The "My Documents" folder and "Desktop" primarily contained files of a personal nature.  It wasn't until we checked the C:\ drive that we found two folders of professional documents, each with layers upon layers of subfolders.  During a cursory examination of the files, I did not identify any files that were clearly outside the scope of the deed of gift.  Knowing that the transfer of the files would take a long time, I opted to transfer the folders in their entireties and do a more thorough appraisal later.

The laptop was very slow and as Lynda began to prepare the files we realized that the transfer process was going to require hours.  We ultimately decided to bring the laptop back to the office to complete the transfer. We didn't know until later that there was 6 GB of data saved to those two folder structures (the laptop was having trouble calculating their sizes).

There are still several more steps that need to occur in the appraisal process.  I need to look more closely at the contents folders to determine whether there are certain subfolders that do not meet our appraisal criteria.  We also need to compare these files with those previously transferred to the Archives from the donor.  Lynda will run programs which will find duplicates among the electronic records.  I will be comparing the recently transferred files with the finding aid for the existing paper records to determine where there may be significant overlap.

Appraising paper records is not always easy, but a quick look can often tell me a lot about them.  Appraisal of electronic records, however, relies heavily on available hardware and software and just tends to require a lot more time.

Today is the second annual Day of Digital Archives.  The Day of Digital Archives has been created to raise awareness of digital archives among both users and managers. By collectively documenting what we do, we will be answering questions like: What are digital archives? Who uses them? How are they created and managed? Why are they important?  For more information, see the project's blog. 

Related Resources

  • Day of Digital Archives, blog
  • Smithsonian Institution Archives' Appraisal Methodology, PDF
  • A Peek Into an Electronic Records Archivist's Toolbox, The Bigger Picture Blog, Smithsonian Institution Archives
  • To Preserve or Not to Preserve: Social Media, The Bigger Picture Blog, Smithsonian Institution Archives
Categories: What Gets Saved
Tags: Web/Tech, Archive, 2012 Archives Month
Comments: View 6 comments, or Give us yours!
All comments are moderated and subject to approval. Further information is available in The Bigger Picture’s Commenting Guidelines.

Comments (6) – Leave a comment

Jonty

There's no doubt that the digital age has changed how we collect, store and interact with our past. I am currently in the process of converting a wedding album into digital images. This album was only shot 10 years ago but comparing it with recent albums is a stark reminder of how much things have changed in a very short space of time. With photography in particular things have become much more organic and didactic rather than based on a formal list of required images. The ability to process and store significantly larger amounts of images has radically altered the way that photography is undertaken as a profession. Whilst this is just one area of archiving I am sure that similar changes have impacted other forms of communication. For example I have no doubt that email and text messaging has shifted all forms of written communication in a less formal direction.

I am hoping to be publishing a blog article in the next week or so on this.

Jonty October 14, 2012 at 6:09 am
  • reply
Courtney

Thank you for this blog! Can Lynda share what kinds of software or scripts she uses to "find duplicates among the electronic records"? I have many drives of video files to inventory, appraise and transfer and I believe there are many duplicates but I would love to be able to analyze this ahead of time.
Thank you!
Courtney
Digital Archivist, Fidelity Investments

Courtney October 15, 2012 at 3:30 pm
  • reply
Lynda Schmitz Fuhrig

Courtney,
Thank you for your question. Checksums (http://en.wikipedia.org/wiki/Checksum) are a good way to determine duplication among digital files. Even if two files have the same name, it is possible they contain different content. A checksum can be calculated for each file and then compared for matches and mismatches. There are a number of free and open-source tools available to create checksums, including the National Archives and Records Administration (NARA) File Analyzer and Metadata Harvester (https://github.com/usnationalarchives/File-Analyzer). Checksums can also let you know if a file has changed, which is important in ensuring authenticity and integrity.

Lynda Schmitz Fuhrig October 25, 2012 at 12:41 pm
  • reply
Michael John

Thats completely true Digital Age has changed a lot.

Floppy Disk where are you?

Its been replaced with much more convenient Pen Drives :)

Its great that we are finding ways to get things in a much better and fastest way but there are chances that our future generation will be much into these tech stuffs and will loose the base skills.

But its real fun to be in this Age :)

Cheers,
Michael John

Michael John October 21, 2012 at 3:43 am
  • reply
Nikhil

The present digital era has put up impending challenges as far as managing, conserving and preserving of archival records. Its high time that appropriate steps and techniques are employed and implemented in the right manner to preserve the archival records and agencies.

Nikhil November 3, 2012 at 3:19 pm
  • reply
Jay Harrison

Its amazing how far data storage has come over the years. I agree with Michael's comment. Back in the early 90's it was all about the floppy disk and look how far data storage has come along now. I found a really interesting infographic on tumblr the other day(http://visualoop.tumblr.com/post/49473895456/the-cost-of-data-storage-throughout-the-years), showing how the costs in data storage have changed over the years. Its really good to see where we have come from.

Jay Harrison May 8, 2013 at 10:54 am
  • reply

Leave a comment

The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.

More information about formatting options

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.
By submitting this form, you accept the Mollom privacy policy.

Produced by the Smithsonian Institution Archives. For copyright questions, please see the Terms of Use.

Stay in touch!

Facebook Twitter Flickr YouTube SlideShare
Join our eNewsletter

About

Connecting you to America’s past with a behind-the-scenes exploration of the Smithsonian’s history, treasures, and the challenges that Archives face preserving collections. More details...

Smithsonian on Flickr Commons

Topics/Tags

  • See Here (612)
  • American History (544)
  • Science (431)
  • Archive (332)
  • Cities/Places (279)
  • Exhibitions (235)
  • Web/Tech (211)
  • Photo History (189)
  • Link Love (154)
  • Politics/Government (153)

Blog Roll

All Smithsonian blogs
American Historical Association Blog
American Institute of Conservation Blog
Archives Next
Archives of American Art
Around the Mall
Field Book Project
Hanging Together
Library of Congress Blogs
National Archives (US) Blogs
National Museum of American History, O say can you see?
Smithsonian Collections Blog
Smithsonian Libraries
Teaching American History

Categories

  • Collections in Focus (991)
  • What Gets Saved (338)
  • Behind the Scenes (212)
  • Smithsonian History (136)

Recent Posts

  • See Here: 5/24/2013
  • Link Love: 5/24/2013
  • "If you feed them, they will come."
  • Women in Science Wednesday: Mary Alice McWhinnie
  • Twenty-Six and Blooming!

Monthly Archive

  • May 2013 (26)
  • April 2013 (26)
  • March 2013 (26)
  • February 2013 (26)
  • January 2013 (28)
  • December 2012 (26)
  • November 2012 (28)
  • October 2012 (32)
  • September 2012 (26)
  • August 2012 (31)
  • July 2012 (26)
  • June 2012 (27)
  • May 2012 (27)
  • April 2012 (27)
  • March 2012 (28)
  • February 2012 (27)
  • January 2012 (26)
  • December 2011 (31)
  • November 2011 (28)
  • October 2011 (35)
  • September 2011 (31)
  • August 2011 (35)
  • July 2011 (41)
  • June 2011 (43)
  • May 2011 (33)
  • April 2011 (40)
  • March 2011 (43)
  • February 2011 (35)
  • January 2011 (36)
  • December 2010 (42)
  • November 2010 (40)
  • October 2010 (44)
  • September 2010 (37)
  • August 2010 (39)
  • July 2010 (38)
  • June 2010 (37)
  • May 2010 (42)
  • April 2010 (44)
  • March 2010 (47)
  • February 2010 (40)
  • January 2010 (39)
  • December 2009 (43)
  • November 2009 (34)
  • October 2009 (11)
  • September 2009 (11)
  • August 2009 (12)
  • July 2009 (14)
  • June 2009 (10)
  • May 2009 (12)
  • April 2009 (14)
  • March 2009 (10)
  • January 2009 (1)
Smithsonian Institution Archives
eNewsletter Facebook Twitter Flickr Historypin YouTube SlideShare Browsealoud
Smithsonian Institution
  • Privacy
  • Copyright
  • Contact