Dataset Documentation & Justification
Upon scraping the College Women website for each nodesÕ ID, FIELD, and VALUE elements on July 1, 2017, the text facets for the FIELD categories were the following:
o Cite This Item* - not a useful category for data visualization project
o Collection
o Collection Guides* - not enough to have a substantial amount of data
o Contributor
o Copyright and Use* - not a useful category for data visualization project
o Creator
o Date
o Description
o Format
o Institution
o Location
o Original URL* - not a useful category for data visualization project; web scraping removed the hyperlinks
o Physical Description
o Subject
o Themes
o Title
(FIELD categories marked with * are categories that were omitted from the dataset for all IDs.)
For the remaining FIELD categories, the following changes were made using OpenRefine:
o Collection
* Minor clustering changes were made
o Contributor
* No changes were made
o Creator
* No changes were made
o Date
* All dates are represented by year only. Any additional information (month, day, season) were omitted.
* Time periods were changed to be represented by the starting year (ex: 1905-1910 as 1905). This will allow for a cleaner timeline.
* Time periods that were estimates were represented by that year (ex: ~1905 or circa 1905 or c. 1905 as 1905).
* For ID element 13678, the date given was Ò19ÑÒ. Upon further inspection of this nodeÕs description on the College Women website, the date was found to be 1865 and corrected as such.
* For ID elements 13584 and 13588, the date given was ÒundatedÓ. Upon further inspection of these nodesÕ descriptions on the College Women website, they were omitted. This will allow for a cleaner timeline.
o Description
* No changes were made
o Format
* Minor clustering changes were made so that all formats were placed into 4 types: Photograph, Correspondence, Diary, or Scrapbook. ÒPhoto AlbumsÓ are a part of the Photograph category, and any type of letter or postcard is a part of the Correspondence category.
o Institution
* No changes were made. Note that Barnard College has no submissions to the College Women data set. 
o Location
* Formatted into one of the following: 
* (City, State) for elements with given location in a specific city in the United States
* (State) for elements with given location in a particular state
* (City, Country) for elements with given location in a specific city outside of the United States
* (Country) for elements with given location in a particular country
* Vassar CollegeÕs lettersÕ locations were all Òletters (correspondence),Ó and so the locations have been omitted
o Physical Description
* No changes were made
o Subject
* Minor clustering changes to standardize plurals and case were made
o Themes
* Minor clustering changes to standardize plurals and case were made
o Title
* No changes were made