Transcript Document

George A. Smathers Libraries
Marston Science Library
MSL
OPEN REFINE:
CLEAN YOUR MESSY DATA
Valrie Minson
Outreach Librarian for Agricultural Sciences
OpenRefine
MSL





OpenRefine.org (Google Refine)
Open Source
Runs locally on computer (privacy)
Looks like Excel or Google Spreadsheets
Data: clean it, transform it, extend it!
Excel: my messy data
MSL
Data issues
MSL





Human/free-text errors
Inconsistent journal titles
Redundant citations
Data (volume/issue) in wrong fields
ARTICLES IN CAPS LOCK
Data in Open Refine
MSL
Use filters to edit data
MSL
Faceted: journal titles by count
MSL
MSL
Filtering/faceting
MSL
 Use filters or facets to select subsets of data




Journal of Agriculture
Journ of Agriculture
Journla of Agriculture
Agriculture, Journal of
 Not just for Messy data
OpenRefine Expression Language
(GREL)
MSL
 Transform list into table (create columns)
 Merge datasets
 Export into Excel, CSV, OpenOffice, Google
Spreadsheets, JSON, RDF, etc.
 Use with other systems (Excel, SPSS, etc.)
 Great videos
OpenRefine.org
MSL
Valrie Minson
[email protected]