Transcript Presentation
Improving Integrity, Transparency, and Reproducibility Through Connection of the Scholarly Workflow Andrew Sallans Partnerships Lead Center for Open Science
A talk on the Open Science Framework 1. Free, open source platform 2. Designed to add efficiency to workflow 3. Connector to other tools and services
So, why is this important?
Challenges: Perceived norms Norms Counternorms
Communality
Open Sharing
Universalism
Evaluate research on own merit
Disinterestedness
Motivated by knowledge and discovery
Organized skepticism
Consider all new evidence, even against one’s prior work
Quality Secrecy
Closed
Particularlism
Evaluate research by reputation
Self-interestedness
Treat science as a competition
Organized dogmatism
Invest career promoting one’s own theories, findings
Quantity
Anderson, Martinson & DeVries, 2007
A little something about COS
• • • • • • Est. 2013 Non-profit tech startup 4 leading foundation funders, > $14M Located in Charlottesville, VA Team: ~ 25 FT & 20 interns Mostly software developers and researchers Mission: Improve openness, integrity, and reproducibility of research
Create an account easy and free!
http://osf.io
Modify Account Settings Update information https://osf.io/settings
Project Organizer Dashboard
Overview Project Overview Page
In the menu bar Wiki history Using the Wiki Add new or edit
Adding Components Add a new component
Select from the results Adding Contributors Choose permissions
Privacy
Uploading Files Click upload button or just drag and drop
Versioning See version history and download
Registering Your Work Choose the registration template Create a frozen registered version
Sharing Your Work Describe the link use Option to make anonymous Create a view-only link Select what parts of the project to share
Unique and permanent IDs Scientific content must be easy to cite and annotate Approach: GUIDs for all content https://osf.io/e81xl -> RPCB https://osf.io/alh38 -> Tim Errington https://osf.io/ibdv8 -> Coding_Study_1.xslx
Current Add Ons: • Dropbox • Github • • • Dataverse Figshare AmazonS3
Connecting the workflow
Examples of other connections
Taking a data management plan and converting it into a living document.
Providing a data repository lookup service and checklist to assist with preparation for deposit.
Connecting to a sensitive video storage service.
O PEN SCI EN CE FRA M EW O RK o sf .i o | @O SFr am ew o r k | # O SFi n A ct i o n
OSF in t h e lab
Er ica Bar ansk i Q Tools used: Qualtrics, Dropbox, Survey Monkey, R OSF features used: version control, collaboration, wiki for lab notebook and meetings Q H ow do y ou use t h e OSF?
The OSF m ak es v er si on con t r ol ef f or t l ess. M y PI, m y l abm at es, an d I hav e access t o pr ev i ous v er si on s of a f i l e at an y t i m e - an d t he m ost cur r en t v er si on i s al w ay s r eadil y av ai l abl e.
A Q H ow h as t h e OSF im pr ov ed y our w or k f low ?
A
Tools used: next-gen sequencers, pipeline software, custom software OSF features used: version control, file sharing, GitHub and Dropbox integration, public sharing.
Problem to solve: teaching undergrads how to make research reproducible and verifiable.
OSF features used: organization of documents and data, command files, metadata, and file sharing.
What’s underneath the hood?
• • • • • • • • • Python Javascript Git MongoDB / TokuMx Ansible Elasticsearch OSF API Rackspace Linode
Want to join the effort?
• • • • Contribute content to SHARE or partner on curation of content Serve as an Ambassador Coordinate a reproducible statistics and practices workshop Join the team – http://cos.io/jobs
Open Science Framework osf.io
Email: [email protected]
Twitter: @OSFramework