Open Science Framework

Jeffrey SpiesUniversity of Virginia

Scientific Values

ScientificPractices

Examples

• Journals strongly favor– Novel findings over replication– Positive over negative or inconclusive results– Confirmatory over exploratory analyses

• As a result, scientists engage in questionable behaviors

• The state of data sharing

Solution

Transparency and Openness

CC flickr:ccpixel;flickr:voxtheory

Be Practical

• Scientists have developed workflows that allow themselves to be successful in the current system

• Scientists must remain productive within the current system in order to acquire jobs, promotions, grants, etc.

Updated Solution

• Incentivize openness• Don’t interfere with productivity• Don’t make more work

Open Science Framework

• Web applicationhttp://OpenScienceFramework.org

• Open source software (mostly Python)• Focus on integrating and incentivize openness

at the workflow level• Make workflow more efficient

Open Science Framework1. Content management system

– Makes it easy to document, organize, and search the entire lifespan of a research project

– Collects metadata at each stage2. Collaboration tool

– Real-time feedback3. Version control system

– Interface and abstraction layer to current VC tools– Projects can be forked

4. Scientific network5. Open Science interface

– Connect resources via APIs

Big Data

• Datasets so large that they are difficult to manage with traditional tools

• Simple statistical models with large amounts of data outperform elaborate models with smaller amounts

• This principle has the possibility to be transformative

Big Science

• Large-scale collaborations and openness to such a degree that it will be difficult to manage with current tools

• New tools need to be developed:

http://OpenScienceFramework.org@OSFramework

jspies@virginia.edu