+ All Categories
Home > Documents > Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political...

Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political...

Date post: 02-Jun-2020
Category:
Upload: others
View: 6 times
Download: 0 times
Share this document with a friend
44
Introduction to Dataverse Meghan Goodchild Scholars Portal & Queen’s University April 19, 2018
Transcript
Page 1: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Introduction to DataverseMeghan Goodchild

Scholars Portal & Queen’s UniversityApril 19, 2018

Page 2: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Plan● Dataverse et la gestion des données de recherche (GDR)

● Scholars Portal Dataverse

● Dépôt des données

● Découverte des données et réutilisation

● Développements à venir

● Comment faut-il se commencer?

Page 3: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

What is Dataverse?● Open source research data repository software

● Store, share, publish and discover research data

Page 4: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

https://dataverse.org/researchers

Page 5: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

What is Dataverse?● Open source research data repository software

● Store, share, publish and discover research data

Page 6: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Dataverse et GDR

https://portagenetwork.ca/fr/

Page 7: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Scholars Portal Dataverse

Page 8: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Dataverses, Datasets, Files

Dataverse = Container for datasets

and/or dataversesDataset = Container for your data,

documentation, and code

Page 9: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale
Page 10: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale
Page 11: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale
Page 12: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale
Page 13: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Usage

401 GBTotal size of published datasets

71,769Total number of downloads

957Number of published datasets

889Number of registered users

Usage at a glance...

Page 14: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Usage - Downloads over time

Usage statistics are for Harvard Dataverse: https://dataverse.org/metrics

Page 15: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Dataset name

Assessment of the fecal microbiota in beef calvesUniversity of Guelph Dataverse

2011 National Household Survey, Forward Sortation Area

(FSA) Level [custom tabulation]

University of Toronto

Open access article processing charges May 2014University of Ottawa Dataverse

1369

1369

765

673

Forum Research Political Poll - Federal Issues (Canada)

20133809 University of Toronto

Theano-based large-scale visual recognition with multiple

GPUs

University of Guelph Dataverse

Dataverse name

2998

Dataverse usage - Downloads by dataset

Page 16: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Usage - Disciplinary coverage

Usage statistics are for Harvard Dataverse: https://dataverse.org/metrics

Page 17: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Data deposit● Institutional dataverses

● Deposit types

● Metadata

● Versioning

● File formats

Page 18: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Institutional dataverses• All data organized by institution (general root

available for non-affiliates, multi-institutional projects)

• Researchers deposit in Institutional Dataverses (defined by user affiliation)

• Library administers institutional space

• Customizable features (branding, featured Dataverses, facets, etc.)

Page 19: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Mediated deposit

Page 20: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Self-deposit

• Open to anyone to deposit and publish data• Usage statistics at institution-level to track published data

Note: SP Terms of Service covers removal of data if necessary (http://guides.scholarsportal.info/dataverse)

Page 21: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Metadata Standards• Citation (DataCite, Dublin Core, DDI)• Social Science (DDI)• Astronomy (Virtual Observatory VOResource)• Life Science (ISA-Tab)

Page 22: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Dataset Versioning

Page 23: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Dataset Versioning (continued)

Page 24: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

File formats

All file formats are supported

• Tabular data files (SPSS, R, excel, CSV)

• Geospatial files

• Images

SP Dataverse storage• Maximum file size 2GB per file• Unzipping, tabular ingest processing intensive

Page 25: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Data discovery and re-use

● Linking research outputs

● Permissions and licensing

● Discovery and access

● Collaboration

● Data explorer

Page 26: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

ORCID and DataCite integration

• Mechanisms for linking research output• ORCID ID field• ORCID sign-in *not configured • DataCite Canada DOI minting • DataCite indexing

Page 27: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Cross-referencing research outputs

Reference and link to publication in Dataverse record

Cite and link to data in publication

Obtain a DOI / data citation beforepublishing data

Provide private access to data during review process

Page 28: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Licensing• Default to CC0 (open data)

OR

• Custom terms of use ‘Data Usage Agreement’

• Restricted files and custom terms of access

Page 29: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

User/groups and roles

• Assign permissions for collaborators, curators, file downloaders (access)

• Granular file-level permissions • IP Group based permissions

Dataset and file permissions

Page 30: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Dataset and file permissions (continued)

Page 31: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Discovery and Access

• Open Archives Initiative (OAI) protocol for metadata harvesting (OAI-PMH)

• Metadata from published, unrestricted datasets can be harvested

• Dataverse APIs

• Search API

• Data Access API

• SWORD API (upload)

• Native API

Page 32: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

GuestbooksWho is downloading my data?

• User fills out guestbook form

• Owner downloads guestbook report

• Can be used to mediate access / approval of access to data

Page 33: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Collaborative data sharing

• Group permissions• Assign account roles• Track changes through versioning

Page 34: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Data ExplorerChart view

Page 35: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Data ExplorerCross tabulation

Page 36: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Preservation Current support:

• Native support for file verification • checksums, UNF• file format identification

• DOIs for persistent identification of data• Derivative generation (tabular data -

.tsv/tab)

Needed:

• Policies required• repositories have some responsibilities

(short term)• institution focused long-term archiving

Page 37: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Coming Next

• Upgrading to 4.8.6 with new French translations (UdeM)• Dataverse-Archivematica integration• Investigating Shibboleth login support• Persistent identifiers at the file level• Support for file hierarchy• Large file support and HTTP upload support

Page 38: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Coming Next Dynamic web report/metrics

• Institutional listing• Downloads by month• File size by Dataverse• File type• Number of datasets by month• Subject coverage

Page 39: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Why use Dataverse?

• Supports FAIR data principles• Findable, Accessible, Interoperable, Reuseable

• Secure data management• Effective sharing• Long-term access and preservation• Increase research visibility

Page 40: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Get started with using Dataverse

Scholars Portal Demo Dataverse

http://demodv.scholarsportal.info

Scholars Portal Production Dataverse

http://dataverse.scholarsportal.info

Free, open for all researchers in Canada

Page 41: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

SP Dataverse support team

Amber Leahey - Data & GIS Librarian

Meghan Goodchild - RDM Systems Librarian (Queen's / SP)

Kaitlin Newson - Digital Projects Librarian

Kevin Worthington - Data/GIS Programmer

Jayanthy Chengan - Senior Developer

Bikram Singh - Systems Analyst

Contact us at [email protected]

Page 42: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Équipe de GDR à uOttawa

Page 44: Introduction to Dataverse - University of OttawaDataverse 1369 1369 765 673 Forum Research Political Poll - Federal Issues (Canada) 2013 3809 University of Toronto Theano-based large-scale

Questions?


Recommended