+ All Categories
Home > Documents > RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR...

RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR...

Date post: 21-May-2020
Category:
Upload: others
View: 3 times
Download: 0 times
Share this document with a friend
28
Kenning Arlitsch, Dean @kenning_msu Patrick OBrien, Semantic Web Research Director @sempob RAMP: Repository Analytics and Metrics Portal Accurately measuring use of institutional repositories OCLC RLP Meeting London, UK, March 8, 2017
Transcript
Page 1: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Kenning Arlitsch, Dean @kenning_msuPatrick OBrien, Semantic Web Research Director @sempob

RAMP:

Repository Analytics and Metrics Portal

Accurately measuring use of institutional repositories

OCLC RLP MeetingLondon, UK, March 8, 2017

Page 2: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Agenda

1. A New Reporting Model2. Accuracy of Analytics Reporting Tools

Page TaggingLog file

3. RAMPNew Prototype Web Service for IR reporting

Page 3: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

A New Reporting Model

Page Type Definition Examples

Citable Content Downloads

Non-HTML scholarly content that may be formally cited in the research process

● Publication (.pdf)● Presentation (.ppt)● Data Sets (.csv)

Item SummaryHTML pages to help user decide to download the full publication

● Title & Abstract● Item Metadata

AncillaryHTML pages that provide general information or navigation

● Search Results● Browse by Author● Statistics

Page 4: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:
Page 5: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:
Page 6: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:
Page 7: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:
Page 8: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Accuracy of Analytics Reporting Tools

Page 9: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Two Classes of Web Analytics

HTML

Analytics Service (SaaS)1Log Files

2Page Tagging{JavaScript}

Page 10: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Page Tagging

Page Tagging does not track non-HTML CCD

HTML

Non-HTML

Page 11: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Show Google Scholar direct link graphic

Page 12: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Google Analytics use in academic libraries

Tested 279 academic library websites ARL DLF OCLC-RLP

90% US libraries contained Google tracking code

Page 13: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Data set: Jan 5 - May 17, 2016 (n = 134 days)

Study Participant IR Platform URL

Montana State University ScholarWorks DSpace scholarworks.montana.edu

McMaster University MacSphere DSpace macsphere.mcmaster.ca

University of New Mexico LoboVault DSpace repository.unm.edu

University of Utah USpace CONTENTdm uspace.utah.edu

Page 14: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Most IR activity is Citable Content Downloads

Page 15: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Most IR Activity Unreported by Google Analytics

Page 16: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Page Tagging does not track non-HTML Citable Content Downloads

Non-HTML

Search Analytics

Does!

Page 17: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Typical Page Tagging (GA) Data Types

Page Type Analytics

Pages Events

Citable Content Downloads - ✅

Item Summary ✅ -

Ancillary ✅ -

Page 18: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Montana Method Includes Google Search Console

Page Type Analytics Search

Console

Pages Events Search Analytics

Citable Content Downloads - ✅ ✅

Item Summary ✅ - -

Ancillary ✅ - -

Page 19: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

GA Ancillary Page Views and Item Summary Page Views vs CCD

Page 20: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

All four IR using Google Analytics

Page Type Analytics Search

Console

Pages Events Search Analytics

Citable Content Downloads

- 26,355 562,933

Item Summary 284,303 - -

Ancillary 201,793 - -

CCD Tracking Improvement

2,000%

Page 21: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Montana Method Challenges

❖ Missing non-Google direct link CCD events ● Yahoo● Bing● Email● FB

❖ GSC limits time and access● Moving 90-day window● Granular data = programing skills to access API

Page 22: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

RAMP: Repository Analytics & Metrics Portal

Page 23: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

RAMP - Repository Analytics and Metrics Portal

Cloud Web service Currently accessible and free No training or configuration required Consistent method and terminology Benchmarking across time and organization Request access - [email protected]

Page 24: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

RAMP institutions as of March 3, 2017

Currently tracking over 86,000 digital items from 7 IR and capturing over 10,000 CCD per day that were previously invisible.

Page 25: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:
Page 26: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:
Page 27: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

PublicationsPublished:Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler, and Susan Borda. “Undercounting File Downloads from Institutional Repositories,” Journal of Library Administration, vol. 56, no. 7, 2016

Forthcoming:Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler. “RAMP: Repository Analytics and Metrics Portal: A Prototype Web Service that Accurately Counts Item Downloads from Institutional Repositories,” Library Hi Tech, v35n1, March 2017

Proposal funded by IMLS:”Measuring Up: Assessing Accuracy of Reported Use and Impact of Digital Repositories” - scholarworks.montana.edu/xmlui/handle/1/8924

Page 28: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:

Undercounting Research Team

❖Montana State University●Kenning Arlitsch, Dean @kenning_msu●Patrick OBrien, Semantic Web Research Director @sempob●Leila Sterman, Scholarly Communication Librarian @calamityleila

❖OCLC Research●Jeff Mixter, Software Engineer @jeffmixter

❖University of New Mexico●Jonathan Wheeler, Data Curation Librarian


Recommended