1

?

Altmetrics in PracticeWorld Social Science Forum

Montréal – Oct 14, 2013

Mike Buschmanmike@plumanalytics.com

@mikebuschman@plumanalytics

Plum Analytics Confidential 2

Current State of Scholarly Measure

Well-known Problems with Citation Analysis

• Self-citations• Citations added because of pressure by editors• Negative citations• Only about 30% of influences are cited*• “Informal” influence isn’t measured through citations• Secondary sources– Review articles “take” citations away from reviewed articles

• Matthew effect – the rich get richer

* MacRoberts and MacRoberts, 2010

3

4

Legacy Metrics

• Journal Impact Factor– Journal-based

measures only

• Citation Counts– Designed in the

1960’s– Lagging indicator

Plum Analytics Confidential

5

Scholarly Data Exhaust

6

7

PlumX provides access to the full impact spectrum

Our Approach to Altmetrics

•Captures•Mentions•Social Media•Citations•Usage

8

Altmetrics

Different Categories of Impact• Usage• Downloads, views, book holdings, ILL, document

delivery• Captures• Favorites, bookmarks, saves, readers, groups, watchers

• Mentions• Blog posts, news stories, Wikipedia articles,

comments, reviews• Social Media• Tweets, Google +1s, likes, shares, ratings

• Citations• Scopus, PubMed Citations, Microsoft Academic Search,

patents

9

Citations are lagging indicators

• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1

Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.

10

Metrics for Every Copy

11

• 59 Bitly clicks through PLOS• 21 Bitly clicks through DOI link• 92 Delicious bookmarks to PLOS• 2 Delicious bookmarks to PubMed

Plum

Ana

lytic

s Co

nfide

ntial

How can I use these metrics?• New data to compete for grant dollars• Showcase full breadth of impact• New benchmarks

Performing Research

• ROI of research• New data to make funding decisionsFunding

Research

• Uncover hidden data• Add value to IRs and online journals• Recruit / retain “best” authors

Publishing Research 12

Tracks 20+ Types of Artifacts• Articles• Blog posts• Book chapters• Books• Cases• Clinical Trials• Conference Papers• Data Sets• Figures• Grants• Interviews 13

• Letters• Media• Patents• Posters• Presentations• Reports• Source Code• Theses /

Dissertations• Videos• Web Pages

Largest List of Metrics Sources• Amazon• Bit.ly• CrossRef• Delicious• Dryad• dSpace• ePrints• Facebook• Figshare• Github

14

• Google+• Medwave• Mendeley• Microsoft

Academic Search• PLOS• PubMed• Reddit• Research Blogging• Scopus

• SlideShare• SourceForge• Stack Overflow• Twitter• USPTO• Vimeo• Wikipedia• Worldcat• YouTube

PlumX / Smithsonian

15

16

Artifact / Article Level Metrics

Book metrics

17

Research Output Summarized

Clear, visual summaries of each researcher’s or group’s output

18

19

PlumX Author Dashboard

Tabular ViewSortable, table-view of full output.

Exportable to spreadsheets or integrated into other applications.

20

21

Author / Group Visualization

Search: Measuring Present Impact Changes the Game

22

Embed Metrics Everywhere

23

24

25

Some active Projects• University of Pittsburgh

– Rolling out to full university– Metrics for 35 journals

• Cambridge Centre for Health Services– Weekly monitor of impact

of promoting their research

• Royal Society of Chemistry– Pilot to incorporate

researcher-level widget into RSC author profile site

• OHSU– Medical taxonomy + metrics

• VIVO– Apps and tools working group

• University of Alberta– Comparing top business

school researchers

• Anonymous institution– Testing impact of open access

vs. published versions in their repository

Plum Analytics Confidential 26

Groupings & Author Widgets too

27

28

Learn more:

http://www.plumanalytics.comhttps://plu.mx

@plumanalytics@mikebuschman

28Mike Buschman

mike@plumanalytics.com206.331.7297