48
Altmetrics: the movement, the tools, and the implications Kimberley R. Barker, MLIS Andrea H. Denton, MILS October 8, 2015
| Date post: | 14-Jan-2017 |
| Category: |
Social Media |
| Upload: | krbarker |
| View: | 708 times |
| Download: | 0 times |
Altmetrics: the movement, the tools, and the implications
Kimberley R. Barker, MLIS Andrea H. Denton, MILS
October 8, 2015
Defining altmetrics
• J. Priem (@jasonpriem), I like the term #articlelevelmetrics, but it fails to imply *diversity* of measures. Lately, I'm liking #altmetrics., 4:28 AM - 29 Sep 10, Tweet
• “…the creation and study of new metrics based on the Social Web for analyzing, and informing scholarship.”
– http://altmetrics.org/about/
Defining altmetrics
• Metrics that supplement or complement traditional metrics
Awareness, not promotion!
From metrics to altmetrics
Measures
Traditional
Research Products
Trad
itio
nal
- Article - Chapter - Book
Times Cited Impact Factor + Rank
H-index
From metrics to altmetrics
Measures
Traditional New
Research Products
Trad
itio
nal
- Article - Chapter - Book
Times Cited Impact Factor +
Rank H-index
Page Views Downloads
From metrics to altmetrics
Measures
Traditional New
Research Products
Tr
adit
ion
al
- Article - Chapter - Books
Times Cited Impact Factor +
Rank H-index
Page Views
N
ew
- Dataset - Blog post - More
None
From metrics to altmetrics
Measures
Traditional New
Research Products
Tr
adit
ion
al
- Article - Chapter - Books
Times Cited Impact Factor
+ Rank H-index
Page Views
N
ew
- Datasets - Blog post - More
None
News stories
Blog mentions Tweets
From metrics to altmetrics
Measures
Traditional New
Research Products
Tr
adit
ion
al
- Article - Chapter - Books
Times Cited Impact Factor
+ Rank H-index
Page Views News stories
Blog mentions Tweets
N
ew
- Datasets - Blog post - More
None
News stories
Blog mentions Tweets
Additional scholarly contributions
• Blogs
• Invited Interviews
• Facebook postings
• Datasets
• Patents
• Software
• Copyrights
Examples of “altmeasuring”
• Downloads and page views
• Track-backs
• Tweets and retweets
• Links from review services (e.g. Facultyof1000)
• Sharing, social bookmarking
• News media
New metrics for traditional products
Newer metrics for traditional products
Br J Sports Med doi:10.1136/bjsports-2013-092417
Other influences
NSF “Publications” broadened to “Products of Research” (Jan 2013)
• “citable and accessible including but not limited to publications, data sets, software, patents, and copyrights.“
Other influences
NIH Biosketch new format (Jan 2015)
• other non-publication research products, including audio or video products; patents; data and research materials; databases; educational aids or curricula; instruments or equipment; models; protocols; and software or netware…
Tools
Early altmetric tools
• Measure web views and downloads
–Google Analytics
–Bit.ly
• Measure views and reads of articles
• Google Profiles
• ResearchGate
Journal-level tools
• Each publisher does it a slightly different way
• Examples…
Emerging Tools
• ImpactStory
• Altmetric.com
• PlumX
Impactstory
• Create an online profile
– Discover and share how your research is read, cited, tweeted, bookmarked, and more
– Help colleagues find and read your preprints, articles, slides and other work by uploading research products straight your profile
• Jason Priem and Heather Piwowar
• Free for 30 days, then $60 a year.
Altmetric.com
• London-based start-up
• Funding from Digital Science (LabGuru, FigShare)
Altmetric’s widget (“donut”)
• Used by publishers/journals
–Nature Publishing
–Cell Press
–Wiley
–BioMed Central
–BMJ Specialty journals
What sources does Altmetric track?
News outlets
• Over 1,300 sites
• Manually curated list
• Text mining
• Global coverage
Social media
and blogs
• Twitter, Facebook,
Google+, Sina Weibo
• Public posts only
• Manually curated list
Reference
managers
• Mendeley, CiteULike
• Reader counts
• Don’t count towards the
Altmetric score
Other sources
• Wikipedia
• YouTube
• F1000
• Q&A
Post-publication
peer review
• Publons
• PubPeer
Policy documents
• NICE Evidence
• Intergovernmental Panel
on Climate Change
• Many more…
Altmetric Score
Volume Sources Authors
The score for an article
rises as more people
mention it.
Each source category
contributes a different base
amount to the final score.
How often the author of
each mention talks about
scholarly articles influences
the contribution of the
mention.
The Altmetric score provides an indicator of the attention surrounding a research output. It represents a weighted approximation of all the attention picked up for a research output and is calculated according to three facets:
Cochrane Library paper investigated use of probiotics to
treat eczema: There is not enough evidence to recommend
using probiotics for the treatment of eczema.
The paper has a relatively low score of attention but
received mentions across policy documents and
Wikipedia:
• Royal College of Paediatrics and Child Health -
Allergy Care Pathways for Children: core
competency for health professionals treating
children with eczema
Discovering policy references
Altmetric Explorer
• Subscription product – monitor, search and measure conversations about your publications and those of your competitors
• “Pricing options”
Altmetric Bookmarklet
• Free
• Reading a paper and want to find out its Altmetric details? Install the bookmarklet in your browser
• When viewing the paper, “Altmetric it”
Altmetric Bookmarklet
Plum Analytics
• PlumX is an institutional “impact dashboard” that provides information on how research output is being utilized, interacted with, and talked about around the world
• Gathers metrics (altmetrics) about research from more than thirty sources including PLOS, PubMed and YouTube, and categorizes them
However…
• Standards aren’t fully defined
– Definitions, calculations, etc.
– NISO effort
• Are altmetrics important for discovery? For evaluation? Both?
Issues
Issues
• Impact vs. attention
–David C.’s Improbable Science… “Why you should ignore altmetrics and other bibliometric nightmares”
http://www.dcscience.net/?p=6369
• Popularity
–Popular topics get higher counts, quickly, but then fade. How does this reflect quality?
Issues
• Too much concern on metrics (“culture of measurement”)
• Does social media help promote good science? Or not? (e.g. anti-vaccine)
Altmetrics: where to start?
Altmetrics for Researchers (Duke University Medical Library)
What are your products?
• (Papers, Chapters, Books)
• A clinical protocol?
• Software code?
• Conference poster?
• Teaching materials?
• White paper?
Where are your products?
• A repository?
• Website?
• Profile?
Are they well-described (findable)?
Are they accessible by others?
Are they citable?
Are they downloadable?
Are there metrics to tell you?
What metrics match those products?
Product Metric
Clinical protocol Adoption
Software code Downloads or forks
Conference poster Views
Teaching materials Adoption/adaptation
White paper Views, Tweets
What systems or tools can provide those metrics?
• Journal’s website
–Views, downloads, comparisons
• Repository
–Views, downloads
• Altmetric.com; Impactstory
How will you explain these metrics?
• Contextualize – “This paper was in the top 10% of all papers
downloaded in 2015.”
• Describe “broader impact”
– “This work was picked up by over 100 news sources.”
Pulling it all together
• Online identity
• Personal branding
• Reputation management
Additional Readings
• Altmetrics for Researchers (Duke University Medical Center Library & Archives)
• How to Track the Impact of Research Data with Metrics (Digital Curation Centre)
