GordanaBudimirInstituteofinformationscience,Maribor,[email protected]
Altmetric analysisinthecontextoftheOpenScienceSlovenia
ThirdWorkshopon"IncentivesandRewardstoengagewithOpenScienceactivities"MutualLearningExerciseonOpenScience-AltmetricsandRewards
12-13September2017,Dubrovnik,Croatia
Slovenian strategy for strengthening the European Research Area 2016-2020
National strategy of open access to scientific publications and research data in Slovenia 2015-2020 (Action Plan for Implementation)
Slovenian Research Agency (ARRS, SRA)
Resolution on Research and Innovation Strategy of Slovenia 2011-2020
Government – Law on Research and Development ActivityMinistry of Education, Science and Sport (MIZŠ)
Methodology for evaluating applications for tenders
Policyandrules
Rules on the co-financing and evaluation procedures and the monitoring of the implementation of research activities
Bibliographic criteria for scientific and professional performance -quantitative assessment
Central Specialised Information Centres (CSICs) for each science field - categorisation of scientific publicationsInstitute of information science (IZUM) – SICRIS, COBISS
PlatformARRSResearchersProjectsProgramsOrganizations
COBISSBibliographicdata(UnioncatalogueCOBIB.SI)
CSICsVerifications
typologyofworks(scientificorprofessional)
COBISS/SciMetAggregator
JCR,SNIPImpactfactorCategoriesofjournals
Lists ofscientificjournals,databases,archives
SICRISBibliographiesReports
WoS,ScopusDataoncitations
AltmetricsAltmetric.comPlumXOpenScienceSlovenia
AuthoridentifiersORCIDScopusAuthorIDResearchersID
OpenAccessSHERPA/Romeo
COBISS/SciMet
1 2 3 4 5 6
scientificexcellenceofresearchers
relevanceofresearcher
achievementsorsupportactivities
abilitytoactandvitalityoftheresearchteam,
scientific,technologicalor
innovationexcellence
potentialimpactdueto
thedevelopment
disseminationanduseofexpected
researchresults
qualityandefficiencyofimplementation,
management,implementedsupport
activityandapplications
Methodologyofevaluation86differentquantitativeandqualitativeindicatorsdividedintogroups
Quantitativeindicators• usedonlyasanentryrequirement• basedonIFquartilesofjournalsinJCR/SNIPandcitations• qualityofpublications (A1) – forlastfive-yearperiod• scientificexcellence- achievementsforlastfive-yearperiod
o A''- exceptionalo A' - high-qualityo A1/2 - important
• visibility (CI)- largenumberofnetcitationsinWoSorScopusfortheperiodofthelasttenyearsregardlessofthepublicationyear
• financing ofotherfunders(A3)• publishingaccordingtotheprinciplesofopenaccess
accessibility
cooperationwithusers
disseminationofresearchresults
publicpresentationandpopularizationof
theproject
linkstosocialandculturalactivities
economic,socialandculturalimpact
frequencyofuse
Relevance&
Impact
Altmetrics• additionalquantitativeindicator (A4) onlyasanentryrequirementforcalls• altimetricdatacapturedbyAltmetric.com, (ALTM),PlumX(PLUM),OpenScience
Sloveniaportal(OSIM)• preliminarystudy- anoverviewofthealtmetricdataforSlovenianresearchers• objectives
o howpublicationsarecoveredbythealtmetricstoolso typesofaltmetriceventso distributionofaltmetricdataacrossscientificdisciplines
• methodso 64,865documentspublishedfrom1970by13,931Slovenianresearcherso atleastoneeventcapturedbyatleastoneofaggregatorsALTM,PLUMorOSIMo scientificdisciplinesdefinedbyresearcherso theprinciplesofwholecounting- publicationwascountedonceineachdiscipline
ofitsauthorso 23/26 differenteventstypeforALTM/PLUM,viewsanddownloadsforOSIM
ResultsResearchers Publications After 2000 Open Access
ALTM 5,061(33%) 8,914(9%) 98% 97%PLUM 10,150(67%) 37,178(36%) 95% 89%OSIM 10,511(69%) 30,000(30%) 88% 16%
ALTM,PLUMorOSIM
13,931(91%) 64,865(63%) 90% 56%
Articles98%
Proceedings1%
Other1%
ALTM
Articles97%
Proceedings2%
Other1%
PLUM
Articles66%
Proceedings9%
Other6%
Books18%
Events1%
OSIM
Scientificdisciplines
• biggestshares ofevents– M,N,BinALTMandPLUM– SinOSIMandPLUM– T,H,IinOSIM
• similar forthetop10th percentileofmostrecordedpublicationsineachaggregator
8 8 5
715 210
2631
21 5
43 39
19
9 14
40
ALTM PLUM OSIM
B S H I M N T
SharesforscienceinALTM,PLUMandOSIM
EventsinAltmetric.com
CITEULIKEMENDELEY50%
CONNOTEA
DOWNLOADSPOSTS20%
ACCOUNTS15%
BLOGS
NEWS1%
QSFORUM
RH
VIDEOS
PINNERS
FBWALLS1%
GPLUS
TWEETERS12%
DELICIOUS
RDTS
WIKIPEDIA
PEERREVIEWSITES
POLICIES
Other
EventsinPlumX
ABSTRACTVIEWS64%
DOWNLOAD
LINKOUTS
HTMLVIEWS16%
PDFVIEWS6%
SUPPORTINGDATAVIEWS
HOLDINGS
SAMPLE_DOWNLOADS
FULLTEXTVIEWS
VIEWS MENDELEY3%
EXPORTSLINKS2%
BOOKMARK
BLOGS
WIKIPEDIANEWS
COMMENTS
BLOGS
REVIEWFACEBOOK
TWEETGPLUSSCORE
CITEDBY CLINICALCITEDBY
Other
EventsinOpenScienceSlovenia
Sharesofeventsbyscience• biggestshare– T,S,N• downloads- approx.10timeslower
thanviews
Correlation• notexistbetweenthemaximum
numberofnetcitationsinWoSorScopusandthenumberofviewsanddownloads
• researchers’rankswithaltmetricvs.citationsdata– 50%:50%
0
10
20
30
40
50
60
70
B D H I M N T X
VIEWCOUNT DOWNLOADCOUNT
EventsbyscienceinAltmetric.comandPlumX
B S H M N T B S H M N T
ALTM PLUM
News
Blogs
Wikipedia
Google+
Tweeter
Mendeley
• similarsharesforcommoneventtypesinALTMandPLUM• B,S,T– 2%– 16%• N,M– 16%- 60%,differencesforTweeter,
Facebook, BlogsandGoogle+• H- <1%,exceptWikipedia(6%)inPLUM
• viewsinPLUM,postsandaccountsinALTM• M,N– 18%- 51%• B,S,T– 4%- 17%• H<2%
Conclusions• coverageofourresearchers'publications in
Altmetric.com,PlumXandOpenScienceSloveniaisquitehigh - journalarticlesandconferenceproceedings,56%inopenaccess
• altimetric datacouldbeusedintheassessmentofsomeimpactofresearchers’outputo ALTMandPLUMappropriate forM,No OSIMforotherscientificdisciplines- overalllackof
DOIsinALTMandPLUM• eventtypesonsocialmediarecorded inALTMandPLUM -
sciencesareevenlycoveredinbothtools• moreresearch
o whatparticularaltmetric eventtypesactuallyreflecto whichofthemcouldbeusedintheassessmento nextstep
?http://blog.cobiss.si
https://www.facebook.com/COBISS.SI
https://www.linkedin.com/company/institute-of-information-science
https://twitter.com/cobissnet
https://www.youtube.com/channel/UCZkUgRB3pMRDxy8hwD2Lj2w
