Date post: | 16-Aug-2015 |
Category: |
Data & Analytics |
Upload: | - |
View: | 132 times |
Download: | 4 times |
RESEARCH ASSESSMENT, STRATEGIC PLANNING AND RESEARCH MONITORING IN ST.PETERSBURG STATE UNIVERSITY
Moskaleva OlgaAdvisor to the Director of SPbSU Research Library
WAYS TO USE CITATION INDEXES AND ANALYTIC INSTRUMENTS IN ST.PETERSBURG STATE UNIVERSITY
Development program of St.Petersburg State University Start – 2009 up to 2020 Priority Fields
Biomedicine & Human Health Computer science Ecology, Environmental & Geosciences Nanotechnology & Materials Science Social Science & Management
Creating different Reports Receiving publication data for grant
proposals Choosing organizations for research
collaboration
OBJECTIVES FOR STRATEGIC PLANNING
Presidential decree N599, 07/05/2012 "On Measures for the implementation of state policy in the field of education and science":5 Russian HEI are to be in top-100 of university
rankings till 2020Share of Russian publications in Web of Science
must be 2,44% till 2016 Thus, main attention is paid to quantity
and quality of university research publications
CHOOSING PRIORITY FIELDS
Priority Fields in Russian Federation Existing Competencies in SPbSU Analyzing Subject Area Ranking Comparing the publication dynamics of Russia and
SPbSU in Citation databases (Web of Science, Scopus, Russian Citation Index) and via Benchmarking in SciVal
Choosing the priority fields for Development Program
TARGET RESEARCH INDICATORS IN DEVELOPMENTAL PROGRAM (2020)
Number of publications in Web of Science & Scopus (2250 in 2020)
Number of publications in Science & Nature Publ. Group
Share of research publications in foreign languages
Share of publications in Web of Science & Scopus in international collaboration
Share of academic staff with publications in Web of Science & Scopus
TARGET RESEARCH INDICATORS IN DEVELOPMENTAL PROGRAM (2020)
Share of academic staff involved in Russian and international research grants
Number of patent proposals Share if income from research & IP
transfer Number of academic staff, who
participated in international research conferences
University position if international university rankings
SPBSU PUBLICATIONS IN DIFFERENT CITATION INDEXES (2010-2014)
RISC
Web of Science
Scopus
Natural Sciences
40%
Engi-neering
and Tech-nical…
5%
Medical Sciences5%
Agricultural Sciences
1%
Social Sci-
ences28%
Hu-man-ities21%
PUBLICATIONS OF SPBSU IN RUSSIAN INDEX OF SCIENTIFIC CITATION (HTTP://ELIBRARY.RU )
SS,A&H
ADMINISTRATIVE SOLUTIONS
Staff recruiting according to publication indicators (Quantity & Quality)
Effective contract with Academic staff (salary depends on research results, e.g. publications in Web of Science & Scopus, number of research grants)
Competitive research funding distribution Additional faculty payments depending on
development program indicators Material stimulation of publications in Web of
Science & Scopus
PROGRAM OF PUBLICATION STIMULATION
Main principles of material stimulation for research publications: Additional payments depends on journal rank (2011-
2014 – journal impact-factor, from 2015 – journal quartile)
Research field is taken into account Fractional counting for publications
Results from 2011 till now Increasing of journal publications VS publications in
local collections of papers (especially in Social Science &Humanities)
Increasing of publications in international journals VS local journals
Increasing of publications in Web of Science &Scopus
THE BASIS FOR “QUARTILE” APPROACH TO PUBLICATION ASSESSMENT
The goal – enhancement of journal quality for university publications
Share of publications in top journals – one of indicators in subject ARWU ranking
Good correlation between publications in top journals and Field-weighted citation
Easy way to perform cross-disciplinary comparisons
PUBLICATIONS IN TOP JOURNALS OF DIFFERENT UNIVERSITIES
PUBLICATIONS IN TOP JOURNAL IN DIFFERENT SUBJECT AREAS (OECD)
CHANGES IN STRUCTURE OF PUBLICATION TYPE
2010 2011 2012 2013 20140
20
40
60
80
100
120
140
160Scopus, SS&Hum
2010 2011 2012 2013 20140%
5%
10%
15%
20%
25%
30%
35%
40%
45%
50%
SPbSU IASArticle in book
Article in journal
PUBLICATIONS IN SCOPUS OF DIFFERENT RUSSIAN UNIVERSITIES AFTER THE IMPLEMENTATION OF PUBLICATION STIMULATION PROGRAMS
2009 2010 2011 2012 20130
200
400
600
800
1000
1200
1400
1600
1800
2000
SPbSU
UrFU
HSE
FULL-TEXT ELECRTONIC RESOURCES AND SPBSU PUBLICATIONS
2007 2008 2009 2010 2011 2012 2013 20140
500
1000
1500
2000
2500
0
100,000
200,000
300,000
400,000
500,000
600,000
700,000
800,000
900,000
1,000,000
Whole read documents
Publications in Scopus
Publications in Web of Science
wri
te
read
SPBSU PUBLICATION IN SCOPUS AND SCIENCEDIRECT USAGE
2007 2008 2009 2010 2011 2012 2013 20140
500
1000
1500
2000
2500
0
50,000
100,000
150,000
200,000
250,000
Freedom Collection Elsevier (read documents)
Publications in Scopus
wri
te
read
SCOPUS ALERTS
12/1
1/20
11
1/20
/201
2
2/29
/201
2
4/9/
2012
5/19
/201
2
6/28
/201
2
8/7/
2012
9/16
/201
2
10/2
6/20
12
12/5
/201
2
1/14
/201
3
2/23
/201
3
4/4/
2013
5/14
/201
3
6/23
/201
3
8/2/
2013
9/11
/201
3
10/2
1/20
13
11/3
0/20
13
1/9/
2014
2/18
/201
4
3/30
/201
4
5/9/
2014
6/18
/201
4
7/28
/201
4
9/6/
2014
10/1
6/20
14
11/2
5/20
14
1/4/
2015
2/13
/201
5
3/25
/201
5
5/4/
2015
6/13
/201
5
7/23
/201
50
20
40
60
80
100
120
140
160
180
201120122013201420152016
2011 2012 1013 2014 20150
500
1000
1500
2000
2500
3000
pub
prediction
OBTAINING DATA FOR REPORTS AND GRANT PROPOSALS
University report or proposal
Indicator Source of Information
Monitoring of dissertation councils
List of articles with journal impact factor (for each research specialization)
Source article listing from Scopus or SciVal Overview & Web of Science (InCites)
Monitoring of HEI Number of articles Scopus & Web of Science
Number of citations in certain year of papers, published in previous 5 years
Citation Overview in Scopus & Citation Report in Web of Science
Share of international publications
Collaboration in SciVal Overview
Grant proposals Cumulative impact factor of journals for publications of organization
Source article listing from Scopus or SciVal Overview & Web of Science (InCites)
Number of articles and citations for certain research areas
Scopus & SciVal OverviewWeb of Science (InCites)
TARGET INDICATOR FOR RESEARCH FOUNDATIONS AND ORGANIZATIONS
Number of publications, written with financial support of certain foundation (RFBR, RFH, RSF) or institutionsThe obligate point in all research proposals The goal – to evaluate the effectiveness of
funding from different sources
SOME PROBLEMS IN SCOPUS
The limit of 2000 articles for citation overview
The existing limits for any export Absence of refine options for funding details
PROBLEMS WITH AUTHOR DETAILS
Absence of any export options for the list of authors affiliated with organization
The limitations for the viewing of author list (not more then 4000)
DISCREPANCY WITH SOME JOURNAL DATA IN SCOPUS
THE MAIN WAYS OF SCIVAL USING
Determining of priorities in research activity Determining of budgetary priorities Searching of collaboration partners for
research Determining of certain fields for
collaboration with certain institutions Benchmarking
ОСНОВНЫЕ МОДУЛИ SCIVAL
SUMMARY ON UNIVERSITY PUBLICATIONS
DIFFERENT JOURNAL CLASSIFICATION
SCIENCE MAPS FOR DIFFERENT COUNTRIES
Russian Federation, 2013 Germany, 2013
CIRCLE AND MATRIX SCIENCE MAPS OF SPBSU
CHANGES IN COMPETENCES DURING DEVELOPMENT PROGRAM REALIZATION
2005-2009
2007-2011
• Nanotechnology & Materials Science
• Biomedicine & Human Health
• Ecology, Environmental & Geosciences
• Computer science
• Social Science & Management
79 competencies • 15 “ distinct “ • 64 “emerging”
56 competencies:• 13 “ distinct “• 43 “emerging”
BENCHMARKING
COLLABORATION DATA IN SCIVAL AND EXISTING AGREEMANETS
Collaborating organizations in SciVal
Number of agreements
Germany 93 27
Italy 55 11
France 73 14
USA 227 19
Australia 21 1
Canada 31 4
Brazil 9 2
Finland 14 10
Poland 21 7
China 36 20
INTERNATIONAL COLLABORATION
FINDING POTENTIAL COLLABORATION
GENERAL PROBLEMS IN RUSSIAN SCIENCE Lack of research in corporate sector Lack of real collaboration of academic
science and industry
THE MAIN PROBLEMS IN UNIVERSITY RESEARCH PRESENTATION
Incorrect author affiliation in articles Incorrect selection of journals for publication of
research results Many publications in Russian-language editions,
that are not indexed in international citation databases
Small proportion of open access publications Overall imbalance of research fields - weak
development of the biomedical and social and humanitarian areas
WISH-LIST FOR OPEN ACCESS
To provide easy way to find open-access journals and open-access articles in Scopus
Special conditions for author payment (open-access publications in hybrid journals) to authors from institutions with subscription to certain journals
Agreements with Russian research foundations (RFBR, RFH, RSF) about open-access payments
THE MAIN WAYS TO CORRECT THE SITUATION IN SPBSU
Training for electronic resources and citation databases
Training for Academic writing Stimulation of research publications -
additional payment for articles in high ranking journals and good citation, compensation of publication fees
Development of material-technical base of research in priority fields
SUMMARYScopus and SciVal helps to find
strong and weak areas in institution research
Very convenient for publication monitoring
Good benchmarking instrumentHelps monitoring the existing
collaboration and looking for potential collaboration