Ranking WebGlobal strategies for Kazakh Universities
Isidro F. Aguillo, HcDrThe Cybermetrics Lab - CSIC
al-Farabi Kazakh National UniversityAlmaty (Kazakhstan), November 21-22th 2011
2
The Cybermetrics Lab
Researchers belonging to the National Research Council (CSIC)
The largest Spanish research public organization
Recognised by our peers
15 years experience in quantitative analysis and evaluation of scholar communication and academic institutions
Papers in referred scientific journals, contributions to international conferences, reports to governmental bodies
About us
3
Ranking Web or Webometrics
Published since 2004
Two times (January & July) per year
Based on Web indicators
Composite indicator combining web presence of the universities (including academic papers) and impact (link
visibility) of the contents
About the Ranking
http://www.webometrics.info/
4
5
a RANKING of Universities
A table league providing performance ranks
Not an alphabetic ordered list
Not groups of universities in large clusters
Not a template with customisable variables
Not a collection of difficult to understand graphs
Not a series of colourful smileys
Webometrics is …
6
ONE Ranking
A unique list according to an informed model built by experts and scientifically tested
Not several completely different rankings derived from exactly the same data
Not an open system to be customised by young students or scholars without experience or expertise in Higher
Education
Webometrics is …
7
Leiden RankingS
8
a GLOBAL Ranking
Aiming to include all the Higher Education Institutions
Not only the developed countries’ universities
Not only research-intensive universities
Webometrics is …
9
Geographical coverage
3466394
16835
6045
6177108
349140
3945
5102413
19403(Top 1000)
July 2011
10
An ALL-MISSIONS Ranking
Representing all the university missions: Teaching, Research, Technology and Knowledge Transfer,
Community Engagement, Internationalization
Not only the research outputs
Not only the students/faculty ratios
Not only the awards and other excellence driven indicators
Not only hard-sciences based criteria
Webometrics is …
11
Missions reflected on the Web
Activity Impact
Citations Patents MISSIONSUNIVERSITIES RESEARCH TEACHING
COMMUNITYENGAGMENT
TECHNOLOGICALTRANSFER
INTERNATIONAL-IZATION
WORLD-CLASS + + + + + + + + + + + +NATION BUILDING + + + + + + + + + + + +LOCAL + + + + + + + + + <-
---L
inks
----
>
<--------------------------------Surveys-------------------------------->
12
built by SCHOLARS
According to a model, with weighting driven by Informetrics criteria and using the correct mathematical
tools
Not considering political or commercial interests
Not ignoring flaws, biases and mistakes
Not given priority to stability over quality enhancements
Not an anonymous website
Webometrics is …
13
Model
ACTIVITY IMPACT
ARWU (Shanghai) 40% 60%
RANKING
QS (former THES) 30% 70%
TIMES HE (2010) 35% 65%
HEEACT (Taiwan) 20% 80%
WR (Webometrics) 50% 50%
Ratio 1:1
14
Normalization
15
SCORE
RANK
WR
QS
CWTS
ARWUHEEACT
log-norm
z-score
16
USEFUL
Provides meaningful information about the global and national systems and identifying bad practices that
explain the major discrepancies
Not hiding or excluding outliers or institutions difficult to analyse
Not explaining strange results accepted without critical review
Webometrics is …
Academic Digital Divide
17
18
1901 Jacobus Henricus van 't Hoff (Chemistry)1901 Emil Adolf von Behring (Physiology or Medicine)1902 Hermann Emil Fischer (Chemistry)1902 Theodor Mommsen (Literature)1905 Adolf von Baeyer (Chemistry)1905 Robert Koch (Physiology or Medicine)1907 Albert Abraham Michelson (Physics)1907 Eduard Buchner (Chemistry)1908 Paul Ehrlich (Physiology or Medicine)1909 Karl Ferdinand Braun (Physics)1910 Otto Wallach (Chemistry)1910 Albrecht Kossel (Physiology or Medicine)1910 Paul Heyse (Literature)1911 Wilhelm Wien (Physics)1914 Max von Laue (Physics)1915 Richard Willstätter (Chemistry)1918 Fritz Haber (Chemistry)1918 Max Planck (Physics)1920 Walther Nernst (Chemistry)1921 Albert Einstein (Physics)
1925 Gustav Ludwig Hertz (Physics)1925 James Franck (Physics)1925 Richard Adolf Zsigmondy (Chemistry)1928 Adolf Otto Reinhold Windaus (Chemistry)1929 Hans von Euler-Chelpin (Chemistry)1931 Otto Heinrich Warburg (Physiology or Medicine)1932 Werner Heisenberg (Physics)1933 Erwin Schrödinger (Physics)1935 Hans Spemann (Physiology or Medicine)1936 Peter Debye (Chemistry)1939 Adolf Butenandt (Chemistry)1944 Otto Hahn (Chemistry)1950 Kurt Alder (Chemistry)1950 Otto Diels (Chemistry)1953 Fritz Albert Lipmann (Physiology or Medicine)1953 Hans Adolf Krebs (Physiology or Medicine)1954 Max Born (Physics)1956 Walther Bothe (Physics)1991 Bert Sakmann (Physiology or Medicine)2007 Gerhard Ertl (Chemistry)
Nobel Laureates of University of Berlin (1945), splitted in two: Humboldt Universität y Freie Universität, ignored by the Shanghai Ranking (ARWU)
RANKINGS WEBInstitution 2011
Freie Universität Berlin - - 92
Humboldt Universität zu Berlin - - 103
2003 …..… 2011ARWU
Other Rankings
19
Current situation
Ranking Web includes 94 universities (64%) with their own web domain (according to the Ministry of Education there
are 148, of which 74 are cited in English version of Wikipedia)
Two have duplicate central domains
None of them are ranked in the Top 4000
There is no Open Access repositories internationally registered
Kazakh Universities
20
Comparison with research outputs
Low correlation
Link Visibility
Low visibility
Presence in Scholar
No Open Access policies
Popularity
Local impact
24
Kazakh Universities are underperformingin the Ranking Web
Major reason is the lack of quality (research-related) international (English) contents in the Web
Other problems are related to web domain bad practices, lack of support of Open Access initiatives, and centralised short-
term web policies
Web is already the most important scholarly communication tool, so …
Why are you ignoring Webometrics results?
Summarizing …
25
Web presence should reflect the performance, prestige and the impact of the universities
The key variables are content-related, involving everybody in the web publication, not only computer department and
the library but every department, research group, individual scholar, researcher or post-graduate student
ContentsA lot of contents
ContentsQuality contents, specially research results
ContentsInternational contents, in local languages and in English too
Recommendations …
26
CONTACT INFO
Isidro F. Aguillo, HcPhDThe Cybermetrics Lab (CSIC)
Madrid. SPAIN
Questions?
Thank you!