Solutions for Research Evaluation from Thomson Reuters

David Horky

Country Manager – Central & Eastern Europedavid.horky@thomsonreuters.com

Agenda

• Web of Science – Life Demonstration

• EndNote Web – Life Demonstration

• ResearcherID

• Questions

2

Web of Science® : STANDARD for Research Evaluation

• “Multidisciplinary” coverage– enable to analyze the whole context of

scientific research

• “Multiyear” coverage– enable to analyze the history and

development of sciences

• “Cover to Cover” policy– enable to follow the flow of a topic

regardless of communication type

• “ALL Authors, ALL Addresses”– enable to analyze by author name, by

institution

• “ALL Cited References”– enable to perform analyses on

literature that is not indexed

The CONSISTENCY enables large-scale counting and reliable analyses

The CONSISTENCY enables large-scale counting and reliable analyses

2004

Cited References

1974 1998

2000

1993

2003Times Cited

Related Records

2006

2004

1999

2002

1994

20002007

Citation Linking

References

Cite While You Write™

While writing a paper in MS Word, utilize an EndNote Web toolbar to:

Search and “Find Citations” within one’s End Note Web Folders and…

-- insert the appropriate reference within the text and…

-- automatically insert the complete cited reference in the bibliography of the paper…

-- in the format that you choose.

WEB OF SCIENCE JOURNAL SELECTION POLICY

• Why do we select journals?

THOMSON REUTERSJOURNAL CITATION REPORTS

0

20

40

60

80

100

120

0 1000 2000 3000 4000 5000 6000

# of journals

% o

f dat

abas

e

Articles Citations

40% of the journals:

• 80% of the publications

• 92% of cited papers

4% of the journals:

• 30% of the publications

• 51% of cited papers

COMPARE LIKE WITH LIKEWHAT IS THE VALUE OF A CITATION?• Why do people cite?

– Pay homage / give credit to pioneer

– Identifying a methodology

– Provide background reading

– Quotations

– Authenticating data, reproducing work etc

– Corrections

– Criticizing/Disclaiming someone's work/opinions

• Citations are an indicator of an article’s impact and usefulness to the research community; they are the mode by which peers acknowledge each other’s research.

• The value of a citation is only as important as its source. – Clearly a citation from a prestigious peer review journal has more value than a

citation from non-scholarly material.

– How can you be sure that the citing source is reputable?

“When to Cite”, E. Garfield, Library Quarterly, v66, p449-458, 1996

WEB OF SCIENCE JOURNAL SELECTION POLICY

• Approx. 2000 journals evaluated annually

– 10-12% accepted

• Thomson Reuters editors– Information professionals

– Librarians

– Experts in the literature of their subject area

Web of Science

Journals under evaluation

Journal ‘quality’

THOMSON REUTERSJOURNAL SELECTION POLICY

• Publishing Standards– Peer review, Editorial conventions

• Editorial content– Addition to knowledge in specific subject field

• Diversity– International, regional influence of authors, editors, advisors

• Citation analysis– Editors and authors’ prior work

• Thomson Reuters journal selection process:– http://thomsonreuters.com/products_services/science/free/essays/jou

rnal_selection_process/

Region # Journals from Region in Web of Science

Europe 5,573 49%

North America 4,251 38%

Asia-Pacific 965 9%

Latin America 272 2%

Middle East/Africa 200 1%

Language # Journals in Web of Science

English 9114 81%

Other 2147 19%

GLOBAL RESEARCH REPRESENTATIONWEB OF SCIENCE COVERAGE

EVALUATING COUNTRIES

CHANGING NATURE OF HUNGARIAN RESEARCH

13

Hungary averaged just over 3,000 papers a year in the 70s – 90s.Now well over 7,000 papers per year

CHANGING NATURE OF HUNGARIAN RESEARCHINTERNATIONAL COLLABORATION

14

Between 1970 and 1999, 30% of Hungarian papers had at least one international author. In the last decade, 2000 – 2010, this figure has risen to 69%

SCIENTIFIC RESEARCH PRODUCTIVITY IN CENTRAL EUROPE

15Thomson Reuters InCites

SCIENTIFIC RESEARCH IMPACT IN CENTRAL EUROPE

16Thomson Reuters InCites

EVALUATING INSTITUTIONS (1)

EXTERNAL COMPARISONS

EVALUATING INSTITUTIONS

Source: Thomson Reuters

North America University Science Indicators

Number of citations to North American scientific papers

INSTITUTIONAL COMPARISONSCOMPARING IMPACT IN BIOLOGY?

19

Cambridge

Oxford

Stirling

Thomson Reuters InCites

INSTITUTIONAL COMPARISONSIN SPECIFIC FIELDS

20Thomson Reuters InCites

INSTITUTIONAL COMPARISONSBIOLOGY PERFORMANCE

21Thomson Reuters InCites

EVALUATING INSTITUTIONS (2)

INTERNAL ANALYSIS

WHAT IS OUR RESEARCH OUTPUT?

23Thomson Reuters InCites

HOW DID THIS PAPER PERFORM WITHIN ITS JOURNAL / FIELD?

24

Nature articles from this year have been cited 135.52 times

Biochemistry and Molecular Biology articles from this year have been cited 23.98 times

This highly cited article is in the 0.006th percentile in its field

Thomson Reuters InCites

WHICH ARE OUR CENTERS OF EXCELLENCE?

25

Physical Chemistry

Computer Science

41% below average

220% above average

Thomson Reuters InCites

WITH WHOM DOES OUR FACULTY COLLABORATE?

26Thomson Reuters InCites

WHICH OF THOSE COLLABORATIONS ARE THE MOST VALUABLE?

27Thomson Reuters InCites

INCITESCITING ARTICLES LISTING

Thomson Reuters InCites

CITING PAPERSIN THE FIELD OF PHYSICS

29Thomson Reuters InCites

EVALUATING INDIVIDUALS

WHO ARE OUR MOST PRODUCTIVE AUTHORS?

31Thomson Reuters InCites

WHO ARE OURMOST INFLUENTIAL RESEARCHERS?

32Thomson Reuters InCites

WHICH AUTHORS HAVE MOST IMPACT?

33Thomson Reuters InCites

WHICH AUTHORS’ PAPERS HAVE PERFORMED BEST IN THEIR FIELD?

34Thomson Reuters InCites

HOW CAN WE COMPARE RESEARCHERS?

35

Author A: 60 papers Author B: 117 papers

Thomson Reuters InCites

ResearcherID.com

RESEARCHERIDSCHOLARLY RESEARCH COMMUNITY

• Accurate Identification

• Organize and Manage

• Increase Visibility and Recognition

• Measure Performance

• Collaboration

• Security

Science, March 2009

INDIVIDUAL LEVELRESEARCH EVALUATION

View accurate publication list due to unique author identification

See personalized metrics using Web of Science citation data

RESEARCHER IDANALYZE COLLABORATION NETWORK

Seek global collaboration opportunities by author, field, institution or country

RESEARCHER IDVISUALIZE CITING ARTICLES NETWORK

RESEARCHER IDELECTRONIC CV RESOURCE

ResearcherID Profile: http://www.researcherid.com/rid/A-9180-2008

Thank you!

science.thomsonreuters.com/trainingresearchanalytics.thomsonreuters.com/incites

David HorkyCountry Manager – Central & Eastern Europe

david.horky@thomsonreuters.com