STIMULATE 5

Ronald RousseauWeb page:

users.telenet.be/ronald.rousseau

Citation analysis

• Advanced partsBibliographic couplingCo-citationCitation context analysis

• The Journal Citation Reports (JCR)Bibliometric indicators

Bibliographic couplingand co-citation

Co-citation network

Co-citation measures

If A is the set of papers citing document X, and B is the set of papers citing document Y, then is the set of documents that cite both X and Y, i.e. that co-cite X and Y.The number of elements in

A BA

, denoted as # ,

is the co-citation frequency of X and Y.

#( ) is the relative co-citation frequency#( )

B A B

A BA B

Citation context analysis

• Cited documents become symbols for the ideas they contain.

• Highly cited documents can be considered as exemplars or concept symbols: illustrations of methods or theories which comprise the essential repertoire of techniques in a specialty.

Citation analysis of scientific journals

• The Journal Citation Reports (JCR)

• The annual publication of the JCR by ISI (nowadays Thomson-ISI) has led to a whole series of indicators. Of these the journal impact factor is the best known.

The publication – citation table

Publ year

2000 2001 2002 2003 2004

# Publ. 35 35 40 40 45# cit rec’d in 2000

5

# cit rec’d in 2001

10 5

# cit rec’d in 2002

15 10 5

# cit rec’d in 2003

15 20 12 6

# cit rec’d in 2004

10 12 16 10 8

The ISI impact factor (synchronous)

Publ year

2000 2001 2002 2003 2004

# Publ. 35 35 40 40 45# cit rec’d in 2000

5 IF(2003)=

# cit rec’d in 2001

10 5 (20+12)/(35+40)

# cit rec’d in 2002

15 10 5 =0.427

# cit rec’d in 2003

15 20 12 6

# cit rec’d in 2004

10 12 16 10 8

Mathematical formulas: the general synchronous impact factor (Rousseau, 1988)

CIT(Y-2,Y) + CIT(Y-1,Y) IF(Y)= --------------------------------- = IF2(Y)

PUB(Y-2) + PUB(Y-1)

1

1

( , )( )

( )

s n

s k sn s n

k s

CIT Y k YIF Y

PUB Y k

Diachronous impact factors

Publ year

2000 2001 2002 2003 2004

# Publ. 35 35 40 40 45# cit rec’d in 2000

5 DIF3(2002) =

# cit rec’d in 2001

10 5 (5+12+16)/ 40

# cit rec’d in 2002

15 10 5 = 0.825

# cit rec’d in 2003

15 20 12 6

# cit rec’d in 2004

10 12 16 10 8

Mathematical formulas: the general diachronous impact factor

1

( , )( )

( )

s n

s k sn

CIT Y Y kDIF Y

PUB Y

The source – item tablePeriod of origin

Period 1 Period 2 Period 3 Period 4 Period 5

# sources

30 35 40 40 45

# items period 1

5

# items period 2

10 5

# items period 3

15 10 5

# items period 4

15 20 12 6

# items period 5

10 12 16 10 8

Examples of general source-item relations• Scientific journal (publishes) articles (receives) citations• Scientific journal (publishes) issues (receives) citations• Scientific journal (publishes) one particular issue (receives)

citations• Congress proceedings (consists of) articles (receives)

citations• Institute (publishes) webpages (receives) inlinks (the institute

web impact factor)• Country (publishes) webpages (receives) inlinks (from other

countries) (country web impact factor)• Fiction author (writes/publishes) books (realizes) sales• Country (publishes) articles in a particular domain (receives)

citations• Journal (publishes) articles (receives) citations in one

particular journal

Generalized impact factors (Frandsen – Rousseau)

Publ year

2000 2001 2002 2003 2004

# Publ. 35 35 40 40 45# cit rec’d in 2000

5

# cit rec’d in 2001

10 5

# cit rec’d in 2002

15 10 5

# cit rec’d in 2003

15 20 12 6

# cit rec’d in 2004

10 12 16 10 8

The median impact factor (MIF): a new impact indicator

( ) / 2( )( , )J

JJ

TOT YMIF YCPUB Y X Y

Here TOT denotes the total number of citations received by journal J in the year Y. CPUB(Y-X,Y) denotes the cumulative number of publications in the journal J, during the period [Y-X, Y]. The symbol X denotes the median cited age.

References

SOMBATSOMPOP, N., MARKPIN, T., PREMKAMOLNETR, N. (2004), A modified method for calculating the impact factors of journals in ISI Journal Citation Reports: polymer science category in 1997-2001. Scientometrics, 60: 217-235.

ROUSSEAU, R. (2005), Median and percentile impact factors: a set of new indicators. Scientometrics, 63: 431-441.

Example: Scientometrics MIF(2003)

• TOT(2003) = 1012 TOT/2 = 506

• The median cited age is 6.53

• The number of articles published during these 6.53 years is 591.75

• The 2003 MIF of Scientometrics is 506/591.75 = 0.855 < ISI IF (1.251).

Y Publ – cum.sum

Cit Cum cit %

03 83 22 2.17

02 84-167 96 11.66

01 91-258 123 23.81

00 82 - 340 85 32.21

99 128-468 68 38.93

98 84-552 78 46.64

97 75-627 64 52.96

Recent trends

Not just the ISI 2-year synchronous impact, but a whole battery of impact factors are used in science evaluation.

What should be the real purpose of research evaluation?

The real goal of any form of research

evaluation is providing those people and institutions that have the talent and motivations to carry out scientific research, with the best conditions possible under which to do so (Russell-Rousseau, 2002).

Evaluation and scientometric research

Budgetary and other kinds of constraints make evaluations

necessary for the equitable distribution of resources. The evaluation of short-term strategic research as well as long-term curiosity-driven search for new knowledge demands the same rigorous standards as scientific research itself.

For this reason the application of bibliometric and

scientometric techniques in research evaluation must keep up with the rapid changes occurring in scientific communication patterns.

Information scientists must also constantly improve the

theoretical foundation for the construction of output and impact indicators supporting peer review (Russell-Rousseau, 2002)