Date post: | 07-Nov-2014 |
Category: |
Documents |
Upload: | rafi-ansari |
View: | 95 times |
Download: | 2 times |
GSM Key Performance Indicator(KPI)Guidebook
Version: V1.1
Security Category: Secret
Serviceable range: Radio Planning Section
GSM Network Planning & Optimization Dept. of Engineering Service Division
ZTE Corporation
5
10
15
Secret▲
Work Guidebook for GSM P&O Dept.
Version Introduction
Versio
n
Date Writer Assessor Amendment Records
V1.0 2008-01-21 Chen Chun Zheng Hao None
V1.1 2008-12-07 Yang Jiazhi
Zheng Hao,
Chen Chun,
Fei Aiping
1、V3 KPI and EDGE KPI were added.
2 、 Amendment: mainly directed at
V2.97 and V6.0.
3 、 Some classic KPI cases and
comments were added.
4、Principles for KPI risk analysis were
added.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
5
Secret▲
CONTENTS
1 Overview..........................................................................................................................1
2 CS Radio Service Statistical KPI...................................................................................4
2.1 Availability........................................................................................................................4
2.1.1 SDCCH availability/SDCCH....................................................................................4
2.1.2 TCH availability/TCH...............................................................................................4
2.1.3 Cell utilization...........................................................................................................4
2.2 Accessibility......................................................................................................................5
2.2.1 Random Access Success rate....................................................................................5
2.2.2 SDCCH blocking rate...............................................................................................5
2.2.3 TCH blocking rate.....................................................................................................6
2.2.4 Radio connection ratio..............................................................................................6
2.2.5 SDCCH drop rate......................................................................................................7
2.2.6 SDCCH assignment success rate..............................................................................7
2.2.7 TCH assignment success rate....................................................................................7
2.2.8 Call setup success rate..............................................................................................8
2.3 Mobility.............................................................................................................................9
2.3.1 Handover success rate...............................................................................................9
2.4 Reliability..........................................................................................................................9
2.4.1 TCH Call Drop Rate.................................................................................................9
2.4.2 Traffic Call Drop.....................................................................................................10
2.4.3 Call Completion rate...............................................................................................10
2.4.4 UL RxQual 0-4........................................................................................................11
2.4.5 DL RxQual 0-4........................................................................................................11
2.5 Call Setup time................................................................................................................11
2.5.1 Call setup time (GSM to PSTN)..............................................................................11
2.5.2 Call setup time (GSM to GSM)...............................................................................12
3 CS Radio Service Test KPI...........................................................................................13
3.1 Call Setup Success Rate..................................................................................................13
3.2 Handover Success Rate...................................................................................................13
3.3 Call Drop Rate................................................................................................................13
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
5
10
15
20
25
30
Secret▲
3.4 Coverage (Drive Test).....................................................................................................13
3.4.1 SQI..........................................................................................................................13
3.4.2 MOS........................................................................................................................13
3.4.3 MOS & PSEQ.........................................................................................................15
4 PS Radio Service Statistical KPI.................................................................................18
4.1 Accessibility....................................................................................................................18
4.1.1 DL TBF establishment success rate........................................................................18
4.1.2 UL TBF establishment success rate........................................................................18
4.1.3 GPRS RLC..............................................................................................................18
4.1.4 GPRS RLC..............................................................................................................20
4.1.5 EGPRS RLC............................................................................................................20
4.1.6 EGPRS RLC............................................................................................................20
5 PS Radio Service Test KPI...........................................................................................22
5.1 Accessibility....................................................................................................................22
5.1.1 Attach success rate..................................................................................................22
5.1.2 Average GPRS attach time......................................................................................22
5.1.3 PDP context activation success rate........................................................................22
5.1.4 PDP context activation time....................................................................................23
5.1.5 PING test success rate.............................................................................................23
5.1.6 Average PING test time..........................................................................................23
5.2 Mobility...........................................................................................................................24
5.2.1 Routing Area Update Successful rate.....................................................................24
5.3 Data Throughput.............................................................................................................24
5.3.1 Average FTP download rate....................................................................................24
5.3.2 Average FTP upload rate.........................................................................................25
5.3.3 Throughput..............................................................................................................25
5.4 Reliability........................................................................................................................25
5.4.1 PDTCH Drop Rate..................................................................................................25
6 Introduction to CN Statistical KPI..............................................................................27
6.1 Paging success rate.........................................................................................................27
6.2 Location update success rate...........................................................................................27
6.3 Attach success rate..........................................................................................................27
6.4 GPRS average attach time..............................................................................................28
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
5
10
15
20
25
30
Secret▲
6.5 PDP context activation success rate................................................................................28
6.6 Routing Area Update Success rate..................................................................................28
7 Comments on KPI Cases..............................................................................................30
7.1 Pengshui (Chongqing) PS Test Result.............................................................................30
7.2 Jishou (Hunan) China Mobile EDGE Test Result...........................................................31
7.3 Acceptance requirements for EDGE KPI of Data Service of a network........................33
7.4 Operation & Maintenance KPI of a Network.................................................................34
7.5 Operation & Maintenance KPI of a network in Southeast Asia.....................................37
7.6 KPI requirements for Indonesia Telkomsel network......................................................40
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
5
10
Secret▲
1 Overview
This guidebook collected the Key Performance Indicators (KPI) for CS and PS
services, which are now commonly adopted in presales bidding projects; and the
definitions of different KPIs and counter formulas for V2/V3 are explained here as
well. Meanwhile, with the aim to unify response on KPIs and avoid the possible
market risks, after analyzing the performance indicators of current networks of
both domestic and overseas key projects, the writer provides the reference values
and risk values of different KPIs in this guide. If the KPIs listed in the bidding
documents go beyond the reference values and risk values (suppose risk value of
the KPI is provided; otherwise, suggested values shall be applied.), we need to
conduct risk analysis and evaluation, meanwhile, try to avoid the risk and send out
pre-warning. The KPIs can be quite different due to the differences in network
structure and dimension. To make sure that our KPI can meet requirements in
bidding documents, we need not only support from theories, but accumulation of
work experience as well. The suggested values and risk values of KPI mentioned
in this guide are reference suggestions concluded from the current conditions of
GSM network. As GSM techniques and skills are developing and equipment
performance is improving constantly, the reference standards for KPI will change
accordingly.
The key requirement for engineers engaged in presales network planning is to
thoroughly understand and master the related KPIs, which is also the basic but
highest demand for radio network planning engineers.
Why network operators set up KPIs and what are they aimed at?
How to define KPI and what can be resulted from deviation of KPI?
How much influence can the value of KPI impose on presales bidding?
How to clarify KPI and how to achieve favorable negotiation results during KPI
clarification?
How to avoid and pre-warn KPI risks?
What is the development direction of KPI assessment?
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 1,Total 47 pages
5
10
15
20
25
5
Secret▲
Each presales radio network planning engineer shall possess related techniques of
and up-to-date answers to the six questions above. For lack of space, the six
questions will not be further discussed in this guidebook. The engineers will be
able to experience and get to know them in presales planning work in future.
Generally, KPI can be classified into four types: statistical KPI, testing KPI,
equipment performance KPI, customer perception KPI. Only statistical KPI and
testing KPI are elaborated here. As for equipment performance KPI and customer
perception KPI, they are focused on in another guidebook. Nowadays, network
operators are attaching more and more importance to KPI during negotiations.
Besides the four types mentioned above, a lot more aspects are involved in KPI.
KPI is also closely related to the basic network environment. Therefore, KPI is
affected by various factors. That is why operators are now regarding KPI as a very
important leverage to shift risk and decrease network investment and maintenance
cost. Equipment manufacturers must commit themselves to suitable, reasonable
and timely KPI, so as to bring down contract risk and ensure profits. “Rationalize
commitment, share risks” is an important principle in presales planning work.
The following are the factors that shall be taken into consideration when we work on
KPI:
1. network dimension;
2. network type;
3. degree of subscriber(number) growth;
4. geographical distribution of network(urban, countryside, village)
5. equipment types; there is difference in KPI for V2 and V3.
Functional principles for this guidebook (mainly directed at KPI):
1. This guide is only available to the radio network planning engineers engaged
in presales bidding. No one is entitled to spread it outside or extensively
spread it inside the company. The right to interpret the serviceable range of
this guide remains with GSM Technical Research Section & Resources
Section.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 2,Total 47 pages
5
10
15
20
25
5
Secret▲
2. It is suggested to release the guidebook in encrypted document. It can not be
procured unless logging into document security software.
3. The guide is a reference to radio network planning staff engaged in presales
bidding. It can not replace the presales KPI project evaluation.
4. The KPI values enclosed in this guide are valid within only half a year since
the release of it. After half a year, it needs to be updated and reassessed.
5. The guide is mostly applicable to V2.97 of V2 and V6.0 (ISMG) and V6.1
(Minos) of V3.
Notes: V6.0 (ISMG), V6.1 (Minos), sic passim
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 3,Total 47 pages
5
5
Secret▲
2 CS Radio Service Statistical KPI
2.1 Availability
2.1.1 SDCCH availability/SDCCH
KPI SDCCH availability (SDCCH in service rate)
KPI reference
value
99%
Indicator
definition
SDCCH usable total*100%/(SDCCH usable total +SDCCH unusable total)
Counter
formula
V2 C11601*100%/(C11601+C11602)
V3V6.0 C100030122*100%/( C100030122+ C100030123)
V6.1 C900060122*100%/(C900060122+C900060123)
Notes
The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly
used to examine equipment performance, especially to inspect the utilization of SDCCH in
the cells. It is directly related to the stability of equipment、 transmission and power
supply, etc.. It reflects the utilization ratio of network equipment and the stability of initial
network operation.
2.1.2 TCH availability/TCH
KPI TCH availability (TCH in service rate)
KPI
reference
value
98%
Indicator
definition
TCH usable total*100%/(TCH usable total+ TCCH unusable total)
Counter
formula
V2 C11607*100%/(C11607+C11608)
V3
V6.0(C100030125+C100030134+C100030155)*100% / (C100030125 +
C100030134 + C100030155 + 100030126+ C100030217+ C100030218)
V6.1
(C900060125+C900060134+C900060155)
*100%/(C900060125+C900060134+
C900060155+C900060126+C900060217+C900060218)
Notes
The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used
to examine equipment performance, especially to inspect the utilization of SDCCH in the cells.
It is directly related to the stability of equipment、transmission and power supply, etc..
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 4,Total 47 pages5
Secret▲
2.1.3 Cell utilization
KPI Cell utilization
KPI reference
value
80%
Indicator
definition
Cells, in which ratio of actual traffic / desired traffic<1
Counter
formula
None
Notes
This is mainly to compare performance of preplanning network with that of actual
network. The prerequisite is that precise traffic model、 traffic dispersion、 network
capacity and redundancy rate shall be provided in preplanning period. This KPI is also
related with network configuration and traffic distribution.
2.2 Accessibility
2.2.1 Random Access Success rate
KPI Random Access Success rate
KPI
reference
value
Suggested value 99%
Risk value 99.5%
Indicator
definition
Random access success times *100% / Random access call attempt times
Counter
formula
V2 (C11626+C11696-C11697)*100%/(C11625+C11696)
V3
V6.0(C100030004+C100030010+C100030038-(C100030011 +C100030039))
*100%/(C100030003+C100030010+C100030038)
V6.1(C900060004+C900060010+C900060038-(C900060011 +C900060039))
*100%/(C900060003+C900060010+C900060038)
Notes SDCCH congestion rate shall be taken into consideration, because of its direct influence on
this KPI.
2.2.2 SDCCH blocking rate
KPI SDCCH blocking rate
KPI reference
value
1%
Indicator
definition
Signaling channel congestion times*100% / signaling channel call attempt times
Counter
formula
V2 (C11625-C11626+C11697)*100%/(C11625+C11696)
V3V6.0
(C100030005+C100030011+C100030039) *100%/ (C100030003+
C100030010+C100030038)
V6.1 (C900060005+C900060011+C900060039)*100%/(C900060003+
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 5,Total 47 pages5
Secret▲
C900060010+C900060038)
Notes
This is mainly to evaluate the fitness between preplanned network and actual network. It will
be affected by the following factors:
1. the fitness between network desired capacity and actual capacity; fitness between preset
traffic model and the actual one; 2. burst traffic; 3. lack of SDCCH capacity; 4. internal &
external interference; 5. preplanned redundancy rate; 6. operators’ special requests; 7. FR and
HR used as signaling channel.
2.2.3 TCH blocking rate
KPI TCH blocking rate
KPI
reference
value
2%
Indicator
definitionTCH congestion times*100%/ TCH call attempts
Counter
formula
V2 (C11612-C11699)*100%/(C11611-C11698)
V
3
V6.0
(C100030020+C100030031+C100030043+C100030047+C100030022 +
C100030033+C100030045+C100030049)*100%/(C100030019+C100030030+
C100030042+C100030046+C100030021+C100030032 +C100030044+C100030048)
V6.1
(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+
C900060045+C900060049)*100%/
(C900060019+C900060030+C900060042+C900060046+
C900060021+C900060032+C900060044+C900060048)
Notes
This is mainly to evaluate the fitness between preplanned network and actual network, and the
precondition is that precise traffic model、 traffic dispersion、network capacity and redundancy rate shall
be provided in preplanning period. It is related to the following factors:
1. the fitness between network desired capacity and actual capacity; fitness between preset traffic model
and the actual one; 2. burst traffic; 3. lack of TCH capacity; 4. internal & external interference; 5.
preplanned redundancy rate; 6. handovers.
2.2.4 Radio connection ratio
KPI Radio connection ratio
KPI
reference
value
97%
Indicator
definition(1-signalling channel congestion rate)*(1-voice channel congestion rate)*100%
Counter V2 (1-(C11625-C11626+C11697)*100%/(C11625+C11696))*(1-(C11612-C11699)/(C11611-C11698))
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 6,Total 47 pages5
Secret▲
formulaV
3V6.0
(1-(C100030005+C100030007)*100% / (C100030003+C100030006)) * (1-(C100030011
+C100030020+ C100030031+C100030039 +C100030043 + C100030047 +C100030013+
C100030022 +C100030033+C100030041 +C100030045+C100030049) / (C100030010+
C100030019+ C100030030 + C100030038+ C100030042+C100030046+ C100030012+
C100030021 +C100030032+C100030040 +C100030044+C100030048))
V6.1
(1-(C900060005+C900060011+C900060039)*100%/
(C900060003+C900060010+C900060038))*(1-
(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+
C900060045+C900060049)/(C900060019+C900060030+C900060042+C900060046+
C900060021+C900060032+C900060044+C900060048))
Notes
This is mainly to compare performance of preplanned network with that of actual network. The prerequisite is
that precise traffic model 、 traffic dispersion、 network capacity and redundancy rate shall be provided in
preplanning period. This KPI is in direct tie-in constraint with SDCCH blocking rate and TCH blocking rate.
2.2.5 SDCCH drop rate
KPI SDCCH drop rate
KPI reference
value
Suggested value 0.1%
Risk value 0.05%
Indicator
definition
SDCCH call drop total*100%/(random access call attempts + voice channel call attempts total
(handover excluded)(signalling))
Counter
formula
V2 C11605*100%/(C11625+C11696)
V3 V6.0 C100030053*100%/(C100030003+C100030010+C100030038)
V6.1 C900060053*100%/(C900060003+C900060010+C900060038)
Notes
C11605 accumulates SDCCH call drops resulted from all reasons, including radio link
failure、LAPD link breaks、handover failure, etc., but except the following four reasons: lost
connection with SMM, forced OMC-R disconnection, forced disconnection by other calls, and
other causes. If we compute according to the formula above, SDCCH call drop rate will be rather
low. If counter 116135 is included (BSS call drop times on SDCCH), the suggested KPI value is
0.6%, and suggested risk value 0.4%.
C100030053/C900060053 is used to find out the frequency of call drops resulted from radio
link failure、LAPD link breaks、handover failure. This KPI value is relatively lower.
2.2.6 SDCCH assignment success rate
KPI SDCCH assignment success rate
KPI
reference
value
Suggested value 96%
Risk value 98%
Indicator
definition
SDCCH assignment success rate*100/(SDCCH assignment success times +SDCCH assignment
failure times)
Counter
formula
V2 C11644*100%/( C11644+ C11645)
V3 V6.
0
C100420014*100%/(C100420014+C100420015)
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 7,Total 47 pages5
Secret▲
V6.
1
C901250014*100%/(C901250014+C901250015)
NotesSDCCH assignment success rate is involved with many factors, such as LAPD link、frequency
interference、access parameters, etc..
2.2.7 TCH assignment success rate
KPI TCH assignment success rate
KPI reference
value
Suggested
value
98%
Risk value 99%
Indicator
definition
TCH assignment success times*100/( TCH assignment success times +TCH assignment
failure times)
Counter
formula
V2 C11657*100%/(C11657+C11658)
V3
V6.0
(C100030017+C100030028+C100030036+C100030235 +
C100030199+C100030210)*100%/(C100030017+C100030028
+C100030036+C100030018+C100030029+C100030037+
C100030235+C100030199+C100030210+C100030200+
C100030211+C100030135)
V6.1
(C900060017+C900060028+C900060036+C900060199+
C900060210+C900060235) *100%/(C900060018+C900060029+
C900060037+C900060200+C900060211+C900060135+
C900060017+C900060028+C900060036+C900060199+
C900060210+C900060235)
Notes This KPI is directly related to radio environment 、 frequency carrier
problems、assignment methods、application of data service, etc..
2.2.8 Call setup success rate
KPI Call setup success rate (CSSR)
KPI reference
value I
Suggested value 92%
Risk value` 94%
Indicator
definition I
(1-SDCCH blocking rate)* (1-SDCCH assignment failure rate)*(1-SDCCH drop
rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note I The definition of this CSSR is relatively strict because too many factors are included
(LAC、SMS, etc.). The definition is not rational from the view of voice call, so that the
CSSR used in MOTO excluded SMS factor. Handover is excluded.
KPI reference
value II
Suggested value 93%
Risk value 95%
Indicator
definition II
((MOC success + MTC success) / (MOC attempt + MTC attempt)) *(1-SDCCH drop
rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note II According to common understanding, CSSR is mostly applied to inspect the
establishment of voice call. It is rather reasonable to exclude LAC and SMS. Handover is
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 8,Total 47 pages5
Secret▲
excluded.
KPI reference
value III
Suggested value 97%
Risk value 95%
Indicator
definition III
((MOC success + MTC success) / (MOC attempt + MTC attempt)) *(1-SDCCH drop
rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note III The CSSR is mainly measured in the view of congestion. It is similar to Hutchison’s
definition of CSSR. Handover excluded.
Counter
formula
CSSR is usually obtained from the combination of original KPI.
Explanation
Different manufacturers have different definitions for CSSR. The formula above is
regarded too strict. Some may define it to be TCH assignment success rate or radio access
completion rate. We need to make clear the formula with customers. It is regarded a
favorable way to exclude location update indicators when we define this KPI.
2.3 Mobility
2.3.1 Handover success rate
KPI Handover success rate
KPI reference
value
V2Suggested value 94%
Risk value 96%
V3Suggested value 95%
Risk value 97%
Indicator
definition
Handover success times in busy hours*100% / handover request times in busy hours
Counter
formula
V2(C11618+C11669-C11675)*100%/(C11617+C11668-
C11675)
V3
V6.0
(C100030098+C100030102+C100030120+C100030094+
C100030096)*100 %/ (C100030097+C100030213+
C100030214+ C100030215+C100030099+C100030100
+C100030101+C100030216 +C100030119 +C100030093
+C100030095)
V6.1
(C900060098+C900060102+C900060120+C900060094+
C900060096)
*100%/(C900060097+C900060213+C900060214+
C900060215+C900060099+C900060100+C900060101+
C900060216+C900060119+C900060093+C900060095)
Notes
This formula includes both incoming and outgoing handovers, while some operators may take
into consideration only one of them. As for V3 equipment, 1-2% can be appropriately increased
according to real situations. This KPI can differ a lot from each other due to different types of
network. In many presales bidding, the operators require a handover success rate of around 98%,
which involves high risks to be reached, though several networks have reached 98%.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 9,Total 47 pages5
Secret▲
2.4 Reliability
2.4.1 TCH Call Drop Rate
KPI TCH drop rate / Call drop rate
KPI reference
value
V2Suggested value 1.0%
Risk value 0.7%
V3Suggested value 0.7
Risk value 0.5
Indicator
definition
TCH call drop times*100%/TCH assignment success times
Counter
formula
V2C11615*100%/(C11611-C11698-(C11612+C11656+C11658+
C11617-C11618-C11699-C116103-C116133))
V3
V6.
0
(C100030054+C100030055)*100%/(C100030028+ C100030036+
C100030199+C100030210+ C100030098+C100030102+C100030120)
V6.
1
(C900060054+C900060055) *100%/(C900060028+C900060036+
C900060199+C900060210+C900060098+C900060102+
C900060120)
Notes
Voice channel call drop rate falls into two types: one is with handover included; the other is with
handover excluded. The formula above takes handover in it. If handover is not included, the indicator
will be about 0.2% higher than the one with handover included. This discrepancy is not universally
definite yet, for it can be bigger in dual-band network. Generally, call drop rate of V3 equipment is a
bit lower than the one of V2. This KPI differs a lot in varied types of network. The discrepancy can
reach 0.3%.
2.4.2 Traffic Call Drop
KPI Minute per drop(MPD)
KPI reference
value
V2Suggested value 90
Risk value 120
V3Suggested value 120
Risk value 180
Indicator
definition
Traffic /TCH call drop times*60
Counter
formula
V2 (C11616/3600)*60/C11615
V
3
V6.0((C100030129+C100030127)/3600)*60/
(C100030054+C100030055)
V6.1 ((C900060129+C900060127)/3600)*60/(C900060054+C900060055)
Notes This KPI of different networks varies to a large extent. Generally, it’s difficult for to
reach this KPI’s standards, if the call drop (with handover included) rate is higher than
0.5%.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 10,Total 47 pages5
Secret▲
2.4.3 Call Completion rate
KPI Call Success Rate (CSR)KPI
reference value
Suggested
value
92%
Risk value 94%
Indicator
definition
CSSR*(1- Call drop rate)
Counter
formula
None. Refer to Indicator Definition II under Item 2.2.8
Notes This formula is a customer KPI. We need to make it clear with customers
when referring to this KPI. But it is close to customers’ perception.
2.4.4 UL RxQual 0-4
KPI UL RxQual 0-4
KPI reference
value
Suggested
value
95%
Risk value 97%
Indicator
definition
UL RxQual 0-4 *100 / UL RxQual 0-7
Counter
formula
V2
(C116114+C116115+C116116+C116117+C116118) * 100 / (C116114
+C116115+C116116+C116117+C116118+ C116119
+C116120+C116121)
V3
V6.0
(C100030066+ C100030067+ C100030068+ C100030069+
C100030070)*100/ (C100030066+ C100030067+ C100030068+
C100030069+ C100030070+ C100030071+ C100030072+ C100030073)
V6.1
(C900060066+ C900060067+ C900060068+ C900060069+
C900060070)*100/ (C900060066+ C900060067+ C900060068+
C900060069+ C900060070+ C900060071+ C900060072+ C900060073)
Notes None
2.4.5 DL RxQual 0-4
KPI DL RxQual 0-4
KPI reference
value
Suggested
value
95%
Risk value 97%
Indicator
definition
DL RxQual 0-4 *100 / DL RxQual 0-7
Counter
formula
V2
(C116122+C116123+C116124+C116125+C116126+C116127)* 100 /
(C116122 +C116123+C116124+C116125+C116126 +C116127
+C116128+C116129)
V3 V6. ( C100030074+ C100030075 + C100030076+ C100030077 +
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 11,Total 47 pages5
Secret▲
0C100030078)*100/ ( C100030074+ C100030075 + C100030076+ C100030077 +
C100030078+ C100030079+ C100030080+ C100030081)
V6.
1
( C900060074+ C900060075 + C900060076+ C900060077 +
C900060078)*900/ ( C900060074+ C900060075 + C900060076+ C900060077 +
C900060078+ C900060079+ C900060080+ C900060081)
Notes None
2.5 Call Setup time
2.5.1 Call setup time (GSM to PSTN)
KPI Call setup time (GSM to PSTN)
KPI reference
value
Suggested
value
8 seconds
Risk value 5 seconds
Indicator
definition
time duration from starting call to ringing out
Notes We can use test software to estimate the time duration, which is related with network
structure、routing and radio environment. MSC provides this KPI. It differs in different
network configurations.
2.5.2 Call setup time (GSM to GSM)
KPI Call setup time (GSM to GSM)
KPI reference
value
Suggested
value
7 seconds
Risk value 5 seconds
Indicator
definition
Obtain from test the time duration from starting call to ringing out
Notes We can use test software to estimate the time duration, which is related with network
structure、routing and radio environment. MSC provides this KPI. It differs in different
network configurations.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 12,Total 47 pages5
Secret▲
3 CS Radio Service Test KPI
3.1 Call Setup Success Rate
KPI Call Setup Success Rate
KPI reference
value
Suggested
value
95%
Risk value 98%
Indicator
definition
Call connection times*100% / call attempt times
Indicator value DT&CQT, test pre-defined locations and Drive Test route
Notes None
3.2 Handover Success Rate
KPI Handover Success Rate
KPI reference
value
Suggested
value
95%
Risk value 98%
Indicator
definition
Handover success times*100% / handover attempt times
Indicator value DT&CQT, Pre Defined Drive Test Route or NMS
Notes None
3.3 Call Drop Rate
KPI Call Drop rate
KPI reference
value
Suggested
value
3%
Risk value 2%
Indicator
definition
Call drop times*100% / call connection times
Indicator value DT&CQT, test Pre Defined Drive Test Route or NMS
Notes None
3.4 Coverage (Drive Test)
Urban Suburban Rural Road
Illustration of 85% of the 85% of the 85% of the 85% of the
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 13,Total 47 pages
5
5
Secret▲
coverage
requirement
sample values
should have a value
equal to or higher
than –75 dBm.
sample values
should have a value
equal to or higher
than –80 dBm.
sample values
should have a value
equal to or higher
than –85 dBm.
sample values
should have a value
equal to or higher
than –90 dBm.
Influencing factors 1. landform; 2. inconsistency between project implementation and project plans;
3. test equipment; 4. test routes
Notes
Detailed coverage requirements (as shown above) are delivered in the bid documents.
Estimation of network dimension is also based on the requirements. Nowadays,
requirements for network coverage are higher, so the accordingly estimated number of
sites will meet the needs. If the network dimension has to be reduced due to market
strategies needs, this KPI will cause problems in the acceptance inspection. Further
more, we need to make sure that our customers are aware of regional assignment、DT
routes and test methods. Coverage KPI is one of the most important KPIs, because it
directly reflects not only our radio network planning ability and the performance of our
equipment, but also our core competitive strength in network planning. Due to lack of
space, there is no more illustration of coverage KPI hereafter in this guide.
3.4.1 SQI
KPI SQI
KPI reference
value
Suggested
value
95% sample >=18
Risk value 95% sample >=25
Indicator
definition
TEMS test value
Notes
This KPI is for inspecting the sound distortion degree resulted from incapable link
transmission. The formula is Ericsson’s patent. It takes into consideration many factors,
including BER、 FER、 handover times、 handover conditions、 DTX activated (or
not)、and the encoder in use, etc., to finally get the SQI. There are different SQI top
limits for different types of encoders. For half-rate encoder, the SQI top limit is 19; for
full-rate encoder, 21; for enhanced full-rate encoder, 30. SQI ranges from 18 to 30. SQI
value will increase when EFR is applied.
3.4.2 MOS
KPI Mean Opinion Score ( MOS)
KPI reference
value
Refer to the form attached bellow.
Indicator
definition
Test value
Notes The commonly used MOS assessment method consists of subjective and objective
scoring parts. In the subjective part, engineers subjectively compare the original voice
material and the deteriorated voice material according to ITU-T Suggestion book P.800
and P.830, and give their MOS scores respectively, then average the scores from
different engineers. While in the objective part, PESQ method from ITU-T Suggestion
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 14,Total 47 pages5
Secret▲
book P.862 is employed, that is special equipment or software (e.g. the VQT test
equipment of Agilent) is used to proceed the assessment. In MOS, 0 means the worst
quality, 5 stands for the highest. Standard PCM quality shall reach around 4.4.
The MOS values for commonly used coding formats are as follows:
G.711——MOS= 4.8
G.721、G.723、G.726——MOS= 4.2
G.728 ——MOS=4.2
G.729 ——MOS=4.2
G.723.1(5.3)——MOS=3.5
G.723.1(6.3)——MOS=3.98
MOS can be affected greatly by the performance of test equipment. The test results
from different manufacturers are different. Currently, the test equipment from Actena
performs the best.
Voice version combination
Average MOS(Including FR &HR
MOS)TFO
Frequency
hopping
No frequency
hopping
Frequency
hopping
No frequency
hopping
100% FR 3.04 3.29 100% EFR 3.63 3.57 100% AMR FR 3.56 3.54 60% HR (+EFR) 30% HR (+EFR) 10% HR (+EFR) 60% AMR HR (+AMR FR) 30% AMR HR (+AMR FR) 10% AMR HR (+AMR FR)
3.4.3 MOS & PSEQ
Subjective scoring method had been used in assessment on voice quality until
2001. Users were requested to assess the voice quality of incoming calls by
scoring 1-5 (5- best, 1 - worst). This assessment method was regulated to be a
standard by ITU in August, 1996. MOS assessment method was defined in its
P.800 standard in details. But later it was found that this method not only took too
much time, but also cost a lot. So there was an urgent need for a kind of economic
test equipment, which can be used to simulate the voice quality received by users,
and thus can play its part in designing、testing and debugging new type of voice
encoders.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 15,Total 47 pages
5
10
5
Secret▲
With the aim to meet the need, in February 2001 ITU issued the new test standard
on voice transmission quality-P.862 (PESQ-Perceptual Evaluation of Speech
Quality). It adopts the new algorithm developed by Psytechnics company. PESQ
can be used to compute voice sample’s MOS-LQO value (Mean Opinion Score-
Listening Quality Objective). The computed result and the subjective scoring
result are basically the same. PESQ compares the output signal (collected after the
signal is transmitted through equipment) and the reference signal, then works out
the difference. In the ordinary course of event, the bigger the difference between
the output signal and the reference signal, the smaller the reference value of MOS
will be. PESQ is testified to be a reliable、economic and fast measuring tool for
voice encoder. Compare PESQ’s predicted value and the result from subjective
scoring method, we can see the correlation between the two values is 0.935(refer
to 《P862E.doc》for correlation factors). For 22 kinds of ITU benchmark tests,
the absolute error is within 0.5 MOS, 69.2% among which is within 0.25 MOS. It
is worth our attention that PESQ value ranges from 0.5 to 4.5, while MOS value
ranges from 1 to 5.
Fig 1 MOS/PESQ Correlation Diagram
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 16,Total 47 pages
5
10
15
5
Secret▲
At the present time, there are two types of QOS test method-subjective and
objective methods. MOS subjective test method is defined in ITU-T P.800. The
objective test methods includes PSQM 、 PSQM+ and PESQ etc.. ITU-T
P.862(PESQ)is the method currently recommended by ITU to test end-to-end
network voice quality. It would be ideal if MOS and PESQ are simultaneously
supported in the QOS test.
Form 1 Definition of MOS Values
Level MOS
Excellent 5
Good 4
Fair 3
Poor 2
Bad 1
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 17,Total 47 pages
5
5
Secret▲
4 PS Radio Service Statistical KPI
4.1 Accessibility
4.1.1 DL TBF establishment success rate
KPI DL TBF establishment success rate
KPI reference
value
Suggested value 95%
Risk value 96%
Indicator type Statistical value
Indicator
definition
(GPRS DL signalling TBF link setup times+ GPRS DL data TBF link setup
times +EGPRS DL signalling TBF link setup times +EGPRS DL data TBF link
setup times)*100%/ DL packet channel request times(V3)
Counter
formula
V2 (C70043+C70057+C70071)*100/C70041
V3
V6.0
(C100010007+C100010015+C100010008+C100010016)
*100%/(C100010141+C100010142+C100010143+
C100010144+C100010145+C100010146+C100010147
+C100010148)
V6.1
(C900040007+C900040015+C900040008+C900040016)
*100%/(C900040141+C900040142+C900040143+
C900040144+C900040145+C900040146+C900040147
+C900040148)
Notes
This KPI reflects the request fulfilled status of PS downlink resources. Its TBF
includes DL signaling TBF、GPRS DL data TBF and EGPRS DL data TBF. DL
TBF link setup success rate can reflect the DL PS quality of a cell. Its major
influencing factors are as follows:
1. Interference: internal & external interference;
2. Parameters setting: eg. errors in Timer and functional parameters
3. Stability of equipment and transmission: eg. instant
breakdown(flash) resulted from high error rate or unstable link;
4. Usability of data service functions.
4.1.2 UL TBF establishment success rate
KPI UL TBF establishment success rate
KPI
reference
value
Suggested
value
92%
Risk value 95%
Indicator
type
Statistical value
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 18,Total 47 pages5
Secret▲
Indicator
definition
(GPRS UL signalling TBF link setup times + GPRS UL data TBF link setup times
+EGPRS UL signalling TBF link setup times +EGPRS UL data TBF link setup
times)*100/ UL packet channel request times(V3)
Counter
formula
V2 (C70042+C70055+C70069)*100%/C70040
V3
V6.0
(C100010025+C100010033+C100010026+C100010034)
*100% /(C100010159 +C100010160+C100010161+C100010168
+C100010163+C100010164+ C100010165+C100010166)
V6.1
(C900040025+C900040033 +C900040026 +C900040034)
*100%/ (C900040159+ C900040160
+C900040161+C900040168+C900040163 +C900040164
+C900040165+C900040166)
Notes
This KPI reflects the request fulfilled status of PS uplink resources. Its TBF includes
UL signaling TBF、GPRS UL data TBF and EGPRS UL data TBF. UL TBF link setup
success rate can reflect the UL PS quality of a cell. Its major influencing factors are as
follows:
1. Interference: internal & external interference;
2. Parameters setting: eg. errors in Timer and functional parameters
3. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link;
4. Usability of data service functions.
4.1.3 GPRS RLC
KPI UL GPRS RLC retransmission rate
KPI
reference
value
Suggested
value
10%
Risk value 5%
Indicator
type
Statistical value
Indicator
definition
GPRS UL TBF NACK blocks *100% / valid data statistics received by GPRS UL
TBF
Counter
formula
V2 C70066*100%/ C70065
V3
V6.0C100010063*100%/C100010062
V6.1C900040063*100%/C900040062
Notes This KPI reveals UL GPRS RLC retransmission rate, which is the most important
indicator to reflect the sensibility of GPRS UL service and to show whether
instability、 congestion and interference exist in the system. Its major influencing
factors are as follows:
1. Interference: internal & external interference;
2. Stability of equipment and transmission: eg. instant breakdown resulted
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 19,Total 47 pages5
Secret▲
from high error rate or unstable link;
4.1.4 GPRS RLC
KPI DL GPRS RLC retransmission rate
KPI
reference
value
Suggested
value
10%
Risk value 5%
Indicatory
type
Statistical value
Indicator
definition
GPRS DL TBF NACK blocks *100% / valid data statistics received by GPRS DL
TBF
Counter
formula
V2 C70068*100%/ C70067
V3
V6.0C100010065*100%/C100010064
V6.1C900040065*100%/C900040064
解 读Notes
This KPI reveals DL GPRS RLC retransmission rate, which is the most important
indicator to reflect the sensibility of GPRS DL service and to show whether
instability、 congestion and interference exist in the system. Its major influencing
factors are as follows:
1. Interference: internal & external interference;
2. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link;
4.1.5 EGPRS RLC
KPI UL EGPRS RLC retransmission rate
KPI
reference
value
Suggested
value
10%
Risk value 5%
Indicatory
type
Statistical value
Indicator
definition
EGPRS UL TBF NACK blocks *100% / valid data statistics received by EGPRS UL
TBF
Counter
formula
V2 C70080*100%/ C70079
V3
V6.0C100010071*100%/C100010070
V6.1C900040071*100%/C900040070
解 读Notes
Refer to UL GPRS RLC retransmission rate
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 20,Total 47 pages5
Secret▲
4.1.6 EGPRS RLC
KPI DL EGPRS RLC retransmission rate
KPI
reference
value
Suggested
value
10%
Risk value 5%
Indicatory
type
Statistical value
Indicator
definition
EGPRS DL TBF NACK blocks *100% / valid data statistics received by EGPRS DL
TBF
Counter
formula
V2 C70082*100%/ C70081
V3
V6.0C100010073*100%/C100010072
V6.1C900040073*100%/C900040072
Notes Refer to DL GPRS RLC retransmission rate
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 21,Total 47 pages5
Secret▲
5 PS Radio Service Test KPI
5.1 Accessibility
5.1.1 Attach success rate
KPI Attach success rate
KPI reference
value
Suggested
value
95%
Risk value 98%
Indicator
definition
Attach success times/Attach attempt times×100%
Indicatory
type
test
Counter
formula
None
Notes Normally, this KPI is the CQT value. Attach success means that the
mobile phone receives the Attach Accept signaling within 15 seconds
after it sends the Attach Request. It is required to perform the Attach
test ten times at each test site.
5.1.2 Average GPRS attach time
KPI Average GPRS attach time
KPI reference
value
Suggested value 2 sec
Risk value 1.5 sec
Indicator
definition
Sum of attach success duration/ Attach success times. It is the
duration from the mobile sends out the first Attach Request to it
receives the Attach Accept signaling.
It is required to perform the test ten times at each test site.
Indicatory type Test value
Counter
formula
None
Notes Normally, this KPI is the same as the CQT value.
Authentication included.
5.1.3 PDP context activation success rate
KPI PDP context activation success rate
KPI reference
value
Suggested
value
95%
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 22,Total 47 pages
5
5
Secret▲
Risk value 98%
Indicator
definition
PDP activation success times/attempt times ×100%.
PDP activation success means that the mobile phone receives the
Activate PDP Context Accept signaling 15 seconds after it sends the
Activate PDP Context Request.
Indicatory type Test
Counter
formula
None
Notes Normally, this KPI is the same as the CQT value. It is required to
perform the PDP activation test ten times at each test site. Test methods
for GPRS and EDGE are the same.
5.1.4 PDP context activation time
KPI PDP context activation time
KPI reference
value
Suggested value 1.5 sec
Risk value 1.2 sec
Indicator
definition
Sum of PDP activation duration/ PDP activation success
times.
PDP activation time means the duration from the mobile
phone sends out the first Activate PDP Context Request
to it receives the Activate PDP Context Accept.
Indicatory type Test value
Counter
formula
None
Notes Normally, this KPI is the same as the CQT value.
Authentication included. GPRS and EDGE are not
separated in this test.
5.1.5 PING test success rate
KPI PING test success rate
KPI reference
value
Suggested value 95%
Risk value 98%
Indicator
definition
Ping success times/Ping attempt times*100%
Counter
formula
None
Notes It is regarded as failure if the time exceeds 30 seconds.
5.1.6 Average PING test time
KPI PING test time
KPI reference
value
GPRS Suggested value 1.5 sec
Risk value 1.4 sec
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 23,Total 47 pages5
Secret▲
EDGESuggested value 1 sec
Risk value 0.6 sec
Indicator
definition
Sum of Ping success duration/ Ping success times
Indicatory type Test value
Counter
formula
None
Notes Authentication is included in this KPI. The Ping package
size will have influence on the test result. Generally, the
smaller the Ping package is, the better the test result will be.
It is sometimes referred as Round Trip Time.
5.2 Mobility
5.2.1 Routing Area Update Successful rate
KPI Routing Area Update Success rate
KPI referenceSuggested value 90%
Risk value 95%
Indicator
definition
Routing update attempt times*100% / Routing update success times
Indicatory type test
Counter
formulaNone
Notes Usually it can be statistical value. It also can be obtained from DT too.
5.3 Data Throughput
5.3.1 Average FTP download rate
KPI FTP download rate
KPI
reference
value
GPRS
Suggested value 20kbps
Risk value 30kbps
EDGE
Suggested value 80kbps
Risk value 120kbps
Indicator definition Actual download data quantity (byte)/actual download duration
Indicatory type Test value
Counter formula None
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 24,Total 47 pages5
Secret▲
Notes Normally, this KPI is the CQT value. Class 4 mobile. Size of the
downloaded document will affect the test result. Usually, the
smaller the document size is, the better the test result will be. It is
related to the number of PS channels、terminal type、encoding
method and test software, etc.. The test result can also be
affected by the adoption of encoding method for CS3 and CS4.
3static time slots are configured.
5.3.2 Average FTP upload rate
KPI FTP upload rate
KPI reference
value
GPRS
Suggested value 8kbps
Risk value 10kbps
EDGE
Suggested value 25kbps
Risk value 35kbps
Indicator definition Actual upload data quantity (byte)/actual upload duration
Indicatory type Test value
Counter formula None
Notes Normally, this KPI is the same as the CQT value. Class 4 mobile.
Size of the uploaded document will affect the test result. Usually,
the smaller the document size is, the better the test result will be.
It is related to the number of PS channels 、 terminal
type、encoding method and test software, etc.. The test result can
also be affected by the adoption of encoding method for CS3 and
CS4. This KPI is the result of single time slot.
5.3.3 Throughput
Preconditions
Mobile phone with multi-timeslot Level 8; single
subscriber; 4 DL static signaling channels, 1 UL static
signaling channel
Indicators (EN) Indicators (CN) Suggested value
GPRS: Max data throughput-DL GPRS DL maximum transmission rate 9.8kbyte/s
GPRS: Max data throughput-UL GPRS UL maximum transmission rate 2.4kbyte/s
GPRS: Average data throughput-DL GPRS DL average transmission rate 5kbyte/s
GPRS: Average data throughput-UL GPRS UL average transmission rate 1.3kbyte/s
EDGE: Max data throughput-DL EDGE DL maximum transmission rate 26.5kbyte/s
EDGE: Max data throughput-UL EDGE UL maximum transmission rate 7kbyte/s
EDGE: Average data throughput-DL EDGE DL average transmission rate 14kbyte/s
EDGE: Average data throughput-UL EDGE UL average transmission rate 3.5kbyte/s
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 25,Total 47 pages5
Secret▲
5.4 Reliability
5.4.1 PDTCH Drop Rate
KPI PDTCH Drop Rate
KPI reference
value
Suggested value 5%
Risk value 2%
Indicatory type DT test value
Indicator
definition
PDTCH drop times/ FTP download attempt times *100%
Counter
formula
None
Notes
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 26,Total 47 pages5
Secret▲
6 Introduction to CN Statistical KPI
6.1 Paging success rate
KPI Paging success rate
KPI reference
value
Suggested value 90%
Risk value 93%
Indicator
definition
Paging response times*100% / Paging request times
Counter
formula
Paging request times refer to the sum of PAGING information sent out by all
MSCs in the area, excluding the secondary paging information. Paging response
times refer to the sum of the PAGING RES received by all MSCs in the area,
including the second paging response. Statistical point is at MSC side.
Notes BSC can indirectly provide this KPI, but its statistical point differs from that of
MSC. The difference lies in call loss at Interface A.
6.2 Location update success rate
KPI Location update success rate
KPI reference
value
Provided by the SMC side
Indicator
definition
Location update success times *100%/ location update request times
Counter
formula
Provided by the SMC side
Notes This KPI can be indirectly provided by BSC, but the value is different and it s statistical
point differs from that of MSC too.
6.3 Attach success rate
KPI Attach success rate
KPI reference
value
Suggested value 90%
Risk value 95%
Indicator
definition
GPRS attach success times *100% / GPRS attach times
Indicatory
type
GPRS attach success times : SGSN delivers ( ATTACH
ACCEPT,3GPP TS 24.008),excluding redeliver
Counter
formula
Statistics at SGSN side
Notes excluding Unregistered subs
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 27,Total 47 pages5
Secret▲
6.4 GPRS average attach time
KPI GPRS average attach time
KPI reference
value
Suggested value To be confirmed
Risk value To be confirmed
Indicator
definition
Customer attach establishment duration *100% / customer
number of attach establishment success
Indicatory type Statistics
Counter
formula
Attach establishment time refers to the time duration from the
receipt of GPRS ATTACH REQUEST by MS to the delivery of
ATTACH ACCEPT by SGSN. If the attach time exceeds the
timer, the attach duration is only computed within the attach
accepted period.
Notes
6.5 PDP context activation success rate
KPI PDP context activation success rate
KPI reference
value
Suggested value 80%
Risk value 85%
Indicator
definition
success times of PDP context activation started by MS*100%/
attempt times of PDP context activation started by MS
The attempt times of PDP context activation started by MS is the times
GGSN received Create PDP Context Request from SGSN.
The success times of PDP context activation started by MS is the
statistic of Create PDP Context Response sent from GGSN to SGSN
when Cause value is Request Accepted.
Indicatory type Test or statistics
Counter
formula
Statistics at GGSN side
Notes The performance evaluation in China Mobile in 2003 (success times of
PDP context activation started by GPRS terminal/ attempt times of PDP
context activation started by GPRS) results are as follows:
Excellency index: 94%
Reach-the-mark index: 90%
Lowest Threshold index: 85%
6.6 Routing Area Update Success rate
KPI Routing Area Update Success rate
KPI reference
value
Suggested value 92%
Risk value 95%
Indicator Routing update attempt times*100%/ routing update success times
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 28,Total 47 pages5
Secret▲
definition
Indicatory type From statistical value or DT.
Counter
formulaStatistics at SGSN side, provided by GPRS core network
Notes Update success rate at routing area crossing SGSN is lower than that at the SGSN
routing area.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 29,Total 47 pages5
Secret▲
7 Comments on KPI Cases
7.1 Pengshui (Chongqing) PS Test Result
1、 CQT scene,near cell
2、 EDGE Commissioned
3、 Multi-timeslot capability3+1
4、 Number of PDCH static channels: 3
Test state Test
serialFTP type
FTP
size ( Kbyte
)
Download
speed
(Kbyte/s)
Download
speed (kbps)
Average timeslot
speed(kbps)
Pre-optimization 1Downloa
d102.381 8.99 71.93 23.98
Pre-optimization 2Downloa
d48.18 8.10 64.80 21.60
Pre-optimization 3Downloa
d204.8 2.97 23.78 7.93
Pre-optimization 4Downloa
d2188.817 7.21 57.72 19.24
Pre-optimization 5Downloa
d102.381 9.05 72.42 24.14
Pre-optimization 6Downloa
d102.381 8.66 69.29 23.10
Pre-optimization 7Downloa
d512.304 15.97 127.73 42.58
Pre-optimization 8Downloa
d512.304 13.34 106.69 35.56
Pre-optimization 9Downloa
d512.304 15.81 126.51 42.17
Pre-optimization 10Downloa
d512.304 15.74 125.88 41.96
Pre-optimization 11Downloa
d512.304 14.33 114.67 38.22
Ping
interval
Ping
package
Ping timelag(ms) Averag
e
Ping
success 1 2 3 4 5 6 7 8 9 10
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 30,Total 47 pages
5
5
Secret▲
size(byt timelag rate
0 32 839 634 61261
2608 589 566 765 561 761 655 100%
5 32 816 590 58177
9757
73
3716 692 812 609 709 100%
2 100 571 650 69775
6753
65
1711 729 707 688 691 100%
2 500 839 955107
5
82
1779
73
7918 894 875 840 873 100%
5 500 862 760 85775
5672
81
1690 811 709 825 775 100%
2 800 959 910 86986
9845
82
3781 883 860 846 865 100%
2 1000115
7
115
8880
90
7
102
8
91
8
105
4881
108
2
103
71010 100%
2 1200107
8840 897
95
7
101
7
95
9
119
1
102
0
101
8
104
21002 100%
Comments on case:
1. When C/I is in good condition, the EDGE download speed of current
equipment can reach above 40kbps.
2. The Ping success rate and Ping timelag can vary very much due to different
Ping intervals、 different Ping package sizes and different Ping servers.
7.2 Jishou (Hunan) China Mobile EDGE Test Result
Test Specification
Test equipment:ANT Pilot for E-GPRS;
Test phone SEGAM OT490(one set)
Test laptop: memory 1024M 、 harddisk 80G 、 CPU
1.60Ghz、Windows XP-SP2、standard 28800bps modem、rate at
115200bps、modem error control and compression forbidden、no
software irrelevant to the test.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 31,Total 47 pages
5
10
5
Secret▲
Test method:outdoor static FTP download test Test location:11
sites at Baoqing market in Fenghuang county Test time:19th—
30th, June 2008
Test aim:to test E-FPRS network performance under static state
Test aim:to download 1000KB document
Timeslot :4 static timeslots
Test Result
Branc
h
office
Test sites
Test
documen
t size
(KB)
Test
electrical
level( d
Bm)
Downloa
d timesTest location
RLC
average
rate(Kb
ps)
RLC
average
rate(Kb
ps)
Jishou
Fenghuang County
prefectural government
office building
Cell 1
1000 -44 2 Gate of Prefectural government office 201.19 181.3
Jishou
Fenghuang County
prefectural government
office building
Cell 2
1000 -40 2 Lobby of MingDu Hotel 192.6 198.98
Jishou
Fenghuang County
prefectural government
office building
Cell 3
1000 -51 2 Opposite MingDu Hotel 197.09 206.26
Jishou Old district Cell 1 1000 -49 2Basketball field
of Jiandaoping Primary School197.74 201.79
Jishou Old district Cell 2 1000 -32 2Basketball field
of Jiandaoping Primary School207.29 193.91
Jishou Old district Cell 3 1000 -56 2Kindergarten
next to Jiandaoping Primary School198.83 196.38
Jishou Rainbow Bridge Cell 1 1000 -43 2 Opposite Wanmingta River 185.72 191.1
Jishou Rainbow Bridge Cell 2 1000 -43 2 Opposite Wanmingta River 191.37 181.36
Jishou TianXia Feng Huang Cell 1 1000 -34 2Square in front of
TianXiaFengHuang Hotel197.46 186.55
Jishou TianXia Feng Huang Cell 2 1000 -59 2Square in front of
TianXiaFengHuang Hotel197.09 206.26
Jishou BaoQing market Cell 1 1000 -38 2 Gate of Linlinlou Drug Store 207.85 198.02
Jishou BaoQing market Cell 2 1000 -36 2 Gate of Linlinlou Drug Store 162.16 185.34
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 32,Total 47 pages
5
5
Secret▲
Jishou BaoQing market Cell 3 1000 -46 2 Gate of Linlinlou Drug Store 180.51 180.09
Jishou Xinhua Bookstore Cell 1 1000 -50 2 Lobby of Xinhua Hotel 195.81 191.5
Jishou Xinhua Bookstore Cell 2 1000 -53 2 Lobby of Xinhua Hotel 198.02 188.38
Jishou Xinhua Bookstore Cell 3 1000 -45 2 Parking lot of Xinhua Hotel 183.08 190.16
JishouComprehensive Building Cell
11000 -37 2 Lane, west to ChinaMobile business hall 178.96 157.44
JishouComprehensive Building Cell
21000 -45 2 Gate of XingGuang Hotel 185.46 187.98
JishouComprehensive Building Cell
21000 -60 2 Gate of XingGuang Hotel 184.07 184.45
JishouComprehensive Building
Cell 1800M1 1000 -50 2 Gate of XingGuang Hotel 193.98 184.51
JishouComprehensive Building
Cell 1800M2 1000 -62 2 Gate of XingGuang Hotel 176.22 185.21
Jishou Telecom Bureau Cell 1 1000 -51 2 Business Hall of Telecom Bureau 180.75 197.88
Jishou Telecom Bureau Cell 2 1000 -64 2 Business Hall of Telecom Bureau 171.85 199.19
Jishou Telecom Bureau Cell 3 1000 -57 2Backdoor of Supermarket (next to Telecom
Bureau)182.7 179.49
JishouTelecom Bureau Cell
1800M1 1000 -59 2 Gate of furniture store (next to Telecom Bureau) 105.44 106.48
JishouTelecom Bureau Cell
1800M2 1000 -73 2 Business Hall of Telecom Bureau 181.85 185.85
JishouTelecom Bureau Cell
1800M3 1000 -84 2 Business Hall of Telecom Bureau 159.20 166.92
Comments on case:
1. When C/I is in good condition, the average EDGE download speed can reach
above 180kbps with a peak value of above 200kbps;
2. This test is the CQT. Cell reselection and RAC renewal can be neglected, that
is they are not necessary to the test conditions.
7.3 Acceptance requirements for EDGE KPI of Data Service of a network
Serial Indicators Explanation Formula Target
1 GPRS/EGPRS
attach
success rate
GPRS/EGPRS Attach success
means that the mobile phone
receives the Attach Accept
signaling 15 seconds after it sends
the Attach Request.
GPRS/EGPRS attach
success rate=GPRS Attach
success times/attach
attempt times×100%
>95%
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 33,Total 47 pages
5
5
Secret▲
2 Average
attach time
Attach time means the
duration from the mobile
sends out Attach Request
until it receives GPRS attach
accept signaling.
Average attach time= sum
of attach success
duration /attach success
times
<3s
3 PDP
activation
success rate
PDP activation success means that
the mobile phone receives the
Activate PDP context Accept
signaling 15 seconds after it sends
the Activate PDP Context Request.
PDP activation success
rate = PDP activation
success times/attempt
times×100%
>95%
4 PDP average
activation
time
PDP average activation time
means the duration from
the delivery of Activate PDP
Context Request to the
receipt of Activate PDP
Context Accept by the
mobile phone.
PDP average activation time
= sum of PDP activation
success duration/PDP
activation success times
<3s
5 WAP website
log-in
success rate
WAP website log-in success
means that the homepage
fully and correctly displays
within 60seconds after the
mobile phone started the
WAP website log-in request.
WAP website log-in
success rate=WAP website
log-in success times/
website log-in attempt
times×100%。
>95%
6 average WAP
homepage
displaying
time
WAP homepage displaying
time refers to the duration
from the WAP website log-in
request is sent out until the
homepage fully and
correctly displays.
average WAP homepage
displaying time = sum of
successful homepage
displaying duration / WAP
homepage displaying
success times
<10s
7 WAP
webpage
refresh
success rate
WAP webpage refresh
success means that the
selected webpage can be
refreshed within 60seconds.
WAP webpage refresh
success rate = WAP
webpage refresh success
times / webpage refresh
attempt times×100%。
>95%
8 Ping success
rate
Ping success rate = ping
success times/ping attempt
times×100
>95%
9 Ping average
timelag
Ping average timelag=sum
of each Ping success
duration/ping success times
<2s
10 FTP
download
speed
FTP download speed =actual download data
quantity ( Byte ) /actual
download time(sec)×9
>80kbp
s
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 34,Total 47 pages5
Secret▲
11 FTP upload
speed
FTP upload speed = actual
upload data
quantity ( Byte ) /actual
upload time(sec) ×9
>20kbp
s
Comments on case:
1. Requirements of operation and maintenance KPI are not as strict as those of
acceptance check KPI.
2. Usually these KPI requirements can be satisfied.
7.4 Operation & Maintenance KPI of a Network
SN Indicator Unit Target Level Permissible
Level
Remark
1 SDCCH Drop
Ratio
% 1 1.2 Base on system performance report of
OMCR, Indication Definition: SDCCH
Drop Ratio=SDCCH call drops/ Access
attempt Number
2 TCH Drop
Ratio
% 2 2.2 Base on system performance report of
OMCR, Indication Definition: TCH Drop
Ratio = TCH call drops/ Seized TCHs
(include handover )
3 Call Success
Ratio
% 98 97 Base on system performance report of
OMCR, Indication Definition: Call
Success Rate = 1 - TCH assignment
failure rate
4 SDCCH
Blocking Ratio
% 0.5 0.75 Base on system performance report of
OMCR, Indication Definition: SDCCH
Blocking Ratio=SDCCH overflows/
SDCCH call attempts
5 TCH
Blocking Ratio
% 2 2.5 Base on system performance report of
OMCR, Indication Definition: TCH
Blocking Ratio=TCH overflows (include
handover)/ TCH call attempts (include
handover)
6 TCH
Assignment
Success Ratio
% 98 97 Base on system performance report of
OMCR, Indication Definition: TCH
assignment Success Ratio=Number of
TCH assignment successful / Number of
TCH call attempts (include handover)
7 GPRS average Kbp 28 25 24-Hour measurement
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 35,Total 47 pages
5
5
Secret▲
DL throughout
per TBF
s
8 EDGE average
DL throughout
per TBF
Kbp
s
45 40 24-Hour measurement
9 Attach
Success Rate
(GPRS/ EDGE)
% 99 97 24-Hour measurement
10 Handover
Success Ratio
% 94 93
11 Call Blocking
Ratio
% < 2 for
98% of all
GSM cells
< 2 for
90% of all
GSM cells
Based on OMC-R statistics
12 Call Setup
Success Rate
(Drive Test)
% 97 90 Depend on the DT route and method
13 Call Drop
Rate (Drive
Test)
% 2 3 Depend on the DT route and method
14 Speech
Quality (Drive
Test)
MOS >= 3 for
95% of
measurement
samples
>= 3 for
90% of
measurement
samples
Depend on the DT route and method
15 Coverage
(Drive Test)
dBm >= -85 for
95% of
measurement
samples
>= -85 for
90% of
measurement
samples
Depend on the DT route and method
16 UL
Throughput
Kbps >10 >10 Based on DT
17 DL
Throughput
Kbps >30 >30 Based on DT
18 BSC/RNC
down time
(unscheduled)
% >99.999
(< 6 sec)
>99.999
(< 6 sec)
per BSC/RNC / week
19 TRX/channel
element failure
(unscheduled)
% < 1 of all
active TRX
< 2 of all
active TRX
per BSC/RNC / week
20 SDCCH
Mean Holding
Time
s < 2 < 3 per BSC/RNC / BH of a week
21 Radio Access
Success Ratio
% >99.5 >99 per BSC/RNC / BH of a week
22 Worst Cells Less than Less than per BSC/RNC / BH of a week
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 36,Total 47 pages5
Secret▲
GOS 1.5% cells of
Network with
GOS 5% or
above
1.5% cells of
Network with
GOS 5% or
above
23 RXQUAL 0 to
3
% >97 >95 per BSC/RNC / BH of a week
24 AMR voice
FER
% < 1 <1 per BSC/RNC / BH of a week
Comments on case:
1. This KPI comprises statistical KPI、 testing KPI and equipment performance KPI,
which features detailed classification and all-round evaluation;
2. Requirements for KPIs like GPRS average DL throughout per TBF and EDGE average
DL throughout per TBF are higher.
3. Requirements for evaluation of CS voice quality are higher.
7.5 Operation & Maintenance KPI of a network in Southeast Asia
No.
KPIMeasuremen
tLevel 0 Level 1 Level 2
Scope and interval
1
% of outdoor
area with 2G signal level > -104 dBm
pre-defined Drive test
route>90% >97% >99%
per city / monthly
2
Call Setup Success
Rate (exclude blocking)
pre-defined locations and Drive
test route/NMS
95% >98% >99%per city / BH of a week (drive test monthly)
3Paging Success
RateNMS >90% >95% >97%
per city / BH of week.With condition that Core Network is achived the same value of Level 1 and Level 2
4Call
blocking rate
pre-defined locations and Drive
test route/NMS
<0.5% <0.5% <1%per city / BH of a week (drive test monthly)
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 37,Total 47 pages
5
5
Secret▲
5
Drop Call Rate
(excluding inter RAT)
Pre Defined Drive Test
Route/NMSGSM: <3%
GSM: <2%
GSM: <1%per city / BH of a week (drive test monthly)
6Handover Success
Rate
Pre Defined Drive Test Route or
NMS
>90% >97% >97%
per city / BH of a week (drive test monthly),per city / BH of week.With condition that Core Network is achived the same value of Level 1 and Level 2
9SQI
(TEMS)
Pre Defined Drive Test
Route>20(95%)
> 25(95%)
> 25(95%)Average value per city / BH of a week
10
Call setup delay
(PSTN to MS, time
from number dialed to
ring)
Pre Defined Drive Test
Route<6s < 6s <6s
per Media Gateway/ monthly
11
Call setup delay (MS to PSTN, time from
send pressed to
ring)
Pre Defined Drive Test
Route<5s < 5s <5s
per Media Gateway/ monthly
12Call Setup Successful
RateNMS >95% >98% >99%
per BSC/RNC / BH of a week
13SDCCH Access Success
NMS >99% >99% >99.5%per BSC/RNC / BH of a week
15SDCCH Blocking
Rate
Pre Defined Drive Test
Route/NMS<0.5% <0.5% <1%
per BSC/RNC / BH of a week
(drive test monthly)
16TCH
Blocking Rate
Pre Defined Drive Test
Route/NMS<0.5% <0.5% <1%
per BSC/RNC / BH of a week
(drive test monthly)
18Drop Call
Rate
Pre Defined Drive Test
Route/NMS<5% <2% <1.5%
per BSC/RNC / BH of a week
(drive test monthly)
19Handover Success
Pre Defined Drive Test
Inter BSS: >92% : Inter Cell: >92%
Inter BSS: >97% :
Inter BSS: >97% : Inter Cell: >97%
per BSC/RNC / BH of a week
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 38,Total 47 pages5
Secret▲
Rate Route/NMSInter Cell:
>97%
(drive test monthly)With condition that Core Network is achived the same value of Level 1 and Level 2
20RXQUAL
0 to 3
Pre Defined Drive Test
Route/NMS>80% >85% >90%
per BSC/RNC / BH of a week
(drive test monthly)
21AMR voice
FER
Pre Defined Drive Test
Route/NMS<1% <1% < 1%;
per BSC/RNC / BH of a week
(drive test monthly)
23
Successful PS
Attachment
NMS >98% >98% >98%per city / BH of
a week
24
Successful PDP
context activation
NMS >98% >98% >98%per city / BH of
a week
25
Data session Setup
Success Rate (PDP
context already exist)
Pre Defined Drive Test
Route/NMS>95% >98% >98%
per city / BH of a week
26
Moving MS FTP download 1MB file
Pre Defined Drive test
routeGPRS>30kbps
GPRS (Class 4
MS): >30Kb
GPRS (Class 4 MS):> 30Kbps per city / BH of
a month
27
Moving MS FTP upload
1MB file
Pre Defined Drive test
routeGPRS>8kbps
GPRS (Class 4 MS): > 9Kbps;
GPRS (Class 4 MS): > 9Kbps;
per city / BH of a month
28
Stationary MS near site, FTP download 1MB file
Pre-defined locations
GPRS (Class 4 MS): > 40 Kbps
GPRS (Class 4 MS): > 40 Kbps
GPRS (Class 4 MS): > 40 Kbps
per city / BH of a month
29
Stationary GPRS MS
in cell border,
FTP
Pre-defined locations
GPRS (Class 4 MS): > 20 Kbps
GPRS (Class 4 MS): >
20 Kbps;
GPRS (Class 4 MS): > 20 Kbps;
per city / BH of a month
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 39,Total 47 pages5
Secret▲
download 1MB file
30
Stationary UMTS MS
in cell border (SHO),
FTP download 1MB file
Pre-defined locations
N/A> 150 Kbps
> 150 Kbpsper city / BH of
a month
31PDTCH blocking
rateNMS <0.5% <0.5% <1%;
per BSC / BH of a week
32
60 second data
transfer drop Rate
(MS moving)
Pre Defined Drive Test
Route<3% <2% <1.5%
per city / BH of a week
33
Routing Area
Update Successful
rate
NMS > 95% > 95% >97%per city / BH of
week
34
MS initiated service
setup time
Pre Defined Drive Test
Route<5s <5s <5s
per city / BH of a week
35
MS roundtrip Ping time (20 ping
averaged)
Pre Defined Drive Test
Route<1 <1 <0.8s
per city / BH of a week
36
PDP update
success rate
NMS >98% >98% >99%per city / BH of
a week
Comments on case:
1. This OM KPI just got some of the indicators, excluding the weighing of all
KPIs and 2/3G interoperate KPI, etc.. Due to market factors, the OM KPI of
this network is set unreasonable, and there is risk in some of the KPIs.
2. The evaluation of this KPI falls into three grades. The requirements for
handover success rate and paging success rate are very high, which are
difficult to reach. But the attached prerequisites can lower the risk to some
extent. Besides, the definition of handover success rate varies with different
manufacturers, which we need to make clear with customers in technical
clarification.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 40,Total 47 pages
5
10
5
Secret▲
3. The requirements for data service and voice KPI are higher.
7.6 KPI requirements for Indonesia Telkomsel network
Comments on case
1. The evaluation scale of KPI is relatively large, mainly dealing with statistical
KPI and testing KPI;
2. It ranges from 2G to 3G network. Its service includes voice、GPRS and 3G
data service, etc..
3. The division of KPI evaluation scenes and most KPI values are relatively
reasonable.
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 41,Total 47 pages
5
10
5