Date post: | 09-Oct-2015 |
Category: |
Documents |
Upload: | zulhilmi-m-aslie |
View: | 176 times |
Download: | 25 times |
of 45
GSM Key Performance IndicatorKPIGuidebook
Version: V1.1
Security Category: Secret
Serviceable range: Radio Planning Section
GSM Network Planning & Optimization Dept. of Engineering Service Division
ZTE Corporation
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
Work Guidebook for GSM P&O Dept.
Version Introduction Version Date Writer Assessor Amendment Records
V1.0 2008-01-21 Chen Chun Zheng Hao None
V1.1 2008-12-07 Yang Jiazhi Zheng Hao, Chen Chun, Fei Aiping
1V3 KPI and EDGE KPI were added. 2Amendment: mainly directed at V2.97
and V6.0. 3Some classic KPI cases and comments
were added. 4Principles for KPI risk analysis were
added.
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
CONTENTS
1 Overview...........................................................................................................................1
2 CS Radio Service Statistical KPI....................................................................................4
2.1 Availability ........................................................................................................................4
2.1.1 SDCCH availability/SDCCH ....................................................................................4
2.1.2 TCH availability/TCH ...............................................................................................4
2.1.3 Cell utilization ...........................................................................................................4
2.2 Accessibility ......................................................................................................................5
2.2.1 Random Access Success rate.....................................................................................5
2.2.2 SDCCH blocking rate................................................................................................5
2.2.3 TCH blocking rate .....................................................................................................6
2.2.4 Radio connection ratio...............................................................................................6
2.2.5 SDCCH drop rate ......................................................................................................7
2.2.6 SDCCH assignment success rate...............................................................................7
2.2.7 TCH assignment success rate ....................................................................................7
2.2.8 Call setup success rate ...............................................................................................8
2.3 Mobility .............................................................................................................................9
2.3.1 Handover success rate ...............................................................................................9
2.4 Reliability ..........................................................................................................................9
2.4.1 TCH Call Drop Rate..................................................................................................9
2.4.2 Traffic Call Drop .....................................................................................................10
2.4.3 Call Completion rate................................................................................................10
2.4.4 UL RxQual 0-4 ........................................................................................................11 2.4.5 DL RxQual 0-4 ........................................................................................................11
2.5 Call Setup time ................................................................................................................12
2.5.1 Call setup time (GSM to PSTN)..............................................................................12 2.5.2 Call setup time (GSM to GSM)...............................................................................12
3 CS Radio Service Test KPI ...........................................................................................13
3.1 Call Setup Success Rate ..................................................................................................13
3.2 Handover Success Rate ...................................................................................................13
3.3 Call Drop Rate.................................................................................................................13
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
3.4 Coverage (Drive Test)......................................................................................................13 3.4.1 SQI...........................................................................................................................14 3.4.2 MOS ........................................................................................................................14
3.4.3 MOS & PSEQ .........................................................................................................15
4 PS Radio Service Statistical KPI ..................................................................................18
4.1 Accessibility ....................................................................................................................18
4.1.1 DL TBF establishment success rate .........................................................................18
4.1.2 UL TBF establishment success rate .........................................................................18
4.1.3 GPRS RLC ..............................................................................................................19
4.1.4 GPRS RLC ..............................................................................................................20
4.1.5 EGPRS RLC............................................................................................................20
4.1.6 EGPRS RLC............................................................................................................20
5 PS Radio Service Test KPI............................................................................................22
5.1 Accessibility ....................................................................................................................22
5.1.1 Attach success rate...................................................................................................22
5.1.2 Average GPRS attach time ......................................................................................22
5.1.3 PDP context activation success rate ........................................................................22
5.1.4 PDP context activation time ....................................................................................23
5.1.5 PING test success rate .............................................................................................23
5.1.6 Average PING test time ...........................................................................................23
5.2 Mobility ...........................................................................................................................24
5.2.1 Routing Area Update Successful rate ......................................................................24
5.3 Data Throughput..............................................................................................................24
5.3.1 Average FTP download rate ....................................................................................24
5.3.2 Average FTP upload rate .........................................................................................25
5.3.3 Throughput ..............................................................................................................25
5.4 Reliability ........................................................................................................................25
5.4.1 PDTCH Drop Rate ..................................................................................................25
6 Introduction to CN Statistical KPI...............................................................................27
6.1 Paging success rate ..........................................................................................................27
6.2 Location update success rate ...........................................................................................27
6.3 Attach success rate ..........................................................................................................27
6.4 GPRS average attach time ...............................................................................................28
6.5 PDP context activation success rate ................................................................................28
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
6.6 Routing Area Update Success rate ..................................................................................28
7 Comments on KPI Cases...............................................................................................30
7.1 Pengshui (Chongqing) PS Test Result.............................................................................30 7.2 Jishou (Hunan) China Mobile EDGE Test Result ...........................................................31 7.3 Acceptance requirements for EDGE KPI of Data Service of a network .........................33
7.4 Operation & Maintenance KPI of a Network ..................................................................34
7.5 Operation & Maintenance KPI of a network in Southeast Asia ......................................36
7.6 KPI requirements for Indonesia Telkomsel network .......................................................40
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 1Total 45 pages
1 Overview
This guidebook collected the Key Performance Indicators (KPI) for CS and PS services, which are now commonly adopted in presales bidding projects; and the definitions of different KPIs and counter formulas for V2/V3 are explained here as well. Meanwhile, with the aim to unify response on KPIs and avoid the possible 5 market risks, after analyzing the performance indicators of current networks of both domestic and overseas key projects, the writer provides the reference values and risk values of different KPIs in this guide. If the KPIs listed in the bidding documents go beyond the reference values and risk values (suppose risk value of the KPI is provided; otherwise, suggested values shall be applied.), we need to 10 conduct risk analysis and evaluation, meanwhile, try to avoid the risk and send out pre-warning. The KPIs can be quite different due to the differences in network structure and dimension. To make sure that our KPI can meet requirements in bidding documents, we need not only support from theories, but accumulation of work experience as well. The suggested values and risk values of KPI mentioned in 15 this guide are reference suggestions concluded from the current conditions of GSM network. As GSM techniques and skills are developing and equipment performance is improving constantly, the reference standards for KPI will change accordingly.
The key requirement for engineers engaged in presales network planning is to thoroughly understand and master the related KPIs, which is also the basic but 20 highest demand for radio network planning engineers.
Why network operators set up KPIs and what are they aimed at?
How to define KPI and what can be resulted from deviation of KPI?
How much influence can the value of KPI impose on presales bidding?
How to clarify KPI and how to achieve favorable negotiation results during KPI 25 clarification?
How to avoid and pre-warn KPI risks?
What is the development direction of KPI assessment?
Each presales radio network planning engineer shall possess related techniques of and up-to-date answers to the six questions above. For lack of space, the six 30
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 2Total 45 pages
questions will not be further discussed in this guidebook. The engineers will be able to experience and get to know them in presales planning work in future.
Generally, KPI can be classified into four types: statistical KPI, testing KPI, equipment performance KPI, customer perception KPI. Only statistical KPI and testing KPI are elaborated here. As for equipment performance KPI and customer 5 perception KPI, they are focused on in another guidebook. Nowadays, network operators are attaching more and more importance to KPI during negotiations. Besides the four types mentioned above, a lot more aspects are involved in KPI. KPI is also closely related to the basic network environment. Therefore, KPI is affected by various factors. That is why operators are now regarding KPI as a very 10 important leverage to shift risk and decrease network investment and maintenance cost. Equipment manufacturers must commit themselves to suitable, reasonable and timely KPI, so as to bring down contract risk and ensure profits. Rationalize commitment, share risks is an important principle in presales planning work.
The following are the factors that shall be taken into consideration when we work 15 on KPI:
1. network dimension;
2. network type;
3. degree of subscriber(number) growth;
4. geographical distribution of network(urban, countryside, village) 20
5. equipment types; there is difference in KPI for V2 and V3.
Functional principles for this guidebook (mainly directed at KPI):
1. This guide is only available to the radio network planning engineers engaged
in presales bidding. No one is entitled to spread it outside or extensively spread
it inside the company. The right to interpret the serviceable range of this guide 25
remains with GSM Technical Research Section & Resources Section.
2. It is suggested to release the guidebook in encrypted document. It can not be
procured unless logging into document security software.
3. The guide is a reference to radio network planning staff engaged in presales
bidding. It can not replace the presales KPI project evaluation. 30
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 3Total 45 pages
4. The KPI values enclosed in this guide are valid within only half a year since
the release of it. After half a year, it needs to be updated and reassessed.
5. The guide is mostly applicable to V2.97 of V2 and V6.0 (ISMG) and V6.1 (Minos) of V3.
Notes: V6.0 (ISMG), V6.1 (Minos), sic passim 5
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 4Total 45 pages
2 CS Radio Service Statistical KPI
2.1 Availability
2.1.1 SDCCH availability/SDCCH KPI SDCCH availability (SDCCH in service rate) KPI reference value
99%
Indicator definition
SDCCH usable total*100%/(SDCCH usable total +SDCCH unusable total
V2 C11601*100%/(C11601+C11602) V6.0 C100030122*100%/( C100030122+ C100030123)
Counter formula V3
V6.1 C900060122*100%/(C900060122+C900060123)
Notes
The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used to examine equipment performance, especially to inspect the utilization of SDCCH in the cells. It is directly related to the stability of equipmenttransmission and power supply, etc.. It reflects the utilization ratio of network equipment and the stability of initial network operation.
2.1.2 TCH availability/TCH KPI TCH availability (TCH in service rate) KPI
reference value
98%
Indicator definition
TCH usable total*100%/(TCH usable total+ TCCH unusable total
V2 C11607*100%/(C11607+C11608)
V6.0 (C100030125+C100030134+C100030155)*100% / (C100030125 + C100030134 + C100030155 + 100030126+ C100030217+ C100030218) Counter
formula V3 V6.1
(C900060125+C900060134+C900060155) *100%/(C900060125+C900060134+
C900060155+C900060126+C900060217+C900060218)
Notes The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used to
examine equipment performance, especially to inspect the utilization of SDCCH in the cells. It is directly related to the stability of equipmenttransmission and power supply, etc..
2.1.3 Cell utilization 5 KPI Cell utilization KPI reference 80%
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 5Total 45 pages
value
Indicator definition
Cells, in which ratio of actual traffic / desired traffic
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 6Total 45 pages
used as signaling channel.
2.2.3 TCH blocking rate KPI TCH blocking rate KPI
reference value
2%
Indicator definition
TCH congestion times*100%/ TCH call attempts
V2 C11612-C11699*100%/C11611-C11698
V6.0 (C100030020+C100030031+C100030043+C100030047+C100030022 + C100030033+C100030045+C100030049)*100%/(C100030019+C100030030+ C100030042+C100030046+C100030021+C100030032 +C100030044+C100030048)
Counter formula V
3 V6.1
(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+ C900060045+C900060049)*100%/(C900060019+C900060030+C900060042+C900060046+ C900060021+C900060032+C900060044+C900060048)
Notes
This is mainly to evaluate the fitness between preplanned network and actual network, and the precondition is that precise traffic model traffic dispersionnetwork capacity and redundancy rate shall be provided in preplanning period. It is related to the following factors:
1. the fitness between network desired capacity and actual capacity; fitness between preset traffic model and the actual one; 2. burst traffic; 3. lack of TCH capacity; 4. internal & external interference; 5. preplanned redundancy rate; 6. handovers.
2.2.4 Radio connection ratio KPI Radio connection ratio KPI
reference value
97%
Indicator definition
1-signalling channel congestion rate*(1-voice channel congestion rate)*100%
V2 (1-(C11625-C11626+C11697)*100%/(C11625+C11696))*(1-(C11612-C11699)/(C11611-C11698))
Counter formula V
3 V6.0
(1-(C100030005+C100030007)*100% / (C100030003+C100030006)) * (1-(C100030011 +C100030020+ C100030031+C100030039 +C100030043 + C100030047 +C100030013+ C100030022 +C100030033+C100030041 +C100030045+C100030049) / (C100030010+ C100030019+ C100030030 + C100030038+ C100030042+C100030046+ C100030012+ C100030021 +C100030032+C100030040 +C100030044+C100030048))
V6.1
(1-(C900060005+C900060011+C900060039)*100%/(C900060003+C900060010+C900060038))*(1-(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+
C900060045+C900060049)/(C900060019+C900060030+C900060042+C900060046+
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 7Total 45 pages
C900060021+C900060032+C900060044+C900060048))
Notes This is mainly to compare performance of preplanned network with that of actual network. The prerequisite is that
precise traffic modeltraffic dispersionnetwork capacity and redundancy rate shall be provided in preplanning period. This KPI is in direct tie-in constraint with SDCCH blocking rate and TCH blocking rate.
2.2.5 SDCCH drop rate KPI SDCCH drop rate
Suggested value 0.1% KPI reference value Risk value 0.05% Indicator definition
SDCCH call drop total*100%/(random access call attempts + voice channel call attempts total (handover excluded)signalling)
V2 C11605*100%/(C11625+C11696) V6.0 C100030053*100%/(C100030003+C100030010+C100030038)
Counter formula V3
V6.1 C900060053*100%/(C900060003+C900060010+C900060038)
Notes
C11605 accumulates SDCCH call drops resulted from all reasons, including radio link failureLAPD link breakshandover failure, etc., but except the following four reasons: lost connection with SMM, forced OMC-R disconnection, forced disconnection by other calls, and other causes. If we compute according to the formula above, SDCCH call drop rate will be rather low. If counter 116135 is included (BSS call drop times on SDCCH), the suggested KPI value is 0.6%, and suggested risk value 0.4%.
C100030053/C900060053 is used to find out the frequency of call drops resulted from radio link failureLAPD link breakshandover failure. This KPI value is relatively lower.
2.2.6 SDCCH assignment success rate KPI SDCCH assignment success rate
Suggested value 96% KPI reference value Risk value 98% Indicator definition
SDCCH assignment success rate*100/(SDCCH assignment success times +SDCCH assignment failure times) V2 C11644*100%/( C11644+ C11645)
V6.0
C100420014*100%/C100420014+C100420015) Counter formula V3
V6.1
C901250014*100%/(C901250014+C901250015)
Notes SDCCH assignment success rate is involved with many factors, such as LAPD linkfrequency
interferenceaccess parameters, etc..
2.2.7 TCH assignment success rate KPI TCH assignment success rate KPI reference value
Suggested value
98%
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 8Total 45 pages
Risk value 99% Indicator definition
TCH assignment success times*100/( TCH assignment success times +TCH assignment failure times)
V2 C11657*100%/(C11657+C11658)
V6.0
(C100030017+C100030028+C100030036+C100030235 + C100030199+C100030210)*100%/(C100030017+C100030028 +C100030036+C100030018+C100030029+C100030037+ C100030235+C100030199+C100030210+C100030200+ C100030211+C100030135) Counter
formula V3
V6.1
(C900060017+C900060028+C900060036+C900060199+ C900060210+C900060235) *100%/(C900060018+C900060029+ C900060037+C900060200+C900060211+C900060135+ C900060017+C900060028+C900060036+C900060199+ C900060210+C900060235)
Notes This KPI is directly related to radio environment frequency carrier problems assignment methodsapplication of data service, etc..
2.2.8 Call setup success rate KPI Call setup success rate CSSR
Suggested value 92% KPI reference value I Risk value` 94% Indicator definition I
(1-SDCCH blocking rate)* (1-SDCCH assignment failure rate)*(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note I The definition of this CSSR is relatively strict because too many factors are included (LACSMS, etc.). The definition is not rational from the view of voice call, so that the CSSR used in MOTO excluded SMS factor. Handover is excluded. Suggested value 93% KPI reference
value II Risk value 95% Indicator definition II
((MOC success + MTC success/ (MOC attempt + MTC attempt)) *(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note II According to common understanding, CSSR is mostly applied to inspect the establishment of voice call. It is rather reasonable to exclude LAC and SMS. Handover is excluded. Suggested value 97% KPI reference
value III Risk value 95% Indicator definition III
((MOC success + MTC success/ (MOC attempt + MTC attempt)) *(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note III The CSSR is mainly measured in the view of congestion. It is similar to Hutchisons definition of CSSR. Handover excluded.
Counter formula
CSSR is usually obtained from the combination of original KPI.
Explanation Different manufacturers have different definitions for CSSR. The formula above is
regarded too strict. Some may define it to be TCH assignment success rate or radio access completion rate. We need to make clear the formula with customers. It is regarded a
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 9Total 45 pages
favorable way to exclude location update indicators when we define this KPI.
2.3 Mobility
2.3.1 Handover success rate KPI Handover success rate
Suggested value 94% V2
Risk value 96% Suggested value 95%
KPI reference value
V3 Risk value 97%
Indicator definition
Handover success times in busy hours*100% / handover request times in busy hours
V2 (C11618+C11669-C11675)*100%/(C11617+C11668-
C11675)
V6.0
(C100030098+C100030102+C100030120+C100030094+ C100030096)*100 %/ (C100030097+C100030213+ C100030214+ C100030215+C100030099+C100030100 +C100030101+C100030216 +C100030119 +C100030093 +C100030095)
Counter formula
V3
V6.1
(C900060098+C900060102+C900060120+C900060094+ C900060096)
*100%/(C900060097+C900060213+C900060214+ C900060215+C900060099+C900060100+C900060101+ C900060216+C900060119+C900060093+C900060095)
Notes
This formula includes both incoming and outgoing handovers, while some operators may take into consideration only one of them. As for V3 equipment, 1-2% can be appropriately increased according to real situations. This KPI can differ a lot from each other due to different types of network. In many presales bidding, the operators require a handover success rate of around 98%, which involves high risks to be reached, though several networks have reached 98%.
2.4 Reliability
2.4.1 TCH Call Drop Rate KPI TCH drop rate / Call drop rate
Suggested value 1.0% V2
Risk value 0.7% Suggested value 0.7
KPI reference value
V3 Risk value 0.5
Indicator definition
TCH call drop times*100%/TCH assignment success times
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 10Total 45 pages
V2 C11615*100%/(C11611-C11698-(C11612+C11656+C11658+ C11617-C11618-C11699-C116103-C116133))
V6.0
(C100030054+C100030055)*100%/(C100030028+ C100030036+ C100030199+C100030210+ C100030098+C100030102+C100030120)
Counter formula
V3 V6.1
(C900060054+C900060055) *100%/(C900060028+C900060036+ C900060199+C900060210+C900060098+C900060102+ C900060120)
Notes
Voice channel call drop rate falls into two types: one is with handover included; the other is with handover excluded. The formula above takes handover in it. If handover is not included, the indicator will be about 0.2% higher than the one with handover included. This discrepancy is not universally definite yet, for it can be bigger in dual-band network. Generally, call drop rate of V3 equipment is a bit lower than the one of V2. This KPI differs a lot in varied types of network. The discrepancy can reach 0.3%.
2.4.2 Traffic Call Drop KPI Minute per drop(MPD)
Suggested value 90 V2
Risk value 120 Suggested value 120
KPI reference value
V3 Risk value 180
Indicator definition
Traffic /TCH call drop times*60
V2 (C11616/3600)*60/C11615
V6.0 ((C100030129+C100030127)/3600)*60/ (C100030054+C100030055)
Counter formula V3
V6.1 ((C900060129+C900060127)/3600)*60/(C900060054+C900060055) Notes This KPI of different networks varies to a large extent. Generally, its difficult for to reach
this KPIs standards, if the call drop (with handover included) rate is higher than 0.5%.
2.4.3 Call Completion rate KPI Call Success Rate CSR
Suggested value
92% KPI reference value
Risk value 94% Indicator definition
CSSR*(1- Call drop rate)
Counter formula
None. Refer to Indicator Definition II under Item 2.2.8
Notes This formula is a customer KPI. We need to make it clear with customers when referring to this KPI. But it is close to customers perception.
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 11Total 45 pages
2.4.4 UL RxQual 0-4 KPI UL RxQual 0-4
Suggested value
95% KPI reference value
Risk value 97% Indicator definition
UL RxQual 0-4 *100 / UL RxQual 0-7
V2 (C116114+C116115+C116116+C116117+C116118) * 100 / (C116114 +C116115+C116116+C116117+C116118+ C116119 +C116120+C116121)
V6.0 (C100030066+ C100030067+ C100030068+ C100030069+
C100030070)*100/ (C100030066+ C100030067+ C100030068+ C100030069+ C100030070+ C100030071+ C100030072+ C100030073)
Counter formula
V3
V6.1 (C900060066+ C900060067+ C900060068+ C900060069+
C900060070)*100/ (C900060066+ C900060067+ C900060068+ C900060069+ C900060070+ C900060071+ C900060072+ C900060073)
Notes None
2.4.5 DL RxQual 0-4 KPI DL RxQual 0-4
Suggested value
95% KPI reference value
Risk value 97% Indicator definition
DL RxQual 0-4 *100 / DL RxQual 0-7
V2 (C116122+C116123+C116124+C116125+C116126+C116127)* 100 /
(C116122 +C116123+C116124+C116125+C116126 +C116127 +C116128+C116129)
V6.0
( C100030074+ C100030075 + C100030076+ C100030077 + C100030078)*100/ ( C100030074+ C100030075 + C100030076+ C100030077 + C100030078+ C100030079+ C100030080+ C100030081)
Counter formula
V3 V6.1
( C900060074+ C900060075 + C900060076+ C900060077 + C900060078)*900/ ( C900060074+ C900060075 + C900060076+ C900060077 + C900060078+ C900060079+ C900060080+ C900060081)
Notes None
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 12Total 45 pages
2.5 Call Setup time
2.5.1 Call setup time (GSM to PSTN) KPI Call setup time (GSM to PSTN)
Suggested value
8 seconds KPI reference value
Risk value 5 seconds Indicator definition
time duration from starting call to ringing out
Notes We can use test software to estimate the time duration, which is related with network structurerouting and radio environment. MSC provides this KPI. It differs in different network configurations.
2.5.2 Call setup time (GSM to GSM) KPI Call setup time (GSM to GSM)
Suggested value
7 seconds KPI reference value
Risk value 5 seconds Indicator definition
Obtain from test the time duration from starting call to ringing out
Notes We can use test software to estimate the time duration, which is related with network structurerouting and radio environment. MSC provides this KPI. It differs in different network configurations.
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 13Total 45 pages
3 CS Radio Service Test KPI
3.1 Call Setup Success Rate KPI Call Setup Success Rate
Suggested value
95% KPI reference value
Risk value 98% Indicator definition
Call connection times*100% / call attempt times
Indicator value DT&CQT, test pre-defined locations and Drive Test route Notes None
3.2 Handover Success Rate KPI Handover Success Rate
Suggested value
95% KPI reference value
Risk value 98% Indicator definition
Handover success times*100% / handover attempt times
Indicator value DT&CQT, Pre Defined Drive Test Route or NMS Notes None
3.3 Call Drop Rate KPI Call Drop rate
Suggested value
3% KPI reference value
Risk value 2% Indicator definition
Call drop times*100% / call connection times
Indicator value DT&CQT, test Pre Defined Drive Test Route or NMS Notes None
3.4 Coverage (Drive Test) 5 Urban Suburban Rural Road
Illustration of coverage
85% of the sample values
85% of the sample values
85% of the sample values
85% of the sample values
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 14Total 45 pages
requirement should have a value equal to or higher than 75 dBm.
should have a value equal to or higher than 80 dBm.
should have a value equal to or higher than 85 dBm.
should have a value equal to or higher than 90 dBm.
Influencing factors 1. landform; 2. inconsistency between project implementation and project plans; 3. test equipment; 4. test routes
Notes
Detailed coverage requirements (as shown above) are delivered in the bid documents. Estimation of network dimension is also based on the requirements. Nowadays, requirements for network coverage are higher, so the accordingly estimated number of sites will meet the needs. If the network dimension has to be reduced due to market strategies needs, this KPI will cause problems in the acceptance inspection. Further more, we need to make sure that our customers are aware of regional assignmentDT routes and test methods. Coverage KPI is one of the most important KPIs, because it directly reflects not only our radio network planning ability and the performance of our equipment, but also our core competitive strength in network planning. Due to lack of space, there is no more illustration of coverage KPI hereafter in this guide.
3.4.1 SQI KPI SQI
Suggested value
95% sample >=18 KPI reference value
Risk value 95% sample >=25 Indicator definition
TEMS test value
Notes
This KPI is for inspecting the sound distortion degree resulted from incapable link transmission. The formula is Ericssons patent. It takes into consideration many factors, including BERFERhandover timeshandover conditionsDTX activated (or not)and the encoder in use, etc., to finally get the SQI. There are different SQI top limits for different types of encoders. For half-rate encoder, the SQI top limit is 19; for full-rate encoder, 21; for enhanced full-rate encoder, 30. SQI ranges from 18 to 30. SQI value will increase when EFR is applied.
3.4.2 MOS KPI Mean Opinion Score ( MOS) KPI reference value
Refer to the form attached bellow.
Indicator definition
Test value
Notes The commonly used MOS assessment method consists of subjective and objective scoring parts. In the subjective part, engineers subjectively compare the original voice material and the deteriorated voice material according to ITU-T Suggestion book P.800 and P.830, and give their MOS scores respectively, then average the scores from different engineers. While in the objective part, PESQ method from ITU-T Suggestion book P.862 is employed, that is special equipment or software (e.g. the VQT test equipment of Agilent) is used to proceed
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 15Total 45 pages
the assessment. In MOS, 0 means the worst quality, 5 stands for the highest. Standard PCM quality shall reach around 4.4.
The MOS values for commonly used coding formats are as follows: G.711MOS 4.8 G.721G.723G.726MOS 4.2 G.728 MOS4.2 G.729 MOS4.2 G.723.15.3MOS3.5 G.723.16.3MOS3.98
MOS can be affected greatly by the performance of test equipment. The test results from different manufacturers are different. Currently, the test equipment from Actena performs the best.
Average MOS(Including FR &HR MOS) TFO
Voice version combination Frequency hopping
No frequency hopping
Frequency hopping
No frequency hopping
100% FR 3.04 3.29 100% EFR 3.63 3.57 100% AMR FR 3.56 3.54 60% HR (+EFR) 30% HR (+EFR) 10% HR (+EFR) 60% AMR HR (+AMR FR) 30% AMR HR (+AMR FR) 10% AMR HR (+AMR FR)
3.4.3 MOS & PSEQ
Subjective scoring method had been used in assessment on voice quality until 2001. Users were requested to assess the voice quality of incoming calls by scoring 1-5 (5- best, 1 - worst). This assessment method was regulated to be a standard by ITU 5 in August, 1996. MOS assessment method was defined in its P.800 standard in details. But later it was found that this method not only took too much time, but also cost a lot. So there was an urgent need for a kind of economic test equipment, which can be used to simulate the voice quality received by users, and thus can play its part in designingtesting and debugging new type of voice encoders. 10
With the aim to meet the need, in February 2001 ITU issued the new test standard on voice transmission quality-P.862 (PESQ-Perceptual Evaluation of Speech Quality). It adopts the new algorithm developed by Psytechnics company. PESQ
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 16Total 45 pages
can be used to compute voice samples MOS-LQO value (Mean Opinion Score-Listening Quality Objective). The computed result and the subjective scoring result are basically the same. PESQ compares the output signal (collected after the signal is transmitted through equipment) and the reference signal, then works out the difference. In the ordinary course of event, the bigger the difference between the 5 output signal and the reference signal, the smaller the reference value of MOS will be. PESQ is testified to be a reliableeconomic and fast measuring tool for voice encoder. Compare PESQs predicted value and the result from subjective scoring method, we can see the correlation between the two values is 0.935(refer to P862E.docfor correlation factors). For 22 kinds of ITU benchmark tests, the 10 absolute error is within 0.5 MOS, 69.2% among which is within 0.25 MOS. It is worth our attention that PESQ value ranges from 0.5 to 4.5, while MOS value ranges from 1 to 5.
15 Fig 1 MOS/PESQ Correlation Diagram
At the present time, there are two types of QOS test method-subjective and objective methods. MOS subjective test method is defined in ITU-T P.800. The objective test methods includes PSQMPSQM+ and PESQ etc.. ITU-T P.862 PESQ is the method currently recommended by ITU to test end-to-end 20
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 17Total 45 pages
network voice quality. It would be ideal if MOS and PESQ are simultaneously supported in the QOS test.
Form 1 Definition of MOS Values Level MOS Excellent 5 Good 4 Fair 3 Poor 2
Bad 1
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 18Total 45 pages
4 PS Radio Service Statistical KPI
4.1 Accessibility
4.1.1 DL TBF establishment success rate
KPI DL TBF establishment success rate Suggested value 95% KPI reference
value Risk value 96% Indicator type Statistical value
Indicator definition
GPRS DL signalling TBF link setup times+ GPRS DL data TBF link setup times +EGPRS DL signalling TBF link setup times +EGPRS DL data TBF link setup times*100%/ DL packet channel request timesV3
V2 (C70043+C70057+C70071)*100/C70041
V6.0
(C100010007+C100010015+C100010008+C100010016) *100%/(C100010141+C100010142+C100010143+ C100010144+C100010145+C100010146+C100010147 +C100010148)
Counter formula V3
V6.1
(C900040007+C900040015+C900040008+C900040016) *100%/(C900040141+C900040142+C900040143+ C900040144+C900040145+C900040146+C900040147 +C900040148)
Notes
This KPI reflects the request fulfilled status of PS downlink resources. Its TBF includes DL signaling TBFGPRS DL data TBF and EGPRS DL data TBF. DL TBF link setup success rate can reflect the DL PS quality of a cell. Its major influencing factors are as follows:
1. Interference: internal & external interference; 2. Parameters setting: eg. errors in Timer and functional parameters 3. Stability of equipment and transmission: eg. instant breakdown(flash)
resulted from high error rate or unstable link; 4. Usability of data service functions.
4.1.2 UL TBF establishment success rate KPI UL TBF establishment success rate
Suggested value
92% KPI reference value Risk value 95% Indicator type Statistical value Indicator definition
GPRS UL signalling TBF link setup times + GPRS UL data TBF link setup times +EGPRS UL signalling TBF link setup times +EGPRS UL data TBF link setup times
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 19Total 45 pages
*100/ UL packet channel request timesV3
V2 (C70042+C70055+C70069)*100%/C70040
V6.0 (C100010025+C100010033+C100010026+C100010034) *100% /(C100010159 +C100010160+C100010161+C100010168
+C100010163+C100010164+ C100010165+C100010166) Counter formula
V3
V6.1
(C900040025+C900040033 +C900040026 +C900040034) *100%/ (C900040159+ C900040160
+C900040161+C900040168+C900040163 +C900040164 +C900040165+C900040166)
Notes
This KPI reflects the request fulfilled status of PS uplink resources. Its TBF includes UL signaling TBFGPRS UL data TBF and EGPRS UL data TBF. UL TBF link setup success rate can reflect the UL PS quality of a cell. Its major influencing factors are as follows:
1. Interference: internal & external interference; 2. Parameters setting: eg. errors in Timer and functional parameters 3. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link; 4. Usability of data service functions.
4.1.3 GPRS RLC KPI UL GPRS RLC retransmission rate
Suggested value
10% KPI reference value Risk value 5% Indicator type Statistical value Indicator definition
GPRS UL TBF NACK blocks *100% / valid data statistics received by GPRS UL TBF
V2 C70066*100%/ C70065
V6.0 C100010063*100%/C100010062 Counter
formula V3
V6.1 C900040063*100%/C900040062
Notes
This KPI reveals UL GPRS RLC retransmission rate, which is the most important indicator to reflect the sensibility of GPRS UL service and to show whether instabilitycongestion and interference exist in the system. Its major influencing factors are as follows:
1. Interference: internal & external interference; 2. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link;
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 20Total 45 pages
4.1.4 GPRS RLC KPI DL GPRS RLC retransmission rate
Suggested value
10% KPI reference value
Risk value 5% Indicatory type
Statistical value
Indicator definition
GPRS DL TBF NACK blocks *100% / valid data statistics received by GPRS DL TBF
V2 C70068*100%/ C70067
V6.0 C100010065*100%/C100010064 Counter
formula V3
V6.1 C900040065*100%/C900040064
Notes
This KPI reveals DL GPRS RLC retransmission rate, which is the most important indicator to reflect the sensibility of GPRS DL service and to show whether instabilitycongestion and interference exist in the system. Its major influencing factors are as follows:
1. Interference: internal & external interference; 2. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link;
4.1.5 EGPRS RLC KPI UL EGPRS RLC retransmission rate
Suggested value
10% KPI reference value Risk value 5% Indicatory type
Statistical value
Indicator definition
EGPRS UL TBF NACK blocks *100% / valid data statistics received by EGPRS UL TBF
V2 C70080*100%/ C70079
V6.0 C100010071*100%/C100010070 Counter
formula V3
V6.1 C900040071*100%/C900040070
Notes Refer to UL GPRS RLC retransmission rate
4.1.6 EGPRS RLC KPI DL EGPRS RLC retransmission rate
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 21Total 45 pages
Suggested value
10% KPI reference value Risk value 5%
Indicatory type
Statistical value
Indicator definition
EGPRS DL TBF NACK blocks *100% / valid data statistics received by EGPRS DL TBF
V2 C70082*100%/ C70081
V6.0 C100010073*100%/C100010072 Counter
formula V3
V6.1 C900040073*100%/C900040072
Notes Refer to DL GPRS RLC retransmission rate
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 22Total 45 pages
5 PS Radio Service Test KPI
5.1 Accessibility
5.1.1 Attach success rate
KPI Attach success rate
Suggested value
95% KPI reference value
Risk value 98% Indicator definition
Attach success times/Attach attempt times100
Indicatory type
test
Counter formula
None
Notes Normally, this KPI is the CQT value. Attach success means that the mobile phone receives the Attach Accept signaling within 15 seconds after it sends the Attach Request. It is required to perform the Attach test ten times at each test site.
5.1.2 Average GPRS attach time KPI Average GPRS attach time
Suggested value 2 sec KPI reference value Risk value 1.5 sec
Indicator definition
Sum of attach success duration/ Attach success times. It is the duration from the mobile sends out the first Attach Request to it receives the Attach Accept signaling. It is required to perform the test ten times at each test site.
Indicatory type Test value Counter formula
None
Notes Normally, this KPI is the same as the CQT value. Authentication included.
5.1.3 PDP context activation success rate 5
KPI PDP context activation success rate
KPI reference value
Suggested value
95%
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 23Total 45 pages
Risk value 98% Indicator definition
PDP activation success times/attempt times 100. PDP activation success means that the mobile phone receives the Activate PDP Context Accept signaling 15 seconds after it sends the Activate PDP Context Request.
Indicatory type Test Counter formula
None
Notes Normally, this KPI is the same as the CQT value. It is required to perform the PDP activation test ten times at each test site. Test methods for GPRS and EDGE are the same.
5.1.4 PDP context activation time
KPI PDP context activation time
Suggested value 1.5 sec KPI reference value Risk value 1.2 sec
Indicator definition
Sum of PDP activation duration/ PDP activation success times. PDP activation time means the duration from the mobile phone sends out the first Activate PDP Context Request to it receives the Activate PDP Context Accept.
Indicatory type Test value Counter formula
None
Notes Normally, this KPI is the same as the CQT value. Authentication included. GPRS and EDGE are not separated in this test.
5.1.5 PING test success rate KPI PING test success rate
Suggested value 95% KPI reference value Risk value 98% Indicator definition
Ping success times/Ping attempt times*100%
Counter formula
None
Notes It is regarded as failure if the time exceeds 30 seconds.
5.1.6 Average PING test time KPI PING test time
Suggested value 1.5 sec KPI reference value
GPRS Risk value 1.4 sec
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 24Total 45 pages
Suggested value 1 sec EDGE
Risk value 0.6 sec Indicator definition
Sum of Ping success duration/ Ping success times
Indicatory type Test value Counter formula
None
Notes Authentication is included in this KPI. The Ping package size will have influence on the test result. Generally, the smaller the Ping package is, the better the test result will be. It is sometimes referred as Round Trip Time.
5.2 Mobility
5.2.1 Routing Area Update Successful rate KPI Routing Area Update Success rate
Suggested value 90% KPI reference
Risk value 95% Indicator definition
Routing update attempt times*100% / Routing update success times
Indicatory type test Counter formula
None
Notes Usually it can be statistical value. It also can be obtained from DT too.
5.3 Data Throughput
5.3.1 Average FTP download rate KPI FTP download rate
Suggested value 20kbps GPRS
Risk value 30kbps Suggested value 80kbps
KPI
reference value EDGE
Risk value 120kbps Indicator definition Actual download data quantity (byte)/actual download duration Indicatory type Test value Counter formula None Notes Normally, this KPI is the CQT value. Class 4 mobile. Size of the
downloaded document will affect the test result. Usually, the smaller the document size is, the better the test result will be. It is related to the number of PS channelsterminal typeencoding method and test software, etc.. The test result can also be affected
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 25Total 45 pages
by the adoption of encoding method for CS3 and CS4. 3static time slots are configured.
5.3.2 Average FTP upload rate KPI FTP upload rate
Suggested value 8kbps GPRS
Risk value 10kbps Suggested value 25kbps
KPI reference value
EDGE Risk value 35kbps
Indicator definition Actual upload data quantity (byte)/actual upload duration Indicatory type Test value Counter formula None Notes Normally, this KPI is the same as the CQT value. Class 4 mobile.
Size of the uploaded document will affect the test result. Usually, the smaller the document size is, the better the test result will be. It is related to the number of PS channelsterminal typeencoding method and test software, etc.. The test result can also be affected by the adoption of encoding method for CS3 and CS4. This KPI is the result of single time slot.
5.3.3 Throughput
Preconditions Mobile phone with multi-timeslot Level 8; single subscriber; 4 DL static signaling channels, 1 UL static signaling channel
Indicators (EN) Indicators (CN) Suggested value GPRS: Max data throughput-DL GPRS DL maximum transmission rate 9.8kbyte/s
GPRS: Max data throughput-UL GPRS UL maximum transmission rate 2.4kbyte/s
GPRS: Average data throughput-DL GPRS DL average transmission rate 5kbyte/s GPRS: Average data throughput-UL GPRS UL average transmission rate 1.3kbyte/s
EDGE: Max data throughput-DL EDGE DL maximum transmission rate 26.5kbyte/s EDGE: Max data throughput-UL EDGE UL maximum transmission rate 7kbyte/s
EDGE: Average data throughput-DL EDGE DL average transmission rate 14kbyte/s
EDGE: Average data throughput-UL EDGE UL average transmission rate 3.5kbyte/s
5.4 Reliability
5.4.1 PDTCH Drop Rate KPI PDTCH Drop Rate
Suggested value 5% KPI reference value Risk value 2% Indicatory type DT test value
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 26Total 45 pages
Indicator definition
PDTCH drop times/ FTP download attempt times *100%
Counter formula
None
Notes
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 27Total 45 pages
6 Introduction to CN Statistical KPI
6.1 Paging success rate KPI Paging success rate
Suggested value 90% KPI reference value Risk value 93% Indicator definition
Paging response times*100% / Paging request times
Counter formula
Paging request times refer to the sum of PAGING information sent out by all MSCs in the area, excluding the secondary paging information. Paging response times refer to the sum of the PAGING RES received by all MSCs in the area, including the second paging response. Statistical point is at MSC side.
Notes BSC can indirectly provide this KPI, but its statistical point differs from that of MSC. The difference lies in call loss at Interface A.
6.2 Location update success rate KPI Location update success rate KPI reference value
Provided by the SMC side
Indicator definition
Location update success times *100%/ location update request times
Counter formula
Provided by the SMC side
Notes This KPI can be indirectly provided by BSC, but the value is different and its statistical point differs from that of MSC too.
6.3 Attach success rate KPI Attach success rate
Suggested value 90% KPI reference value Risk value 95% Indicator definition
GPRS attach success times *100% / GPRS attach times
Indicatory type
GPRS attach success timesSGSN deliversATTACH ACCEPT3GPP TS 24.008excluding redeliver
Counter formula
Statistics at SGSN side
Notes excluding Unregistered subs
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 28Total 45 pages
6.4 GPRS average attach time KPI GPRS average attach time
Suggested value To be confirmed KPI reference value Risk value To be confirmed Indicator definition
Customer attach establishment duration *100% / customer number of attach establishment success
Indicatory type Statistics Counter formula
Attach establishment time refers to the time duration from the receipt of GPRS ATTACH REQUEST by MS to the delivery of ATTACH ACCEPT by SGSN. If the attach time exceeds the timer, the attach duration is only computed within the attach accepted period.
Notes
6.5 PDP context activation success rate KPI PDP context activation success rate
Suggested value 80% KPI reference value Risk value 85%
Indicator definition
success times of PDP context activation started by MS*100%/ attempt times of PDP context activation started by MS
The attempt times of PDP context activation started by MS is the times GGSN received Create PDP Context Request from SGSN. The success times of PDP context activation started by MS is the statistic of Create PDP Context Response sent from GGSN to SGSN when Cause value is Request Accepted.
Indicatory type Test or statistics Counter formula
Statistics at GGSN side
Notes The performance evaluation in China Mobile in 2003 (success times of PDP context activation started by GPRS terminal/ attempt times of PDP context activation started by GPRS) results are as follows:
Excellency index: 94% Reach-the-mark index: 90% Lowest Threshold index: 85%
6.6 Routing Area Update Success rate KPI Routing Area Update Success rate
Suggested value 92% KPI reference value Risk value 95% Indicator definition
Routing update attempt times*100%/ routing update success times
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 29Total 45 pages
Indicatory type From statistical value or DT. Counter formula
Statistics at SGSN side, provided by GPRS core network
Notes Update success rate at routing area crossing SGSN is lower than that at the SGSN routing area.
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 30Total 45 pages
7 Comments on KPI Cases
7.1 Pengshui (Chongqing) PS Test Result 1 CQT scenenear cell
2 EDGE Commissioned
3 Multi-timeslot capability3+1 5
4 Number of PDCH static channels: 3
Test state Test
serial FTP type
FTP sizeKbyte
Download speed (Kbyte/s)
Download speed (kbps)
Average timeslot speedkbps
Pre-optimization 1 Download 102.381 8.99 71.93 23.98 Pre-optimization 2 Download 48.18 8.10 64.80 21.60 Pre-optimization 3 Download 204.8 2.97 23.78 7.93 Pre-optimization 4 Download 2188.817 7.21 57.72 19.24 Pre-optimization 5 Download 102.381 9.05 72.42 24.14 Pre-optimization 6 Download 102.381 8.66 69.29 23.10 Pre-optimization 7 Download 512.304 15.97 127.73 42.58 Pre-optimization 8 Download 512.304 13.34 106.69 35.56 Pre-optimization 9 Download 512.304 15.81 126.51 42.17 Pre-optimization 10 Download 512.304 15.74 125.88 41.96 Pre-optimization 11 Download 512.304 14.33 114.67 38.22
Ping timelagms Ping interval
Ping package sizebyte
1 2 3 4 5 6 7 8 9 10
Average timelagms
Ping success rate
0 32 839 634 612 612
608 589 566 765 561 761 655 100%
5 32 816 590 581 779 757 733 716 692 812 609 709 100%
2 100 571 650 697 756 753 651 711 729 707 688 691 100%
2 500 839 955 1075 82
1 779 737 918 894 875 840 873 100%
5 500 862 760 857 75 672 811 690 811 709 825 775 100%
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 31Total 45 pages
5
2 800 959 910 869 869 845 823 781 883 860 846 865 100%
2 1000 1157 115
8 880 90
7 102
8 918 105
4 881 108
2 103
7 1010 100%
2 1200 1078 840 897 95
7 101
7 959 119
1 102
0 101
8 104
2 1002 100%
Comments on case:
1. When C/I is in good condition, the EDGE download speed of current equipment can reach above 40kbps.
2. The Ping success rate and Ping timelag can vary very much due to different 5 Ping intervals different Ping package sizes and different Ping servers.
7.2 Jishou (Hunan) China Mobile EDGE Test Result Test Specification
Test equipmentANT Pilot for E-GPRS
Test phone SEGAM OT490(one set) 10
Test laptop: memory 1024Mharddisk 80GCPU 1.60GhzWindows XP-SP2 standard 28800bps modem rate at 115200bps modem error control and compression forbiddenno software irrelevant to the test.
Test methodoutdoor static FTP download test Test location11 15 sites at Baoqing market in Fenghuang county Test time19th30th, June 2008
Test aimto test E-FPRS network performance under static state Test aimto download 1000KB document
Timeslot 4 static timeslots 20
Test Result
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 32Total 45 pages
Branch office
Test sites
Test
document size KB
Test
electrical leveldBm
Download times
Test location
RLC average rate
Kbps
RLC average rate
Kbps
Jishou
Fenghuang County prefectural government office building Cell 1
1000 -44 2 Gate of Prefectural government office 201.19 181.3
Jishou
Fenghuang County prefectural government office building Cell 2
1000 -40 2 Lobby of MingDu Hotel 192.6 198.98
Jishou
Fenghuang County prefectural government office building Cell 3
1000 -51 2 Opposite MingDu Hotel 197.09 206.26
Jishou Old district Cell 1 1000 -49 2 Basketball field of Jiandaoping Primary School
197.74 201.79
Jishou Old district Cell 2 1000 -32 2 Basketball field of Jiandaoping Primary School
207.29 193.91
Jishou Old district Cell 3 1000 -56 2 Kindergarten next to Jiandaoping Primary School
198.83 196.38
Jishou Rainbow Bridge Cell 1 1000 -43 2 Opposite Wanmingta River 185.72 191.1
Jishou Rainbow Bridge Cell 2 1000 -43 2 Opposite Wanmingta River 191.37 181.36
Jishou TianXia Feng Huang Cell 1 1000 -34 2 Square in front of TianXiaFengHuang Hotel
197.46 186.55
Jishou TianXia Feng Huang Cell 2 1000 -59 2 Square in front of TianXiaFengHuang Hotel
197.09 206.26
Jishou BaoQing market Cell 1 1000 -38 2 Gate of Linlinlou Drug Store 207.85 198.02Jishou BaoQing market Cell 2 1000 -36 2 Gate of Linlinlou Drug Store 162.16 185.34Jishou BaoQing market Cell 3 1000 -46 2 Gate of Linlinlou Drug Store 180.51 180.09Jishou Xinhua Bookstore Cell 1 1000 -50 2 Lobby of Xinhua Hotel 195.81 191.5
Jishou Xinhua Bookstore Cell 2 1000 -53 2 Lobby of Xinhua Hotel 198.02 188.38
Jishou Xinhua Bookstore Cell 3 1000 -45 2 Parking lot of Xinhua Hotel 183.08 190.16
Jishou Comprehensive Building Cell 1
1000 -37 2 Lane, west to ChinaMobile business hall 178.96 157.44
Jishou Comprehensive Building Cell 2
1000 -45 2 Gate of XingGuang Hotel 185.46 187.98
Jishou Comprehensive Building Cell 2
1000 -60 2 Gate of XingGuang Hotel 184.07 184.45
Jishou Comprehensive Building Cell 1800M1
1000 -50 2 Gate of XingGuang Hotel 193.98 184.51
Jishou Comprehensive Building 1000 -62 2 Gate of XingGuang Hotel 176.22 185.21
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 33Total 45 pages
Cell 1800M2
Jishou Telecom Bureau Cell 1 1000 -51 2 Business Hall of Telecom Bureau 180.75 197.88
Jishou Telecom Bureau Cell 2 1000 -64 2 Business Hall of Telecom Bureau 171.85 199.19
Jishou Telecom Bureau Cell 3 1000 -57 2 Backdoor of Supermarket (next to Telecom Bureau) 182.7 179.49Jishou Telecom Bureau Cell 1800M1 1000 -59 2 Gate of furniture store (next to Telecom Bureau) 105.44 106.48Jishou Telecom Bureau Cell 1800M2 1000 -73 2 Business Hall of Telecom Bureau 181.85 185.85
Jishou Telecom Bureau Cell 1800M3 1000 -84 2 Business Hall of Telecom Bureau 159.20 166.92
Comments on case:
1. When C/I is in good condition, the average EDGE download speed can reach above 180kbps with a peak value of above 200kbps;
2. This test is the CQT. Cell reselection and RAC renewal can be neglected, that is they are not necessary to the test conditions. 5
7.3 Acceptance requirements for EDGE KPI of Data Service of a network
Serial Indicators Explanation Formula Target
1 GPRS/EGPRS attach success rate
GPRS/EGPRS Attach success means that the mobile phone receives the Attach Accept signaling 15 seconds after it sends the Attach Request.
GPRS/EGPRS attach success rate GPRS Attach success times/attach attempt times100
>95%
2 Average attach time
Attach time means the duration from the mobile sends out Attach Request until it receives GPRS attach accept signaling.
Average attach timesum of attach success duration /attach success times
95%
4 PDP average activation time
PDP average activation time means the duration from the delivery of Activate PDP Context Request to the receipt of Activate PDP Context Accept by the mobile phone.
PDP average activation time sum of PDP activation success duration/PDP activation success times
95%
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 34Total 45 pages
log-in success rate
means that the homepage fully and correctly displays within 60seconds after the mobile phone started the WAP website log-in request.
rate WAP website log-in success times/ website log-in attempt times100
6 average WAP homepage displaying time
WAP homepage displaying time refers to the duration from the WAP website log-in request is sent out until the homepage fully and correctly displays.
average WAP homepage displaying time sum of successful homepage displaying duration / WAP homepage displaying success times
95%
8 Ping success rate
Ping success rate ping success times/ping attempt times100
>95%
9 Ping average timelag
Ping average timelagsum of each Ping success duration/ping success times
80kbps
11 FTP upload speed
FTP upload speed actual upload data quantityByte/actual upload time(sec) 9
>20kbps
Comments on case:
1. Requirements of operation and maintenance KPI are not as strict as those of acceptance check KPI.
2. Usually these KPI requirements can be satisfied.
7.4 Operation & Maintenance KPI of a Network 5 SN Indicator Unit Target Level Permissible
Level Remark
1 SDCCH Drop Ratio
% 1 1.2 Base on system performance report of OMCR, Indication Definition: SDCCH Drop Ratio=SDCCH call drops/ Access
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 35Total 45 pages
attempt Number
2 TCH Drop Ratio % 2 2.2 Base on system performance report of OMCR, Indication Definition: TCH Drop Ratio = TCH call drops/ Seized TCHs (include handover )
3 Call Success Ratio
% 98 97 Base on system performance report of OMCR, Indication Definition: Call Success Rate = 1 TCH assignment failure rate
4 SDCCH Blocking Ratio
% 0.5 0.75 Base on system performance report of OMCR, Indication Definition: SDCCH Blocking Ratio=SDCCH overflows/ SDCCH call attempts
5 TCH Blocking Ratio
% 2 2.5 Base on system performance report of OMCR, Indication Definition: TCH Blocking Ratio=TCH overflows (include handover)/ TCH call attempts (include handover)
6 TCH Assignment Success Ratio
% 98 97 Base on system performance report of OMCR, Indication Definition: TCH assignment Success Ratio=Number of TCH assignment successful / Number of TCH call attempts (include handover)
7 GPRS average DL throughout per TBF
Kbps 28 25 24-Hour measurement
8 EDGE average DL throughout per TBF
Kbps 45 40 24-Hour measurement
9 Attach Success Rate (GPRS/ EDGE)
% 99 97 24-Hour measurement
10 Handover Success Ratio
% 94 93
11 Call Blocking Ratio
% < 2 for 98% of all GSM cells
< 2 for 90% of all GSM cells
Based on OMC-R statistics
12 Call Setup Success Rate (Drive Test)
% 97 90 Depend on the DT route and method
13 Call Drop Rate (Drive Test)
% 2 3 Depend on the DT route and method
14 Speech MOS >= 3 for >= 3 for Depend on the DT route and method
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 36Total 45 pages
Quality (Drive Test)
95% of measurement
samples
90% of measurement
samples
15 Coverage (Drive Test)
dBm >= -85 for 95% of measurement
samples
>= -85 for 90% of measurement
samples
Depend on the DT route and method
16 UL Throughput
Kbps >10 >10 Based on DT
17 DL Throughput
Kbps >30 >30 Based on DT
18 BSC/RNC down time (unscheduled)
% >99.999 (< 6 sec)
>99.999 (< 6 sec)
per BSC/RNC / week
19 TRX/channel element failure (unscheduled)
% < 1 of all active TRX
< 2 of all active TRX
per BSC/RNC / week
20 SDCCH Mean Holding Time
s < 2 < 3 per BSC/RNC / BH of a week
21 Radio Access Success Ratio
% >99.5 >99 per BSC/RNC / BH of a week
22 Worst Cells GOS
Less than 1.5% cells of Network with GOS 5% or above
Less than 1.5% cells of Network with GOS 5% or above
per BSC/RNC / BH of a week
23 RXQUAL 0 to 3 % >97 >95 per BSC/RNC / BH of a week 24 AMR voice
FER
% < 1
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 37Total 45 pages
interval
1
% of outdoor
area with 2G signal level > -104 dBm
pre-defined Drive test
route >90% >97% >99% per city /
monthly
2
Call Setup Success
Rate (exclude blocking)
pre-defined locations and
Drive test route/NMS
95% >98% >99% per city / BH of a week (drive test monthly)
3 Paging Success
Rate NMS >90% >95% >97%
per city / BH of week. With condition that Core Network is achived the same value of Level 1 and Level 2
4 Call
blocking rate
pre-defined locations and
Drive test route/NMS
25(95%)
Average value per city / BH of a week
10
Call setup delay
(PSTN to MS, time
from number dialed to
ring)
Pre Defined Drive Test
Route
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 38Total 45 pages
12 Call Setup Successful
Rate NMS >95% >98% >99% per BSC/RNC / BH of a week
13 SDCCH Access Success
NMS >99% >99% >99.5% per BSC/RNC / BH of a week
15 SDCCH Blocking
Rate
Pre Defined Drive Test
Route/NMS 90%
per BSC/RNC / BH of a week
(drive test monthly)
21 AMR voice FER Pre Defined Drive Test
Route/NMS 98% >98% per city / BH of a week
24 Successful
PDP context
activation NMS >98% >98% >98% per city / BH of
a week
25
Data session Setup
Success Rate (PDP
context already exist)
Pre Defined Drive Test
Route/NMS >95% >98% >98% per city / BH of
a week
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 39Total 45 pages
26 Moving MS
FTP download 1MB file
Pre Defined Drive test
route GPRS>30kbps
GPRS (Class 4
MS): >30Kb
GPRS (Class 4 MS):> 30Kbps
per city / BH of a month
27 Moving MS
FTP upload
1MB file
Pre Defined Drive test
route GPRS>8kbps
GPRS (Class 4 MS): > 9Kbps;
GPRS (Class 4 MS): > 9Kbps;
per city / BH of a month
28
Stationary MS near site, FTP download 1MB file
Pre-defined locations
GPRS (Class 4 MS): > 40 Kbps
GPRS (Class 4
MS): > 40 Kbps
GPRS (Class 4 MS): > 40 Kbps
per city / BH of a month
29
Stationary GPRS MS
in cell border,
FTP download 1MB file
Pre-defined locations
GPRS (Class 4 MS): > 20 Kbps
GPRS (Class 4
MS): > 20 Kbps;
GPRS (Class 4 MS): > 20 Kbps;
per city / BH of a month
30
Stationary UMTS MS
in cell border (SHO),
FTP download 1MB file
Pre-defined locations N/A
> 150 Kbps > 150 Kbps
per city / BH of a month
31 PDTCH blocking
rate NMS
SecretSecretSecretSecret
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 40Total 45 pages
success rate
Comments on case:
1. This OM KPI just got some of the indicators, excluding the weighing of all KPIs and 2/3G interoperate KPI, etc.. Due to market factors, the OM KPI of this network is set unreasonable, and there is risk in some of the KPIs.
2. The evaluation of this KPI falls into three grades. The requirements for 5 handover success rate and paging success rate are very high, which are difficult to reach. But the attached prerequisites can lower the risk to some extent. Besides, the definition of handover success rate varies with different manufacturers, which we need to make clear with customers in technical clarification. 10
3. The requirements for data service and voice KPI are higher.
7.6 KPI requirements for Indonesia Telkomsel network
KPI requirements for Indinesia Telkomsel.xls
Comments on case
1. The evaluation scale of KPI is relatively large, mainly dealing with statistical 15 KPI and testing KPI;
2. It ranges from 2G to 3G network. Its service includes voiceGPRS and 3G data service, etc..
3. The division of KPI evaluation scenes and most KPI values are relatively reasonable. 20