ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Audit Number: IT 2014-311 Audit Title: Performance & Quality Management
Scheduled: 17 Dec2014 Client: Network PerformanceBudgeted Man Days
50Lead Auditor:
Faisal Khan
Proposed Man Days:
50Assistant Auditor:
Samer Itani/Hamid Masood
Background
Performance Management is performed to ensure network availability, acceptable network quality, and great experience for subscribers, while avoiding additional CAPEX. Performance management involves monitoring the network service activity in order to adjust or improve network performance and traffic management. Network Performance is a continuous process that is required as the network evolves due to subscriber growth, network enhancement or coverage.
Network performance is the target evaluation of the network based on design goals versus the performance achieved, while Network optimization is performed to improve the performance of the network with existing resources. The dynamic nature of mobile network caused by network expansion, subscriber growth and new service launch creates multiple challenges for operators to know exactly where the performance of the network stands compared to the design objectives. However, the optimization goal is to better utilize existing network resources and solve potential problems to identify possible solutions for future planning. Through Network Optimization, the service quality and resources usage of the network are greatly improved to achieve a balance between coverage, capacity and quality.
Performance management evaluates and report upon the behavior of network equipment and the effectiveness of the network. Therefore, a continuous and real-time review of network performance assists inidentifying and eliminating problems before impacting services and customers.
Performance Management Process
At Mobily, Network performance team monitors the performance through Performance Statistical Alarm (PSA) using various tools to report any kind of abnormalities.
Once abnormalities are detected as a KPI trend, the Performance team informs the operation team in the form of a trouble ticket that includes the severity, problem description, affected nodes, and trouble start date and time.Operations analyses the trouble ticket and raise it to the related vendor to take the appropriate actions as needed based on the severity of the ticket as per the Service Level Agreements (SLA).
In order to deliver High-Qualityservices, Mobily have partnered with vendors (Huawei Alcatel, Nokia, Ericsson, and Samsung).Each vendor monitors their Key Quality Indicators (KQIs) and Key Performance Indicators (KPIs)and the associated thresholds through statistics on network availability and service degradations.
1
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Huawei Network Performance Process Flow
Figure 1AHuawei Network Performance Process
Ericsson Network Performance Process Flow
Figure 1BEricsson Network Performance Process
AlcatelNetwork Performance Process Flow
Figure 1CAlcatelNetwork Performance Process
2
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
NokiaNetwork Performance Process Flow
Figure 1DNokia Network Performance Process
SamsungNetwork Performance Process Flow
Figure 1ESamsungNetwork Performance Process
3
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Performance Management Organizational Structure
At Mobily, the Network Performance Management is a department under the Network Strategic Planning and Support,headed by Mr. Salim S. Aldweik - Director Networks Performance Management. The Performance team assists Network Operations and Planninginidentifyingand reporting on Network congestionsaimed to further improving
Network Performance and Quality of Services.
Figure 2A Organization Structure of Network Performance Team
In coordination withvarious groups,performance management department grinds on the improvement of network performance based on measured and evaluated utilization,optimization andavailability of network resources. The Department analyzes the network performance across regions providing technical recommendation to manage the network in-line with the global strategy in order to ensure high capability. Major performance processes focus on the preparation of appropriate documentation for assigned projects, while liaising with internal and external customers and third parties, to identify system faults and rectify or escalate them appropriately, to ensure rapid restoration of the network service. This may ensure the ongoing network development and guide reporting activities to oversee the overall performance availability and quality according to communicated KPI’s.
The network performance team is divided into four groups:
International Circuit Switching Core EngineeringMajor activities performed by the international CS Core team are to identify system faults and rectify or escalate them appropriately.
National CS Core EngineeringTeam activities focus on monitoring ofcore Call treatment, Trunk utilization, Signaling, Roaming and MPBN core utilization etc.
PS & Data NetworksThe team focuses on monitoring of packet switching, data network including availability, Nodes utilization and links statistics monitored by performance team.
Chief Technology Operations Officer Mr. Haitham Faraj
(Acting CTO)
Director Networks Performance ManagementMr. Salim S. Aldweik
International Circuit
Switching Core Engineering
Manager Mr.
Judwin Digo
National Network
Performance Engineering
ManagerMr. Frederick G.
Roxas
Executive Manager VAS,
PS & Data NPM Mr. Samer M.
Mahayni
Exec. Manager Access Network
Performance ManagementMr. Bilal El-
Skafi
4
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Radio Access NetworksThe team focuses onmonitoring of accessibility, capacity, retain ability and data throughput.
Transmission Operations
While Transmission monitoring is not managed under Performance Department,its realized activities areunder the Operation and Maintenance umbrella, led by Mr. Waleed Yousef Laywad. His team is responsible for performance, Quality Assurance (QA) and integration.
5
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Performance Management Technology & Vendor Distribution
Radio Access Network (RAN)
Region NSN Huawei Alcatel Ericsson SamsungEast - 2G, 3G & 4G 2G, 3G & 4G - -West/South - 2G, 3G & 4G - 2G, 3G & 4G 4GNorth 2G, 3G & 4G 2G, 3G & 4G - - -Central 2G, 3G & 4G 2G & 3G - - 4G
Figure 3AVendor Distribution of BSC/RNC & MME nodes for 2G, 3G & 4G
Figure 3BRegional segregation of BSC/RNC & MME nodes for 2G, 3G & 4G
Northern
NSN 2G, 3G & 4G
Huawei 2G, 3G & 4G
Eastern
ALU 2G, 3G & 4G
Huawei 2G, 3G & 4G
Central
NSN 2G, 3G & 4G
Samsung4G
Huawei2G and 3G
Western
Huawei 2G, 3G and 4G
Ericsson 2G, 3G and 4G
Samsung 4G
CENTRAL EAST NORTH WEST/SOUTH
BSC-2G 25 35 18 37
RNC-3G 94 64 68 22
MME-4G 5 3 5 3
1030507090
BSC/RNC/MME Per Region
BSC-2G RNC-3G MME-4G
6
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
CS Core Network
Nodes Ericsson HuaweiOberthur
TechnologiesRoamware
MSS 28 7 - -MGW 26 9 - -STP 10 2 - -MSC - 2 - -HLR 8 - - -HSS 2 2 - -
GMSC 7 - - -TMGW 5 - - -TMSC 5 1 - -ITSC 8 2 - -DSA - - 4 -RMS - - - 2Total 99 25 4 2
Figure 3CVendor Distribution of CS Core Network Nodes
Figure 3DRegional segregation of CS Core nodes
Ericsson
MSS 28
MGW 26
STP 10
HLR 8
HSS 2
GMSC 7
TMSC 5
ITSC 8
Huawei
MSS 7
MGW 9
STP 2
MSC 2
HSS 2
TMSC 1
ITSC 2
Oberthur Technology
DSA 4
RMS 2
Roamware
MSS
MGWST
PMSC
HLRHSS
GMSC
TMGW
TMSC
ITSC
DRADSA
RMS
2826
108
27
5 5 8
7 9
2 22
1 2 42
Mobily CS Core Device Count
Ericsson Huawei Oberthur Technologies Roamware
7
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
PS Core NetworkNodes Ericsson Huawei Citrix Byte MobileUSN 3 10 -UGW 4 10 -eDNS - 2 -iDNS 3 4 -
WAPGW - 2 3Total 10 28 3
Figure 3EVendor Distribution of PS Core Network Nodes
Figure 3FVendor Distribution of PS Core Network Nodes
Ericsson
USN 3
UGW 4
iDNS 3
Huawei
USN 10
UGW 10
eDNS 2
iDNS 4
WAPGW 2
Citrix Byte Mobile
WAPGW 3
USN UGW eDNS iDNS WAPGW Optimization (Citrix by mobile)
0123456789
10
34
3
10 10
2
4
23
Mobily PS Core Device Count
Ericsson Huawei Citrix Byte Mobile
8
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Key Performance Indictors and Key Quality Indicators
Key Performance Indicators are used to measure the performance and effectiveness of network elements. KPIs are calculated based on counters maintained by network elements. Key Quality Indicators are used to measure the perceived quality of networks towards end-users. KQIs are calculated using several KPIs. The following are examples of major KPIs and KQI:
Service
Service KQI Service KPIAvailability MTBF, MTBRConnect time Loss of ServiceSuccessful call attempts Voice QualityFailed call attempts Voice DelaySignaling Voice clarityPDP utilization Data browsingPDP success rate Paging
Performance Management Thresholds & Key Performance Indictors
Key Performance Indicator (KPI) is a quantifiable metric of performance essential for operations and their thresholds are based on Key Quality Indicators (KQIs), these threshold values are mutually agreed between Mobily performance management team and vendors.Vendors are penalized if the degradation level or outage time exceeds the maximum threshold for the Hurdle/ Acceptable value. The penalties are charged when the SLAs are breached.
Below are the major Performance& Quality KPIs along with their thresholds and targets as set in the MNS contracts. These KPIs are applicable for the period starting from April 2014 to March 2015. Further, as per the MNS contracts, each vendor is supposed to provide a continuous improvement plan to improve these KPIs yearly.
Major KPIs &Thresholds
Success & Availability
KPI Service TargetHurdle
(Acceptable Value)Weight
1 Server & Link Availability KQI >99.99% >99.9% 1.0%
2Service Request Successful
KQI >99% >98% 1.0%
The service availability shows target key performance indicators for links.
Network Switching Subsystems Voice Service
KPI Service TargetHurdle
(Acceptable Value)
Weight
1 Successful Signaling Attempt KQI >= 99.9% >= 99.8% 2.0%3 Call Completion Rate KPI >=98.0% >=97.0% 2.0%
3Location Update successful rate
KPI>=98.0% >=97.0% 2.0%
4 Handover Success Rate KPI >=96.0% >=95.0% 1.0%
5Authentication Successful rate
KQI>=98.5% >=97.5% 1.0%
6 Paging Success Rate KPI >=93.0% >=91.0% 1.0%
9
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
The Network Switching Subsystem (NSS) is the main part of the Mobile Switching Center (MSC) that performs the switching of calls between mobile and fixed network users.
Circuit Switching Fallback Service
KPI Service TargetHurdle
(Acceptable Value)
Weight
1LTE to CSFB over SG Success Rate
KQI>=97.0% >=96.0% 1.0%
2 Location Update Success Rate KPI >=98.0% >=97.0% 1.0%3 End to End Paging Success Rate KPI >=92.0% >=91.0% 1.0%
Circuit Switching Fallback is a functionfor combining Long Term Evolution (LTE/4G) and Circuit Switching (CS)services likeVoice over LTE and 3G – Generation voice calls.
Access & Roaming Network Level
KPI Service TargetHurdle
(Acceptable Value)
Weight
1Network Efficiency Ratio (NER) outgoing international
KQI>=92.0
%>=90.0% 1.0%
2Network Efficiency Ratio (NER) incoming international
KQI>=96.0
%>=95.0% 1.0%
3Monthly Average LU% SR for Top 10 Outbound Roamers to Preferred Partner/Operator
KQI>=96.0
%>=95.0% 1.0%
4Monthly Average % NER for Top 10 Outbound Roamers Preferred Operators
KQI>=92.0
%>=90.0% 1.0%
5Monthly Average % ASR for Top 10 Outbound Roamers Preferred Operators
KQI>=98.0
%>=96.0% 1.0%
Access and roaming shows the key performance indicators of international roaming which is the ability to automatically make and receive voice calls, send and receive data, or access other services when travelling outside the geographical coverage area.
Radio Access Network Level
KPIServic
eTarget
Hurdle(Acceptable value)
Weight
1 Call Setup Success Rate (%) KQI >=99 >=98.5 2%2 Call Setup Successful Rate(UMTS) KQI >=99% >=98.5% 2%3 PS R99 Connection Setup Success KQI >=98.5 >=97.5 1%4 UMTS Call Drop Rate CS - Speech KPI <=0.45% >=0.5% 2%5 Call Drop Rate (%) KPI <=0.45% >=0.5% 2%6 Handover Success Rate (%) KPI >= 98% >=97.5% 1%7 Overall PS Drop Rate KPI <=2% <=3% Reporting8 PS HSDPA RAB Drop Rate (%) KPI >=0.8% <=1% 1%9 RRC Establishment Success Rate
CSKPI
>=99% >=98.5% 2.5%
10 PS RRC Establishment Success Rate
KQI>=99% >=98.5% 2.5%
11 RAB Establishment Success Rate CS
KQI>=99% >=98.5% 1.5%
12 PS R99 RAB Establishment Success KQI >=97.5% >=96.5% 2.0%13 PS HSUPA RAB Establishment KQI 99.00% 98.50% 1.5%14 HS Accessibility -Overall KPI >=98.5% >=98% Reporting
10
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Part of a telecommunications network which connects subscribers to their immediate service provider.
11
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
CellLevel
KPIServic
eTarget
Percentage of cells meeting the
thresholdWeight
City NodesRural Node
s1 Call Setup Successful Rate(2G) KQI >98% 90% 70% 1%2 Call Setup Successful Rate(UMTS) KQI >98% 85% 75% 1%3 Drop Call Rate (UMTS) KPI <0.6% 55% 40% 1%4 Drop Call Rate (2G) KPI <0.6% 55% 35% 1%5 HS Accessibility KQI >98% 87% 75% 1%6 HS Throughput KQI >2Mbs 75% 60% 1%7 Call Setup Successful Rate(PS) KQI >98% 85% 70% 1%8 LTE Accessibility KQI >99% 94% 91% 1%9 LTE Throughput KQI >3Mbs 50% 45% 1%10 RAB Blocking Rate PS KQI <0.2% 95% 90% 1%
Network consists of different cells and each cell transmits signals to and receives signals from mobile stations.
GPRS Level
Service Level Service TargetHurdle
(Acceptable Value)Weight
1 Successful PS Attachment 2G KQI >=98.0% >=95.0% 1.0%2 Successful PS Attachment 3G KQI >=99.0% >=98.0% 1.0%3 Successful PDP context activation 2G KQI >=99.0% >=98.0% 1.0%4 Successful PDP context activation 3G KQI >=99.9% >=99.0% 1.0%5 Inter RAU 3G KPI >=99.0% >=98.0% 1.0%6 PDP cut off ratio KQI <=0.0001 <=0.00015 1.0%7 Successful PS Attachment 4G KQI >=99.0% >=98.0% 1.0%
8Successful SAE Bearer context Activation 4G
KQI>=99% >=98.0% 1.0%
9 PDP context SR (Top 20 operator) KQI >=90% >=88.0% 1.0%General Packet Radio Service (GPRS) is a packet oriented mobile data service on the 2G and 3G cellular communication system's global system for mobile communications (GSM).
Tools
Network Performance Management team uses various tools to extract the reports and measure KPIs for RAN, Core & IP networks. Below are the tools that are used by various vendors for measuring the network performance.
Vendor Tool Tools DescriptionEricsson ENIQ Business Object client
Used to monitor Radio access, PS Core and CS core platforms for monitoring.
Ericsson ENIQ PortalEricsson Ericsson DashboardsHuawei Huawei M2000Huawei Huawei U2000 Used to monitor Transmission Platforms.Huawei Huawei PRS
Used to monitor Radio and PS Core platforms.Huawei Huawei MOS5200NSN Nokia NetAct Used to monitor Access and CS Core platforms.NSN Nokia Dashboards
Used to monitor Access platforms.ALU 2G NPO; 3G NPO and LTE NPOALU ALU DashboardsSamsung LSM- Radio (Jeddah)Samsung Samsung DashboardsAnritsu MasterClaw Business Objects
Used to monitor PS Core platforms.Anritsu MasterClaw DashboardsCacti Cacti traffic graphs
12
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
InfoVista InfoVista portal Used to monitor Access and PS Core platforms.Xius Lebara Dashboards Used to monitor CS Core platforms.
Performance Management Monitoring& Reporting
Performance Management involves continuous monitoring of data concerning the network elements; it is designed to measure the overall quality of performance, using monitored parameters to detect degradations.The extracted data is used to analyze faults, growth, and capacity of the network. Reports are useful only if accurate data is presented in a useful manner to the performance team.
At Mobily, various Daily, Weekly and Monthly reports are generated to monitor network performance through KPIs and KQIs for following:
Creating recommendations for performance improvement
Evaluating threshold rates
Forecasting network usage
Capacity analysis of the network
Major Network Performance Reports
CIRCUITSWITCHING PERFORMANCE REPORTS
Daily Weekly MonthlyDaily Core CS Performance Report
Subscriber per BSC and RNC wise
Monthly Core Network Utilization
Daily A Interface Utilization Report
2G Paging Success Rate (LAC wise)
Mobily MNS Monthly Report
Daily IGWs KPI Report3G Paging Success Rate for Huawei 3G LACs
Huawei MSC Level Subscribers& Traffic
Daily HSS Performance ReportWeekly Traffic/Subscriber Report.
2G/3G Subscribers Data
PACKET SWITCHING CORE PERFORMANCE REPORTS
Daily Monthly
Daily GPRS Performance Report Monthly MNS KPIs report
Gb Utilization Report Monthly MNS SLA report
2G REPORTS
Daily Weekly Monthly2G CS Daily Radio Network Performance Report of Huawei on Node Level.
BSC Utilization and CP Load Monthly MNS KPIs report
2G CS Daily Radio Network Performance Report of Huawei on Regional Level.
BSCs Performance KPIs for Huawei 2G
Monthly Meeting Report
2G PS Daily Radio Network Performance Report of Huawei on Node Level.
Weekly QOS KPIs Report on Regional level - Week #
Monthly TT Report
2G PS Daily Radio Network Performance Report of Huawei on Regional Level.
Weekly Hanging TRXs __
13
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Top 10 of 2G worst and zero traffic cells Report of Huawei 2G.
__ __
3G REPORTS
Daily Weekly Monthly
3G Daily Analysis Report Weekly 3G report Monthly Report & Monthly TT Tracking
Top 10 Worst Cells and sleeping cells
Weekly QoS Report Utilization & congestion report-central & south
3G Key cities main highlightsWeekly Site Utilization, Capacity and Congestion Report-East region
Network topology performance KPIs report
4G – LONG TERM EVALUTION - LTE REPORTSDaily Weekly Monthly
LTE Daily Analysis ReportWeekly core utilization and congestion Report
Monthly Utilization Report
__ Weekly Task Utilization & congestion
MULTI-PROTOCOL LABLE SWITCHING PERFORMANCE - MPLS REPORTSDaily Weekly Monthly
MPLS Core Daily ReportNE 40- E MPLS Core traffic utilization Weekly Report
MPLS Core Monthly Report
__ RNCs & BSCs link Utilization __
14
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Budget
During initial interactions it was noted that Mobily Performance team is operating on outsourced model through Managed Network Services (MNS) contracts and they don’t manage any budget on their own. However, they use performance services, human resources and tools from vendors having MNS contracts.
Managed Network Service contracts are depicted in the following table:
Vendor Contract IDBegin Date
Expiry Date
LOI Value Per Year *
Alcatel-Lucent318/2013/Alcatel-Lucent
Apr’2014
Mar’2015 SAR 37,794,000 SAR 37,794,000
Ericsson 318/2013/EricssonApr’201
4Mar’2017
SAR 653,084,724
SAR 217,694,908
Huawei 318/2013/HuaweiApr’201
4Mar’2019
SAR 817,153,585
SAR 163,430,717
Nokia Siemens Networks
318/2013/Nokia Siemens Networks
Apr’2014
Mar’2019SAR 408,720,000
SAR 81,744,000
ZTE 318/2013/ZTEApr’201
4Mar’2019
SAR 532,577,862
SAR 106,515,572.4
SAMSUNG 4G(LTE-TDD, Western region)
243/2010/SAMSUNGJan’201
4Dec’2015
SAR 124,994,880
SAR 62,497,440
*Data related to cost of performance has been requested and will be analyzed during fieldwork
15
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Audit Objectives
The objective of this audit is to review and evaluate the adequacy and effectiveness of process, procedure, and technical controls covering key areas related to Network Performance.The audit will address the following audit objectives:
1. Adequate Governance Practices Pertaining to the Network Performance Function
To ensure that performance department is running in an efficient manner, governance framework is designed, well-structured, functional and regularly monitored.
To assess the adequacy of policies, procedures and its consistent implementation.
To review defined roles & responsibilities of selected staff and their duties are adequately segregated.
To assess and review the availability of skilled and experienced resources for network performance.
To assess the adequacy of documented authority matrix and its implementation showing management involvement in critical issues.
2. Network Performance Strategy
To assess that network performance strategy is driven by well-defined business objectives.
To review the process of considering internal and external factors in the network performance strategy for long term achievement and alignment with Mobily’s vision.
To determine that network performance strategy is approved, communicated, periodically reviewed and implemented.
3. Budget Management
To assess that adequate controls are in place for preparation, dimensioning, allocation & management of budget for applicable MNS contracts pertaining to network performance.
To review the alignment of network performance with business objectives and how performance plays a role in reduction of CAPEX.
4. Vendor Management
To assess and review Management Network System contracts against the approved KPIs, SLA’s & Penalties.
To assess that process is in place to keep KPI formulae definition uniform across all vendors.
To assess that adequate controls are in place for vendor resiliency and fair selection.
16
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
5. Adherence to Performance Principles
To review that performance management mechanisms are considered for network expansion and swap activities to ensure network quality and availability.
To assess that performance management evaluation for the network is conducted on regular basis and observations are considered for improvement.
To assess that approved and acceptable target levels of Key Performance Indicators and Key Quality Indicators are in place, monitored and escalated in timely manner.
6. Effectiveness of Network Performance and Quality Management
To validate that the performance team have effective processes in place to provide the required reports to relevant teams for actions in timely manner for better network availability.
To assess the validation of formulae and effectiveness of reports that are monitored and reviewed by performance team to provide network view for accurate future planning.
To follow up with concerned teams on reported degradations and previous audit results to ensure that proper steps have been taken to remedy the issues and confirm it through updated performance reports.
7. RAN, Transmission & Core Performance
To assess that end to end Key Performance Indicators (KPI) and Key Quality Indicators (KQI) are aligned throughout the call set up and the packet data flow.
To ensure all performance reports for Transmission network are addressing the required KPIs and the Quality of Service (QoS) of the transmission network.
To validate that the Radio Access Network, Transmission, and PS/CS CORE are working according to the desired throughput and that identified degradation are well communicated to the relevant teams in efficient manners.
To assess and ensure that all installed network elements are available and monitored through
Network Management System tools for proper monitoring and KPI evaluation.
To ascertain that performance of transmission links are adequate and compared to the reasonable
level such as power level are in line with Mobily business requirements and industry best practices.
To assess critical rings of Metro, Long-Haul and Back-Haul links bandwidth utilization and
redundancy are in line with Mobily Business requirements and industry best practices.
17
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
Audit ScopeThe review will focus on Network Performance of RAN, Core & Transmission and samples will be selected for the years 2013 & 2014. The main areas that will be reviewed during Network Performance audit are:
Technical Controls: Compliance to vendor’s KPI claims to be assessed technically and to assess Key Quality Definitions that are being used across all regions/vendors as set in the above objective.
Management Controls: Policy and procedures related to performance tasks shall be analyzed with emphasis on Governance, Strategy, in addition to Budget and Vendor compliance as set in the above objectives.
Audit Out of Scope
The review will focus only on Mobile Core (CS and PS) and RAN service performance. Charging System (IN) & VAS will not be part of this review.
Audit Areas
Governance
Strategy
Budget Management
Vendor Management
Adherence to Performance Principles
Effectiveness of Performance & Quality Management
RAN, Transmission& Core Performance
18
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
RISK ANALYSIS OF AUDIT AREAS
NO. AUDIT AREAS NO. OF HOURS
RISK Rating(H/M/L
)
JUSTIFICATION
1. Audit planning 90 First time audit requires meeting with various teams across Mobily.
2. Governance 30 M
Policies and procedures pertaining to network performance features are documented communicated and are adhered.
3. Strategy 30 M
Review if strategy is properly communicated to performance team and complied in routine performance circle.
4. Budget Management 30 H
Review the accuracy of budgeting, allocation, revenue losses and financial discipline on vendor dealings.
5. Vendor Management 40 HReview overall vendor contracts and assess the KQIs, SLAs, Outages and penalties.
6.Adherence to Performance Principles
50 MReview and analyze effective performance utilization as per requirements and growth.
7.Effectiveness of Performance and Quality Management
50 M
Review effectiveness of current performance& quality to analyze if these processes can be further improved.
8. RAN, Transmission& Core Performance
50 H Review effectiveness of RAN, Transmission& Core Performance
9. Audit Reporting 30
Total Work Hours 400
Total Days 50
*Hours mentioned above are SME Hours only, these hours does not include project management and team member hours.
19
ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)
PLANNING MEMORANDUM
EXPECTED KEY MILESTONES
Completion of Planning: 17/12/2014Completion of Fieldwork: 02/04/2015Reporting: 15/04/2015
REPORTING
The audit opening meeting will be held on__________________with___________________. The report will be addressed to Chief Audit Executive. Prior to the issuance of the final report, significant finding will be communicated to the client and their comments will be incorporated into the audit report.
Faisal Khan Abdul Rehman ShaikhLead Auditors AGM, IT & Telecoms Audit
Pankaj Jain AbdulKareem D.Al YousifProject Manager EGM, Audit Assurance
20