“Companion” network

services monitoring App

implementation results

#Metricell

Anton Kopysov

Head of Product Quality Division

2 17.02.2015

SmartphonesGeneral trends

45%

34%

12%4% 2% 3%

22%

58%

8% 5% 3% 3%

12%

71%

4% 6% 4% 2%0%

20%

40%

60%

80%

Symbian Android Bada iOS Windows Phone Другое (Asha, Blakberry, Linux, Windows Mobile, Live Area, Palm)

2012 2013 2014

16%

24%30%

0%

10%

20%

30%

40%

2012 2013 2014

Smartphone share in Tele2 network, %

12.03.20153

Phase 1 MQMS Project resultsGeneral conclusions: progress, subscribers, geography and network

26.09.2014 – available on Google Play

29.10.2014 – available on App Store (iTunes)

12.03.20154

Info Campaign for Subscribers:

100 000+ customers received SMS on their Android and iOS handsets

More that 2% responded and installed “Companion” application

Data collected from “Companion” covered wide geographical area:

More than 91% of Tele2 base stations in Chelyabinsk region

13 biggest cities of Chelyabinsk region with 2,3M+ population summary or

67,5% of total population

Phase 1 MQMS Project resultsProgress, geography and network

City000

pers.

% of

population

Chelyabinsk 1 143 32,9%

Magnitogorsk 409 11,8%

Zlatoust 173 5,0%

Miass 150 4,3%

Kopeysk 138 4,0%

City000

pers.

% of

population

Ozersk 82 2,4%

Snezhinsk 48 1,4%

Satka 44 1,3%

Chebarkul 42 1,2%

Korkino 38 1,1%

City000

pers.

% of

population

Kashtym 38 1,1%

Yuzhnouralsk 37 1,1%

Total: 2 348 67,5%

12.03.20155

App inbuilt Questionnaire:

More than 10% responded

Average rating of application– 4,3

User’s comments from questionnaire:

Need to add Exit button

Dual SIM devices support required

Add functions to check account balance,

account management, on-line support chat

Phase 1 MQMS Project resultsCustomer’s feedback

Google Play Questionnaire:

More than 3% responded

Average rating – 4,0

12.03.20156

Totally 22 problem spots detected in

Chelyabinsk region:

12 spots – in Chelyabinsk,

Snezhinsk, Magnitogorsk, Ozyorsk

and surrounding suburbs

4 spots – on M5 federal highway

and Chelyabinsk ring road

4 spots – in cities outside of Tele2

planned coverage

2 spots – on regional motorways

Actions considered:

8 Base Stations to rollout

1 Base Station to optimise

Снежинск

Челябинск

Озерск

Магнитогорск

Phase 1 MQMS Project resultsProblem areas

12.03.20157

More than 45 000 Auto-events captured in background mode

546 Manual Reports sent by users

500 subscribers affected a problem a half of them has sent a report

More than 20% “Companion” users has actively used Speed Test, My routes drive test and

My Building indoor test

Phase 1 MQMS Project result

Active Test Test Users

Speed Test, # 548 274

My Buildings, # 374 257

My Routes, # / km 66 / 600 66

Call Setup Success

Rate, %Drop Call Rate, %

Voice Call Success Rate,

%Service Availability, %

99,97% 1,29% 98,68% 99,44%

Overall Tele2 network KPIs shows excellent results:

12.03.20158

Passive ModeProblem captured in background mode in 2G/3G

More than 45 000 problem events captured in

background mode:

38,6% - No Data

32,1% - No Service

22,6% - Emergency Only

38.6%

32.1%

22.6%

4.6% 2.2%

12.03.20159

Active ModeProblems reported by subscribers

More than 200 subscribers reported 546

problems about problems with service:

26,2% - No Service

22,9% - No data

18,5% - Slow Data

26.2%

22.9%

18.5%

15.6%

8.9%

1.3%6.6%

12.03.201510

15%85% На улице

100% of problems reported consist location coordinates

85% of problems reported from indoor

48% of reports enclosed with user’s comments

Problem User’s Comment Location

No Service Total nightmare with coverage in my apartment :) Magnitogorsk, Truda str. 59

No Service Yesterday was No Service, no signal bars for a while Chelyabinsk, Pobedy eve. 160а

Slow Data Slow Internet connection while using Opera mini browser Trehgornyi, Mira str. 4

No Service Available only near the window. Magnitogorsk, Zhukova str. 17

Dropped Calls Connection lost on the entrance to my home Zlatoust, Zelyonaya str. 8

Slow Data When the hell 3G will rise??? Chelyabinsk, Kalinina, 15

Active ModeProblems reported by subscribers

12.03.201511

Active ModeMeasurements done by customers

66 users performed Drive Tests of 600 km total length

12.03.201512

Quality of Service evaluation:

3,8 – quality of service perception

3,6 – coverage perception

4,1 – voice quality perception

2,7 – data quality perception

39% of app users responded

4.1

4.2

2.7

3.6

1 2 3 4 5

Coverage evaluation:

3,5 – overall coverage evaluation

2% of app users rated their coverage perception

27 – answers where processed*

* Users were able to evaluate coverage in Coverage Checker menu

Value Add Functions of “Companion” appCoverage and Quality of Service evaluation

12.03.201513

Value Add Functions of “Companion” appSpeed Test and ‘My Building‘ indoor test

5 tests per day

-84 dBm – average indoor

Signal Level

20% of tests had Low Signal

Level

116 Kbps – Average Speed

in 2G

2,0 Mbps – Average Speed

in 3G

12.03.201514

The most popular function was “My

Buildings” indoor test.

Most number of test were performed on

First (1,2,3) and Top (9, 16) floors.

Floor

Average Signal

Level, dBmLow Signal reports, % Average Data speed

2G 3G 2G 3G 2G, Kbps 3G, Mbps

First floors (1-3) -87 -92 32,8% 18,7% 136,8 3,39

Mid floors (4-7) -82 -81 15,3% 9,6% 125,3 1,54

Top floors (8-16) -85 -98 1,4% 53,5% 83,6 1,59

Value Add Functions of “Companion” appIndoor tests

12.03.201515

252 No Service events recieved

1 user made indoor test at home (Breyvoila str. 27, 4th floor). Test measured median

Signal Level -99 dBm

2 additional Base Stations were considered to Rollout

Problem spot exampleChelyabinsk city, recently constructed buildings area (Sub-district #54 and #55)

12.03.201516

71 events of No Service, Emergency Only and Drop Call detected around Payment

Centre area. Average Signal Level -111 dBm

Considered Base Station RAN Optimisation

Problem spot exampleMagnitogorsk city, Karl Marks ave. 119/3

12.03.201517

758 problems detected in

background mode

2 users manually sent No

Service, Bad Call Quality

Reports

-99 dBm average Signal

Level around Truda str.

-105 dBm avg. Signal Level

during the problems

Considered to rollout new Base Station

Problem spot exampleMagnitogorsk, Truda str. 57 – 61

12.03.201518

Plant area of ‘ARH-Story’D

276 Emergency Only events captured that says competitors has better coverage

Considered to build new Base Staion

Problem spot exampleSuburbs around Korkino city and Novobaturino

12.03.201519

229 No Service events detected at Military unit with avg. Signal Level of -107 dBm

Considered to Rollout new Base Station

Problem spot exampleNorth-East part of Bishkil town district Chebarkul

12.03.201520

56 No Service, Emergency Only, Drop Call events captured

Considered to build 2 new Base Stations

Problem spot exampleM5 Highway, area between Zlatoust and Satka

Tank You!#Metricell

#Metricell