Presented by: For:
© ETSI 2018
19 June 2019
The Mission Critical Services (MCX) Plugtests Programme
Adrian Scrase, ETSI
Harald Ludwig, TCCA
Critical Communications
World 2019, Kuala-Lumpur
© ETSI 2018 2
Content
Open Standards
Motivation, Testing & Interoperability
Results from previous MCPTT Plugtests Event
Outlook to MCX#4 Plugtests Event
Summary
Agenda
© ETSI 2018 3
Open Standards & Testing
3GPP included Mission Critical Features beginning with Release-12
Products are under development, First products are commercially available
Only Open Standards give you full Interoperability
Only Testing ensure compliance to Open Standards
Testing of Products is very important
3GPP RAN5 MCPTT-Conformance Tests
Global Certification Forum (GCF)
ETSI MCX Plugtests Events
© ETSI 2018 4
Benefits of Standard-based Solutions
Wide choice of compatible equipment
Continuous and fast product innovation
Continuous and genuine competition
Lower prices and higher quality
Less dependency on one vendor
Equipment can be changed during the
lifetime of the system
Industry benefits:
Wider Market, Bigger Volumes
More possibility to invest –
faster product creation
Longer lifetime of market
© ETSI 2018 5
Motivation for Plugtests
Contribute to the standards validation effort
Plugtests Result will be used to improve 3GPP Specifications
Unique opportunity for implementers
To validate their understanding of the 3GPP standards
To test with other real implementations
To debug their prototype implementations (early bug fixing)
Support vendors, operators and users
To demonstrate end-to-end interoperability
To promote the technology and the eco system
© ETSI 2018 6
The MCX Plugtests Program
MCPTT becomes MCX (the “X” stands for PTT, VIDEO and DATA)
Participants have to sign the Non-Disclosure Agreement only once
Registrations to individual Plugtests (face-to-face or remote only)
Plugtests planned every 9-12 months
Scope of Plugtests and Test Plans will be agreed amongst participants
Observers are invited to help defining the scope and tests
Requests to test Interworking MCPTT-TETRA/P25 and Device to Device
Communications, but standards/products are not ready
ADD SECTION NAME
© ETSI 2018 7
What is Interoperability?
Interoperability ensures, that equipment from one vendor
is working with equipment from another vendor,
and vice versa
Gives Confidence that Purchased
Equipment Works with Equipment
from other Vendors
Ensures Open Standards
Enables Multi-Vendor Market
Example: Interoperability in TETRA
© ETSI 2018 9
Overview MCPTT/MCX Plugtests
First MCPTT Plugtests
June 2017 in Sophia Antipolis, France
Second MCPTT Plugtests
June 2018 in College Station, Texas
Third MCX Plugtests
December 2018 – January 2019, remote only Plugtests
Fourth MCX Plugtests
September 2019 in Kuopio, Finland
ADD SECTION NAME
© ETSI 2018 10
MCPTT#1 Plugtests - Summary
June 2017 at ETSI Headquarters in Sophia Antipolis, France
19 vendors, 140 participants in total (some remote)
Observers from: Belgium, Finland, France, Norway, UK
Based on 3GPP Release 13
47 test cases for MCPTT
160 test combinations
900+ tests performed
85% success rate
© ETSI 2018 11
MCPTT#1 Plugtests – Participating Vendors
MCPTT
Application
Server
Airbus
Alea
Genaker
Harris
Hytera
Nemergent
TASSTA
ZTE
MCPTT Client
Airbus Alea Armour
Etelm* Frequentis** Funkwerk
Genaker Harris Hytera
Nemergent Spirent TASSTA
ZTE*in TETRA BS ** in Control Room
User
Equipment
Bittium
Funkwerk
LTE Network
(EPC, eNB, MBMS)
Athonet Ericsson
Expway Huawei
One2many
IMS
Athonet
© ETSI 2018 13
MCPTT#2 Plugtests – Summary
25-29 June 2018
Hosted by the Texas A&M University in their “Disaster City”
31 vendors and 7 observers, 120 participants on-site in total
Based on 3GPP Release 14
100 test cases for MCPTT, MCData and MCVideo
300+ Test Combinations
2100+ Test Cases Executed
92% Success Rate
Interoperability Totals
OK NO Run
2003
(92.9%)152 (7.1%) 2155
OK
NO
© ETSI 2018 14
MCPTT#2 Plugtests – Participating Vendors (1/3)
MCPTT
ApplicationServer
Airbus* Alea*
Cisco Ericsson*Genaker* Frequentis*
Harris Corporation* Huawei*
Hytera* Kapsch CarrierCom
Leonardo Motorola Solutions
Nemergent* NokiaStreamWIDE TASSTA*
TD Tech
MCVideo
ApplicationServer
Alea
EricssonGenaker
Harris Corporation
Hytera
Nemergent
StreamWIDE
MCData
ApplicationServer
Airbus
AleaEricsson
Genaker
Harris Corporation
Hytera
Kapsch CarrierComLeonardo
Motorola Solutions
Nemergent
*participated in First MCPTT Plugtests as well
© ETSI 2018 15
MCPTT#2 Plugtests – Participating Vendors (2/3)
MCPTT
Clients
Airbus* Alea*
Armour Communications* Etelm*Funkwerk* Genaker*
Harris Corporation* Huawei
Kapsch CarrierCom Hytera*
Leonardo MCOP
Nemergent* NokiaPrescom Softil*
Sonim TASSTA*
TD Tech Valid8
MCVideo
Clients
Alea
FunkwerkGenaker
Harris Corporation
Hytera
Nemergent
NokiaSoftil
MCData
Clients
Airbus
AleaEtelm
Genaker
Harris Corporation
Hytera
LeonardoSoftil
*participated in First MCPTT Plugtests as well
© ETSI 2018 16
MCPTT#2 Plugtests – Participating Vendors (3/3)
LTE Network
ComponentsClientsAthonet*
Ericsson*Expway*
UE
User Equipment
Airbus
Bittium*Funkwerk*
Huawei
Sonim
TD Tech
IMS
IP Multimedia Subsystem
Athonet*
Audio Quality
Tester
Spirent
eMBMS Components
Evolved Multimedia Broadcast Multicast
Services
Athonet*
Expway*ENENSYS Technologies
Huawei*
One2many*
*participated in First MCPTT Plugtests as well
© ETSI 2018 17
MCPTT#2 Plugtests – Observers
Observers
AT&T
US Department of Homeland SecurityNIST
French Ministry of Interior
TCCA
Southern Linc Wireless
UK Home OfficeVerizon Wireless
© ETSI 2018 19
MCX#3 Remote Only Plugtests – Summary
Over-The-Top testing
Dec 2018 – Jan 2019
MCPTT, MCData and MCVideo (Rel-14)
26 vendors participated
150 test sessions, 1000 test cases
91% success rate
� Alea
� Armour Communications
� Athonet
� Beijing Jiaxun Feihong Electrical Co
� ENENSYS Technologies
� Etelm
� Expway
� Frequentis
� Funkwerk
� Harris Corporation
� Indian Institute of Technology-Bombay
� Kapsch CarrierCom
� Leonardo
� Mission Critical Open Platform (MCOP)
� Motorola Solutions
� Nemergent Solutions
� Nokia
� Polaris Networks
� Prescom
� Samsung Electronics
� Softil
� Sonim Techhnologies
� StreamWIDE
� TASSTA
� Valid8.com
� ZTE Caltta
© ETSI 2018 20
Documentation
http
s://w
ww
.ets
i.o
rg/s
tan
da
rds-
se
arc
h#
pa
ge
=1
&se
arc
h=
ts1
03
564
Plugtests Report Test Specification
© ETSI 2018 22
MCX#4 Plugtests – Key Facts
23 – 27 September 2019
Kuopio, Finland
Hosted by Finish State
Security Networks
35 Vendors and 15 Observers
MCPTT, MCVIDEO, MCDATA
Test Cases will be enhanced
(ETSI TS 103 564)
Preparation: already started
VPN & Remote Testing: ongoing
ADD SECTION NAME
© ETSI 2018 23
MCX#4 Plugtests – Registered Vendors
Airbus D&S
Alea
Armour Comm.
Athonet
name not disclosed
Cubic
name not disclosed
Ericsson
Etelm
Expway
Frequentis
Funkwerk
Genaker
Harris Corporation
name not disclosed
Hytera
IIT Bombay
Kapsch CarrierCom
Leonardo
MCOP
Motorola Solutions
Nemergent Solutions
ng-voice
one2many
Polaris Networks
Prescom
name not disclosed
Samsung
Softil
Sonim
StreamWide
Tassta
TD-Tech
Telo Systems
Valid8
© ETSI 2018 24
MCX#4 Plugtests – Registered Observers
Astrid
name not disclosed
Austin Wireless
name not disclosed
French Ministry of Interior
name not disclosed
Nordic Telecom Systems
NSW Telco Authority
name not disclosed
Suomen Virveverkko
TCCA
Police Netherlands
Norwegian Directorate of Civil Protection
Union International des Chemins de Fer