Date post: | 19-Nov-2014 |
Category: |
Documents |
Upload: | don-plooksawasdi |
View: | 310 times |
Download: | 12 times |
� � �� � � � � ��� � � � �� � � � � � �� � � �� � � � � � �
�������������
������������ ������
20YEARS
Key
note SIGOS
1989 - 2009
3
Testing is our Competence
Keynote SIGOS was
founded under the
name of SIGOS back in
1989. For two decades
we have been sup-
porting the mobile
networks, including most
of the World's Top Twenty operators, ensur-
ing and improving their Quality of Service
and helping them to both discover new
opportunities and launch new services. In
other words, we have helped our network
customers to continuously improve the
experience of their own customers, driving
up customer satisfaction and retention.
We are doing this through providing flagship
solutions for active End-to-End Testing to
the telecommunications industry. Since we
have dedicated ourselves totally to this
speciality we always have to be top notch
in what we do.
The development of our product portfolio
also reflects the development of telecommu-
nications itself: we started with testing of
fixed line services, expanded our intelligent
testing solutions towards mobile telecommu-
nications in 2G and 3G. Of course we won't
stop there: we will continuously strengthen
our customers’ position through providing
more than just basic mobile operator testing
services. Next generation network including
VoIP quality testing, revenue assurance and
Drive Service Testing are good examples of
solutions that go beyond the verification
of standard services.
Today, Keynote SIGOS offers the most tho-
rough active End-to-End Testing solutions
in the market.
We have a clear business focus, close co-
operation with our customer base and an
established and experienced team. Telecom-
munications is a relatively young business
but we can proudly look back on two
decades of success.
Keynote SIGOS
20YEARS
Keynote SIGO
S
1989 - 2009
Keynoottee SSIIGGO
S
"�����"�"?"��9
��)�3
"�������;66%�� �����
��� ! �������!��"
= ���� %% ������������������������ �1
",66%� ��� ��"��:���� �������������� �1
#����"��"
"9"���������������������������� �@
99"�����������������������������2
9�#�%����� ��9��� ����������������� ��
����� %���&��9 � �� ��� ������������ ��
�$���%
����� ���:�>�������6���� ��������������
�,�&����� %� �����������������������*
>����A, %��� �����������������������1
>�����:���� ��������������������� �2
��!�
��"��/�"B�"0 ������������������ ��
=% ��=���� ������������������������4�
��&��� �������������������������� 4�
C;����������������������������� 44
C�#=�������D�� �������������������4*
C8;+���������������������������41
"��� ���������������������������42
>�)����%�6&���������������������� *�
>�)��A, %��� ����������������������*�
"����:��:���/���%�E-� �,���0
�6��"���� ����������������������� 2
����� %�6��� � # ��� ��������������� 2
"�99,%��6%�3��� ��������������������� 2
���������' ��� ����������������������� 2
� 6&�� %���������' �� ���������������� �
9�),% ����E"� % #�%��� ���������������� �
��� ������,���9 � �� ��� ���������� �
����� ���)���� ���������������������� ��
����� �������)�� �������������������� ��
����"�F,�����E������%"��,��,��� ������� ��
� � " '���������������������������� ��
��-�2�& � ����",66��� ���������������� ��
��6������E;% � ��� ������������������ ��
�"��:���;�� 9��������� ��������������� ��
�� �&#� �) ������������������������ �4
�9 ���3��6��� ���������������������� �4
"���+������� 6&�� �������������������*
"���+������� 6&��G�* ���:�"��:����������G**&
!������"��"
�����),����� �������������������������1
G��)�3
�,��� ��9 6G11
"�9=�3���������G*2
�&���H��9�#�%�;
'
���'������ %"��:����
���'������ %"��:���� ������������������14
"����������%����
�������%���� ������������������������ ((
����+������������������������������� ((
8 ���4�� �� ������������������������ ((
�+B�;9�8 �������������������������(1
"������������6��
���:�"��:���������� ������������������**
$ �)���"� ,% ���� �������������������*1
"�9=�3��������� ��������������������*2
��:��,�;��,� ��� ������������������� (�
������ 6 ����� �������������������� (�
�=�%%��� �)� ����>���'�� ��������������� (�
�� ������������������������������ (4
���#�,�)�� ���/���0��������������� (4
�%�# %�� ���A, %���/�A0 ����������� (*
%�# %�� ��
�,�#�,�)�� ��� �������������������(2
�,��� ���
�,��� ��� ��������������������������11
6
SITE TEST SYSTEM
Whether you require a stand-alone test solution
or you wish to span your testing facilities around
the globe at multiple locations: from Keynote
SIGOS solutions you can always expect scalability,
integrity and great expertise reflected in our
solutions and professional services.
With the Keynote SIGOS SITE Test System –
comprising sophisticated hardware and software
solutions – network operators are enabled to
host and work with their own testing facilities.
Key here is the ability to easily integrate into
the existing network infrastructure realities.
Interfaces to complementary solutions, e.g.
monitoring systems, are provided so that SITE
can be exactly matched to your specific
requirements.
The SITE Test System’s architecture is completely
modular. Only the modules that are needed for
the given tasks needs to be purchased. Our
Senior Telco Experts will be happy to discuss
your requirements.
GlobalRoamer
Keynote SIGOS Managed Global Infrastructure and Test SystemFor Outbound Roaming
With GlobalRoamer, Keynote SIGOS offers the
most extensive infrastructure for automated
outbound roaming testing world-wide. We provide
our customers with an extensive network of
testing facilities around the globe, hosted by
Keynote SIGOS. GlobalRoamer customers can
use this sophisticated testing infrastructure
through a web based user interface.
All that is required is a web browser and access
to the internet. Simply log on with your password
and set up your test schedules without worrying
about a thing. However, Keynote SIGOS can
also provide a fully managed roaming test
service so that all that you really need to do
is look at the results.
We at Keynote SIGOS are always there for our
customers: in each phase of your testing
requirements we provide you with well
experienced and specifically trained personnel,
whether it be for project implementation,
maintenance, managed services, training or
solution consulting. All our Professional Services
can be customized to your specific needs.
For instance, with different levels of Managed
Services, we can help our customers with the
management, operation and administration of
tests. Our services are completely customizable
and scalable: we are handling complete SITE
systems for customers as well as we manage
small occasional testing projects. Just as you
please.
Professional Services
Solution Consulting, Managed Services and More – Flexibleand Customizable
Keynote SIGOS
> Introduction
Your Own Scalable and Highly Flexible Testing Infrastructure
7
Keynote SIGOS
> Introduction
The solution is fully automated testing with SITE:Keynote SIGOS has developed the most advanced
automated test system available on the market,
providing precise and easy to use automated testing
throughout the entire network.
Today, network operators are confronted with an extremely dynamic market
and the challenges of keeping up with new technology, permanent surveillance
of Service Level Agreements (SLA) and reducing costs whilst maintaining
customer satisfaction. To fulfil these challenges preventive and permanent
testing is required. These tests can be both labour-intensive and extremely
costly and for those reasons are frequently neglected.
Cost-Saving Automated TestingAvoid imprecise, time consuming and labour intensive manual tests
SurveillanceContinuous and precise monitoring of service availability, quality (KQI)
and performance (KPI)
Service Quality ManagementPrecise measurement of service availability, performance and quality
ReportingHighly flexible, dynamic and automated reporting and alarming environment
ScalabilityFrom small stand-alone to network-wide distributed systems
Central SIM MultiplexingTo use infinite numbers of SIM Cards at various locations
Graphical User InterfaceUser-friendly, drag-and-drop graphical interface with rollover help text
Flexible User AccessPermission based access via Internet, LAN and XML
Open InterfacesFor seamless integration and combination of existing and new tools
Customising EnvironmentTest case editor to create and adapt tests to specific customer needs
The Keynote SIGOS platform for
first-class Quality of Service
8
SITE Test System
ISUPMAP Gb GSM
SCCP TCAP IuCS
GSM AINAP
CAP IuPS
Core Network Internet
WLAN
BlackBerry
a / bS0UCP SMPPSMTP/IMAP
WAP via IPMMS via IP
EthernetS2m
DSL
Mobile Network
HSPA*
Specific Interfaces
SITE Overview
SIT
E T
EST
SYSTE
M
CIMD
Central Open DatabasesTo ensure maximum performance, the SITE System
uses an open SQL-based database. All configuration
information, test results, measurements and KPIs
are stored logically, to provide a clear measurement
and reporting capability. Using powerful filter
functionality any database listing can be easily
modified and a multi-format export function allows
the sharing of data with other network support
tools.
Test InterfacesSITE supports GSM/GPRS Um, UMTS Uu, HSDPA,
HSUPA, EDGE, CDMA2000, PSTN a/b, ISDN S0, S2m,
GSM A, GSM Gb, ISUP, GSM-R, WLAN, IuCS, IuPS,
Ethernet, DSL, SMPP/UCP/CIMD, MM7.
Open SystemSITE is an open system and can be easily integrated
into existing test environments. Existing equipment
may be directly linked to SITE and controlled and
monitored via the XML system interface.
In addition, current software updates, configuration
modifications or problem resolution are quickly
and reliably performed by Keynote SIGOS.
SIM MultiplexingSITE can handle thousands of SIM and USIM
cards in cascade-style SIM card boards. The
subscriber information of a SIM card is read out
by the system and transmitted via a LAN/WAN
network to any test location required. The SIM
authentication procedure is handled virtually between
the wireless interface in any location and the real
SIM stored in the central Multiplexer unit.
* with possibility of Layer 3 protocol trace feature/monitoring
GSM/GPRS Um
UMTS Uu* GSM-R
CDMA2000EDGE
PBX
PSTN
ISDN GSMA
Gb GSM ISUP
LAN / WAN
lu CS lu PSsupporting thousands of SIM cards serving
Um, Uu and SS7-Interfaces (A, …)
CentralUnit
SIMMultiplexer
Compact LocalUnits
Local Units
Clients
UMTS Uu
GSM /GPRS Um GSM/GPRS
Interfaces UMTSInterface
MM7
9
SITE Overview
Graphical User InterfaceThe SITE User Interface enables easy system
operation and administration via either the intranet
or internet. The Web GUI client is used for
configuration of tests and reports as well as for
administrative system configuration. The system
can be accessed simultaneously by various parties,
each with configurable user rights. The SITE User
Interface provides a user friendly, drag-and-drop
environment to arrange, copy and edit test and
report elements, within a directory tree and folder
system. The Web enabled User Interface enables
a flexible access to the system, for example, by
technicians from remote locations.
The XML interface is used as an integration interface
to exchange input and output data with other
network test or management infrastructure.
The modularity and scalability of SITE permits
optimum system adaptation to customer
requirements. Portable and Stand-Alone Systems
for implementation in test laboratories are just as
possible as the provision of a distributed system
to cover the geography of an entire live network.
The modules of the SITE system are the Central
Unit, SIM Multiplexer and Local Units. Local Units
may be connected by permanent IP – but fast,
problem oriented, deployment of local units
independent of permanent IP is just as possible.
There are Wireless Local Units (WLU) and Mobile
Local Units (MLU) to increase deployment flexibility.
The IP connection is vital to the system and is
therefore constantly monitored by SITE. The test
system may be upgraded as required by new
applications, functions and test interfaces.
Modularity & Scalability
Dynamic Resource Management
SITE can execute tests at any time desired. Via the
scheduler window a single or group of tests can
be defined once or periodically, based on very
flexible selection criteria of date, day, time, frequency
and number of repetitions. To avoid any resource
conflict, an intelligent resource management system
controls access to interfaces and SIM cards, assuring
a smooth operation and maximum test parallelism.
The selfmanagement checks system components
regularly and generates an alarm (SNMP-Trap) in
the event of failure.
SIT
E T
EST
SYSTE
M
10
DATA SafetySITE redundant is a solution for reliable high
availability. The main concept is the mirroring of
the hard disk partition over TCP, based on the
standard Linux High-Availability option. It observes
the operating system, databases and processes.
If a component crashes a power failure happens
or anything is stopped manually, then a switchover
to the second system will be initiated.
SITE Backup Solution is very important in the case
of a damaged or corrupt database, SITE installation
or hard disk. It is based on Arkeia’s “Enterprise
Backup Solutions”. Keynote SIGOS provides this
backup software with a pre-configured backup
strategy for the SITE Central Unit. Special features
are scheduled backups, incremental and
differentiating backup, as well as tape
administration.
Test Sequences & Control StructuresTo mimic the typical usage, of say a mobile network
customer, a test sequence feature can be used for
a series of different service tests after a single
Location Update. Control Structures provide logical
operators like: List based ‘FOR EACH’, condition
based ‘WHILE and REPEAT’, and time based ‘WAIT’
functions. These features save valuable resource
time and significantly increase the testing throughput
and efficiency of the system.
Test Case EditorSITE provides large libraries of Test Cases for main
network services in various formats with detailed
parameter options. To create customized own Test
Cases with the assembly of various test steps via
a user-friendly drag-and-drop mechanism SITE
provides it’s Test Case Editor environment. Complex
scenarios can be quickly built to enable the testing
of new network services.
Test Case RecorderThis SITE tool allows intuitive recording of browsing
actions taking handset characteristics into account.
Mobile and provider specific web and WAP pages
are retrieved from the network via the test probes
during recording sessions to get a feel for real
download behaviour and latency. Traces are shown
live while the developer is browsing. The test case
can be evaluated before saving the entire browsing
session by replay during creation. Full feature
support by the Test Case Editor makes later
adaptation of recorded browsing sessions easy. It
is like having full and instant remote control access
to a specific handset in a remote location – with
no need to travel anywhere to use it.
UTF-8 Character SupportThe UTF-8 feature enables the full encoding for
e-mail, web pages, & other places where characters
are stored or streamed. SITE test cases support
full encoding for SMS, WAP and MMS parameters.
All parameters in the Test Case Editor can be filled
with UTF-8 characters unless no specific presets
are given. So an SMS text or html link can be
searched and checked with UTF-8. SITE Reporting
shows all possible values: conventional as well as
UTF-8 entries.
Benefit: Wealth of language specific characters can
be supported, e.g. Latin, Greek & Coptic, Cyrillic,
Armenian, Hebrew, Arabic, Syrian, Bengali, Thai,
Myanmar, Georgian …
SIT
E T
EST
SYSTE
M
SITE Overview
11
SITE Reporting enables users to create, view
and forward multiple reports. These reports are
generated from measurements collected in the
report database. These reports can either be
based on SIGOS standard Key Performance
Indicators (KPIs), on KPIs according to ETSI
standards or on individual customized KPIs.
This report creation is by means of an easy
drag-and-drop configuration functionality. SITE
Reporting offers the possibility to visualize test
results in various illustration tools, serving
even specific presentation and monitoring
needs. Flexible standard charts and diagrams
as well as enhanced functionalities like
“percentile”, “ad hoc reporting” and “derive to”
can be immediately generated from recorded
KPI data. Real time alarming is also embedded:
resulting alarm notifications are automatically
distributed e.g. via SMS, e-mail, SNMP, etc. to
defined recipients. Users can define flexible
threshold-settings, counters, severity triggering
points, etc. when alarms should be generated
or cleared.
Reports can be illustrated in different ways,
either charts in various formats; markers, bars,
lines etc, or by matrix tables to provide a fast
color coded overview of vital services or
specific KPIs.
Reporting and Alarming
Reporting is fully integrated in SITE
Service Area Monitoring
Dashboard
Matrix Report
SITE Overview
> Reporting and Alarming
Your benefits
Automated testing: avoid expensive and time consuming manual testsIncrease reliability of the mobile network, thereby increasing ARPUIncrease customer satisfactionMonitoring and measuring of service availability and quality Ensuring SLAs with precise KPIsScalable architecture: from stand-alone to geographically distributed systemsCentral SIM Multiplexing No “SIM card traveling”Quick detection of problems by rapid parallel testing of all network servicesIn addition to standard SITE reporting, many powerful reporting features are available
ReportDefinition
alarming
KPI Databases
PostReporting
OnlineReporting
MeasurementsStrategy / KPI design
Raw-Measurements(Input and Output)
real timereporting
Test Executions
Test Execution on different locations
SIT
E T
EST
SYSTE
M
12
Service Area Monitoring is divided in two panels:
SERVICE View
The Service View is the GUI for Service AreaMonitoring application. Users are able to seethe status of network elements in theNetwork / Service model graphically.
DETAILS View
The Details View offers further information foreach unit in the Service View, such as:Name, Alarm Aggregation Method, Commentsand Assigned Alarms.
Service Area Monitoring
The SITE Service Area Monitoring application is
used to visualize mobile network services that
target a specific Service Area. Alarms that are
generated by the failure or degraded performance
of services can now be linked to a specific
network element within the operator’s
infrastructure. This function is implemented by
careful correlation between the specific elements
used within a Test Case execution, and the overall
network topology which has supported the Test
Case scenario that generated the alarm or
measurement. An example could be a WAP test
initiated from a wireless interface located at
Latitude (x), Longitude (y). The topology for this
scenario would use specific BTS/node B, BSC/RNC
infrastructure, assigned to an MSC/SGSN reaching
finally a specific content portal.
Each network information and trace is processed
to provide significant data of the actual network
performance and functionality, finally combined
to a total service area view.
Test Execution System SITE KPI Database Reporting/Alarming Service Monitoring Engine
Alarms
Test Execution Results (Traces) Report/Alarm View Service View
Drill Down #1Drill Down #2
Test DefinitionsSchedules
Report DefinitionsAlarm Thresholds
Alarm CorrelationNetwork/ServiceTopology
SIT
E T
EST
SYSTE
M
SITE Overview
> Reporting Additions
13
Matrix ReportMatrix Report environment allows the user to
view Key Performance Indicator (KPI) data as a
numerical value, which can be easily color coded
to provide a quick, easy to understand overview
of network performance. Service KPIs can
therefore be displayed in a format which is
especially useful for Network Management and
Operations personnel.
Matrix_Multi mode, allows for a table of different
KPIs as the “Y-Axis” to be configured, in relation
to another KPI as the “X-Axis”.
The right example displays the average results
of a tested service, where three different
measurement KPIs, (Success, Failure and
Incomplete) have been tracked against different
PLMNs. By placing the cursor above a selected
cell within the Matrix, additional information can
be gained regarding the displayed statistic. As
with all report charts available in SITE, a “drill
down” process is also available to gain access
to detailed individual test data when required.
Matrix_Single mode allows for the tracking of
one Key Performance Indicator (KPI) , in relation
to two other KPIs in a matrix. Alarm thresholds
can easily be set to provide a distinctive color
output to ensure that possible error conditions
can be quickly seen and understood. In the left
example, the Rx (Receive) Value is the single KPI
represented, against day of the week and different
interface types and their current locations.
DashboardThis GUI system tool provides a simplified intelligent
interface to SITE reporting. It is interesting especially
for the people responsible for the service who
want to work intuitively without any training effort.
KPIs can easily be filtered and individually stored
in a few clicks. Individual configurations allow
additional, more customer-oriented, data analysis.
Fast and easy drill down to individual traces is
possible directly from the Dashboard.
SITE Overview
> Reporting Additions
SIT
E T
EST
SYSTE
M
SITE TEST SYSTEM
SIT
E T
EST
SYSTE
M
Various Technologies – ONE Test System: SITE
14
15
SIT
E T
EST
SYSTE
M
Given all these challenges how can you
ensure top quality end user experience
avoid revenue leakage
safeguard SLA compliance
The answer is “Active End-to-End Service
Quality Testing and Revenue Assurance” with
Keynote SIGOS.
SITE Test Applications
> End-to-End testing
SIT
E T
EST
SYSTE
M In a highly competitive market, such as the tele-
communications industry, providing and
maintaining highest quality to end customers
is key to sustainable competitive advantage.
With customers having multiple options at hand,
poor quality – even the occasional drop of
quality – can have immediate consequences.
Switching between operators never has been
easier and through mobile number portability
a classical barrier to switching long has fallen.
First class service quality has many influencing
factors not all being under immediate control
of the operator. Identification of weak points
can be difficult and remain undiscovered while
the effects still are being carried into the market.
Often goes along hidden revenue leakage as
for example through the fraudulent and
undiscovered usage of SIM boxes. Safeguarding
compliance of service level agreements is another
example that requires active testing.
Even the basic call in fact is not exactly basic:
prepaid subscribers, which make the majority
of most mobile network's customer base, typically
involve complex intelligent network support
and interaction with a ‘hot billing’ credit database.
Also supplementary services like Call Forwarding,
Call Waiting, Call Barring, Call Hold, CLIP/CLIR
are multi-switched calls which need complex
interaction with the subscriber profile.
Infrastructure growth or changes require that
core network configuration data between mobile
to mobile and between mobile and fixed line
is correctly maintained.
Active End-to-End service quality testing and
revenue assurance with Keynote SIGOS enables
operators to identify weak points and to get in
control over aspects normally out of direct reach.
From slipping into the role of end customers
and experiencing service quality from different
angles to preventive testing, as it is required
when new services are introduced. With Keynote
SIGOS’ SITE Test System and its comprehensive
test applications and concepts, operators always
have the right tool available.
Why End-to-End Service Testing?
Customers’ View
Quality of Service
Quality of Service on the move
Service reaction time
Revenue Assurance
CDR Compare
Prepaid account check
Voucher booking
Defined Conditions
Defined time /duration
Defined data volume
Defined period
Exact KPI control
Immediate Reaction
Immediate fail detection
Clear alarm situation
Advantages of active End-to-End Testing
Preventive Testing
New Components
Service Introduction
Regression tests
Roaming Tests
IREG tests
Outbound roaming
16
What about your Text Message Service?
SMS is the worldwide killer application
for network operators.
This simple network application results
in a large percentage of turnover for each
network operator. However, this important
revenue stream also requires constant
monitoring and possible improvement in
quality of service. SMS, as simple as it
may look, when monitored continuously,
often suffers from long delivery durations,
modification of content or missing text
with multiple SMS messages.
Regular tests are therefore required to
maintain a high standard of quality and
to improve customer satisfaction.
Phot
o ©
T-M
obile
AG
17
IP IPIP
CIMDUCPSMPP
SMSCBSC BSC
SITE Test System
Features
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, UMTS Uu, Iu CS,
CDMA2000, GSM A,
SMPP / UCP / CIMD via LAN (TCP/ IP)
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Protocol test GSM 03.40, MO/MT
Resource allocation for different users or groups
Check functionality of SMSC
Check SM Service functionality
at peak times
Transmission time KPI
Available SMS KPIs:
SMS send duration
SMS deliver duration
SMS end-to-end duration
SITE Test Applications
> SMS
SIT
E T
EST
SYSTE
M
Multimedia Messaging Services are vital
to the network operators younger and
higher ARPU (Average Revenue Per User)
customers. With its complex functional
combination of SMS and GPRS it is easy
for the service to become unavailable in
a complex mobile network that is always
being upgraded or optimized.
In order to gain acceptance as a useful
service and drive frequent use by the
subscribers errors should be avoided
from the beginning, as once a service
does not work subscribers turn away
from it. Therefore, to aquire a high
reputation for Quality of Services (QoS),
regular tests are essential.
Test your services proactively via the
automatated SITE MMS Test capability,
and guarantee your subscribers a high
standard of quality!
Success with MMS!
18
Features
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, GSM A, GSM Gb,
UMTS Uu, HSDPA, HSUPA, EDGE, Iu CS, Iu PS
CDMA2000, MM7
Detailed test reports incl. WAP WTP/WSP
decoding
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Resource allocation for different
users or groups
No MM storage limitations
MM to legacy handset tests
User definable test messages
MO/MT transmission of multipart MMs
Segmentation and reassembly supported
Expandable library of MMS test messages
Logging of all relevant timestamps
SITE Test Applications
> MMS
SIT
E T
EST
SYSTE
M
Phot
o ©
T-M
obile
AG
MMS Test Cases
19
Example Test Case MMS_MO_MT
Orig.MMS Client
TargetMMS Client
Orig. MMSProxy-Relay
Target MMSProxy-Relay
WSP/HTTP GET.req
M-Retrieve.conf
Time passes
M-Send.req
M-Send.conf M-Notification.ind
M-NotifyResp.ind
M-Acknowledge.ind
M-Delivery.ind
Available MMS KPIs:
GPRS attach duration
PDP context activation duration
PDP IP UP duration
MMS send duration
MMS fetch duration
MMS push arrival to receive MMS
duration
MMS connection to send duration
MMS send to push arrival duration
MMS end-to-end duration
> MMS
MMS_MOSending of an MMS message to any externalnumbers or e-mail address
MMS_MTReceiving MMS via corresponding WAP Pageafter SMS notification
MMS_MO_MTSending and receiving of an MMS (notificationand download via WTP or WHTTP protocol stack)
MMS_MO_ToEmail_Retrieval Via MobileSending of an MMS message to an e-mailaddress and fetching the correspondinge-mail message via POP3/IMAP
MMS_MO_ToLegacySending of an MMS to a subscriber which hasno MMS capabilities configured by thenetwork operator
Others on Request
Interactions occuringbeyond MMSM are not
in this document’s scope
Interactions occuringbeyond MMSM are not
in this document’s scope
SIT
E T
EST
SYSTE
M
20
Can your customers chat via
Mobile Instant Messaging?
Keynote SIGOS offers Mobile IM test cases based
on OMA, optimized to customer requirements.
Operators who test with SITE can get KPIs about:
registration at the IM server
successful login
“get presence”-information of other users
and whether two parties can “see” each other
text message receipt from IM server
successful logout from the IM server
Instant Messaging – the real time text
based communication between two or
more participants – is well known on the
desktop, like Skype, ICQ, MSN etc. This
instant messaging (IM) has made the
leap from the PC to the mobile phone
connecting friends, peers, colleagues
while they are on the go.
To get connected to either fixed IM users
or mobile IM users, Java applets installed
on mobiles deliver branded user interfaces
that reflect the operator-owned mobile
IM community or the most popular
Internet IM services. A single client gives
access to multiple IM systems and can
transmit and receive presence information.
The clients are compliant to the Open
Mobile Alliance (OMA) Instant Messaging
and Presence Service (IMPS). Which also
means the needed IM protocol for mobile
devices is defined by the OMA.
SITE Test Applications
> Mobile Instant Messaging
SIT
E T
EST
SYSTE
M
21
Make Premium Content download apremium customer experience andtest your Digital Rights Management
Phot
o ©
T-M
obile
AG
SITE Test Applications
> Digital Rights Management
Digital Rights Management (DRM) is an
important enabler for billing of premium
priced content, e.g. ring tones. To cater
for fast and flexible service creation the
Open Mobile Alliance (OMA) defined
application-level protocols and behaviors
needed to provide powerful as well as
reliable content download functionality.
The scheme is implemented on most
multi-media phones and is intended to
be used by mobile content providers to
control access to their products.
The whole Digital Rights Management
process is relatively complex and could
introduce multiple risks of malfunction.
At the same time, the effect of a possible
error can be disastrous: unhappy
customers if a fault occurs during the
download and billing process of the
premium priced content.
With special SITE Test Cases for the
verification of your Digital Rights
Management you can avoid undesirable
surprises for your customers and test the
entire procedure according to OMA
specifications. So that your customers
will call their download experience a
premium one.
The purpose of DRM is to enable controlled
purchase and usage of digital media objects.
The Open Mobile Alliance (OMA) has defined
Digital Rights Management specifications for
the mobile world:
Forward Lock (prevents the user from
unlawful forwarding of protected content)
Combined Delivery
(combined rights object / media object)
Separate Delivery (separated rights object
+ encrypted media object)
Digital Rights Management is a complex
process. Users expect seamless proce-
dures when downloading premium content.
Ensure your customers will call their
download experience a premium one.
SIT
E T
EST
SYSTE
M
Interactive Voice Response services (IVR)
used, for example, during Voicemail
access, are a common feature of everyday
life. The situations in which people
communicate with services such as
customer care systems via IVR servers
will increase continuously.
Testing these systems is essential for
network operators to assure the quality
of their services and thus keep their
customers. IVR systems are sophisticated
and extremely difficult to test on a
continuous and reliable basis. At present,
complicated test runs in which employees
must manually test IVR systems are to
a large extent standard practice.
Keynote SIGOS innovation has created a
tool that can wholly automate this task.
The IVR tester is designed so that even
the most sophisticated speech menus
may be recorded and recognized based
on a library of voice prompts.
Do your voice response serviceswork correctly?
22
Features
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, UMTS Uu, Iu CS,
CDMA2000, PSTN, ISDN So, S2m, GSM A
and ISUP
Scalable architecture: from stand-alone
system to widely distributed system
Detailed IVR test reports
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Testing IVR trees
Voice mailbox tests
Resource allocation for different
users or groups
Announcement comparison based on
voice prompts
Easy integration of new voice prompts
DTMF and voice stimulation
Customer specific extension
Several languages available
Language independent
SITE Test Applications
> IVR
SIT
E T
EST
SYSTE
M
IVR systems need to be checked in respect to:Availability of voice services
Correctness of announcement
The structure of the entire IVR system
Available IVR KPIs
Recognized prompt
Recognized prompt parts examples
Keynote SIGOS IVR Test System Procedure
calling service number
recording announcement 1
sending DTMF/WAV
recording announcement 2
sending DTMF/ WAV
recording announcement n. . .
23
> IVR
Available IVR KPIs:
Call Duration
Duration of played audio file
Length of recognized reference prompt
Duration of recognition process
Recognition confidence of best recognizedreference prompt
Recorded audio file location
Real duration of recording
Announcementcomparisonwith Prompt
library
Announcementcomparisonwith Prompt
library
SITE IVR Tester
SITE IVR Tester
SITE IVR Tester
IVR System
IVR System
IVR SystemSIT
E T
EST
SYSTE
M
Phot
o ©
T-M
obile
AG
24
The “push-to-talk” services turn mobile
phones into walkie-talkies with unlimited
range.
Mobile users like businessmen, delivery
companies and taxi drivers can connect
in a “walkie-talkie-style” at the touch of
a button.
Push-to-Talk over Cellular (PoC) a real-
time, direct, 1-to-1 and 1-to-many voice
communication service is mandatory for
today’s cellular networks. Companies,
especially those needing to be in constant
touch with several teams and locations,
will soon discover PoC to be the most
efficient solution. The benefit of radio-
style communication, especially
broadcasting to many users, makes it
much more convenient than many phone
calls or even call conferencing.
Be sure your Push-to-Talk service meets
the high quality and reliability required.
Back to the Future with Push-to-Talk
Features
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, GSM Gb,
UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS,
CDMA2000
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Test 1-to-1 or 1-to-many communication
Play and record speech data
Emulating mobiles like Nokia 5140
and similar
Real End-to-End Testing of
real-time-always-on voice service
Check SIP (Session Initiated Protocol) Control
Plane of the PoC Application Server
Check RTP (Real-time Transfer Protocol) User
Plane of the PoC Application Server
SITE Test Applications
> Push-to-Talk
SIT
E T
EST
SYSTE
M
25
QoS testing solution for PoC:
Test PoC availability
Check Communication between
UE and PoC server
Check control plane
Handling SIP sessions which are
used to establish and maintain
the connection between PoC-enabled handsets
(Interface: UE and PoC server via UDP)
Registration, authentication and
authorization at PoC server
Group attachment
Check user plane
Speech data transmission
Send and receive speech data
in AMR format to/from
other group members
Handling of RTCP messages
SITE Test System
LAN/WAN
IP Network
PoC Application Server
RTPUser Plane
SIPControl Plane
> Push-to-Talk
Available PoC KPIs*:
Registration Failure Ratio
Registration Time
Session Initialization Failure Ratio [%]
Session Initialization Time [s]
Floor Request Failure Ratio [%]
Floor Request Time [s]
Stop-Talking Timer Failure Ratio [%]
Stop-Talking Time [s]
Session Cut-off Ratio [%]
Session Setup Time [s]
Voice Delay (in session) [s]
Voice Delay (first) [s]
Audio Quality
* Reference: ETSI/STQ_Mobile(05)06TD06
SIM Multiplexer
Um, Uu
Central Unit
SIP + RTP messages viavia Um, Uu
SIT
E T
EST
SYSTE
M
Voice Quality is, and will remain the major
key performance indicator for each
operator’s network quality. This is
recognized by subscribers and operators
alike.
Bad voice quality generates short holding
times and repeated attempts, and
immediately sets a poor level of
satisfaction with the user. Furthermore,
international Voice Quality tests can reveal
crucial quality information of different
network carriers, the usage of IP routing
or SIM boxes. Therefore, verification of
voice quality is essential. Subjective tests,
where human beings would have to score
the quality of sound samples in a listening
laboratory environment are expensive.
Automated test methods with the
intention to mimic subjective tests, allow
for a cost effective and consistent
alternative to subjective testing, either
on a referenced or an unreferenced basis.
Do you offer excellent Voice Quality?
26
Referenced Voice Quality (PESQ)
Unreferenced Voice Quality (3SQM)
Features
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, UMTS Uu, Iu CS,
CDMA2000, VoIP, PSTN, ISDN S0, S2m,
GSM A, ISUP, LAN/WLAN
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Customer specific audio reference files
are easy to ingrate
Objective MOS Voice Quality result values
from 1-5 (bad, poor, fair, good, excellent)
Many further measurements
SITE Test Applications
> Voice Quality
SIT
E T
EST
SYSTE
M
Call from A-Side to B-Side and perform speech
quality check, by playing an audio reference file
from A-Side to B-Side and check the received
audio signal with its reference using the
standardized PESQ algorithm. One crucial result
measurement is called ‘mean opinion score’
(MOS) and the result values can be interpreted
from ‘bad’ to ‘excellent’.
27
> Voice Quality
Available Voice Quality KPIs:
MOS_Lq
MOS_Noise
MOS_P8001
MOS_Speech
Background Noise
Average delay
Measurements e.g.: MOS value background noise delays attenuation …
optionally:
A BA B
Impairment GradeExcellent 5Good 4Fair 3Poor 2Bad 1
=
play Audio File record
A-Side
Reference Audio File
B-Side
Reference Audio File
PESQAlgorithm
Recorded Audio File
Unreferenced Voice Quality Testing(3SQM™)SITE also supports the Single Sided Speech Quality
Measure 3SQM™ (ITU-T P.563) for advanced non-
intrusive voice quality testing. The technology behind
3SQM™ is also based on a generic perceptual approach
and so is independent from the network technology
being assessed.
In comparison to intrusive measurement techniques,
such as P.862/PESQ, 3SQM™ is based on single ended
measurements. In consequence, accuracy may not be
as high but measurements can be made at almost
any point in the network with any real-world speech
signal.
Referenced Voice Quality Testing (PESQ)Referenced SITE Voice Quality testing is based
on the ITU-T P.862 standard via the PESQ
algorithm (PESQ = Perceptual Evaluation of
Speech Quality). PESQ forms the state-of-the-
art technique and international standard for
automated advanced perceptual voice quality
analysis, comparing actual test results with an
audio reference. Referenced Voice Quality Testing
provides a very high level of accuracy.
SIT
E T
EST
SYSTE
M
28
Voice over IP
SITE Central Unit
With the Voice over IP testing capabilities
of the SITE Test System, it is possible to
perform real time end-to-end active
VoIP-testing to determine the customer’s
experience of the service.
Testing Voice QualityAlthough Voice Quality is vitally important
for any type of network that routes voice
traffic, the shift from dedicated circuits
to the efficiency of IP based traffic, brings
its own problems with regard to the end
customer’s perception of performance.
The possibilities for Delay, Jitter and
Packet Loss over an IP based infrastructure,
means the network operator must con-
stantly check the Voice Quality metrics
to ensure that problems are detected
before they cause major disturbances
and dissatisfac-tion to the customers. As
well as ensuring that end-to-end connec-
tions can be established, maintained in
a speech state for the required test period
and success-fully cleared down, the quality
of real sound samples needs to be
checked throughout the “speech” phase
of the connection.
This is why SITE supports voice quality
testing according to the PESQ algorithm
recommended in the ITU-T P.862 standard.
Fixed NetworkISDN S0, S2m
SITE Test Applications
> VoIP
SIT
E T
EST
SYSTE
M
Operator Network
LAN
DSL-Router
DSL-Modem DSL-Modem
DSL-Router
EthernetIPIP
PSTN / ISDN
Location nCLU
Location 1CLU
IPFixed NetworkISDN S0, S2m
IP
Available VoIP KPIs:
The Mean Opinion Score /Perceptual Evaluation ofSpeech Quality (MOS / PESQ)
Delay
RTP Jitter
RTP Packet Loss
PSTN / ISDN
Over the air IP data services offer
subscribers a highly flexible way to
connect to a rich world of internet based
services like Email, Instant Messaging,
websites, VoIP and much more.
GPRS represents the first step towards
a faster access provided via EDGE, UMTS,
HSPA (HSDPA / HSUPA). Whilst there are
gains in flexibility the technologies need
to be supervised and maintained leading
to added costs and higher labor content.
To increase revenue and service quality
SITE offers data tests to access all
available technologies via dedicated
interfaces to reveal service performance
and functionality problems.
Do you meet your subscribers’ demands withGPRS, EDGE, UMTS and HSPA Data Services?
Service precedence
Availability and reliability
Access speed and delay
Throughput, RTD and idiosyncrasies
And much more ...
29
Available data KPIs:
GPRS attach duration
PDP context activation duration
PDP setup connect duration
PDP IP UP duration
CSD dial in duration
CSD connect assign IP duration
Download: download duration, download rate, throughput, session time
Simulation of real subscriber behaviour
Interfaces: GPRS Um, GSM Gb, EDGE,
UMTS Uu, HSDPA, HSUPA, Iu PS, CDMA2000,
Ethernet IP, DSL
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Scalable architecture: from stand-alone
system to widely distributed system
Detailed test reports
Pro-active testing
HSDPA throughput: theoretical download
maximum 7.2 Mbps; Cat. 6, 8 and 12
HSUPA throughput: theoretical upload
maximum 2.0 Mbps; Cat. 3 and 5
HTTP, FTP, SMTP, WAP
Measuring transfer rates
Roaming aspects covered
Features
SITE Test Applications
> GPRS IP (CS / PS)
SIT
E TE
ST
SYSTE
M
30
BlackBerry is today’s leading wireless
connectivity solution for a large number
of mobile professionals like enterprise
and governmental organizations
worldwide.
It allows users to stay connected with
secure and wireless access to e-mail,
corporate data, calendar and web, to
easily manage all their communication
and information from a single BlackBerry
device whenever and wherever required.
BlackBerry eliminates the hassles of dial-
up by moving mobile data to a “push”
architecture.
Especially for mobile professionals, it is
vital that the network operator provides
the highest levels of quality and reliability.
BlackBerry, your network’s sweetest fruit?
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, UMTS Uu, HSDPA,
HSUPA, TCP/ IP
Real End-to-End testing of BlackBerry
‘push’ service
Testing carried out using a commercial
BlackBerry device
Check sending and receiving e-mails
Check the BlackBerry device integrated
email features
Using BlackBerry devices with a java application
for reflector code – for sending emails
Management notification and reporting
Features
SITE Test Applications
> BlackBerry
SIT
E TE
ST
SYSTE
M
31
QoS testing solution for BlackBerry:
Sending a message from SITE test system to a BlackBerry
device via mobile operator’s network
Important: time synchronisation for time KPIs
BlackBerry device receives e-mails from the SITE test
system per “push” from the RIM Server and it immediately
responds to the sender with a receive timestamp
SITE extracts timestamp details from the e-mail and
processes them to measurements which can give delivery
delay or success rates in both directions
Phot
o ©
T-M
obile
AG
IP Networkwith POP3, IMAPor SMTP Servers
Mobile Operator’s Network
SITE Test System
RIMServer
BlackBerrydevice
SITE e-mailTest Case
Push 1. part of e-mail
(more parts of e-mail)
e-mail [email protected]
e-mail [email protected] with timestamps
(optional)
RIM Mail Server
PLMN
BlackBerry devicewith java application
for reflector code
> BlackBerry
Available BlackBerry KPIs:
Send time
Receive time
Round trip time
Battery level of the device
Battery temperature of the device
SIT
E T
EST
SYSTE
M
32
For many users the iPhone and the 3G
iPhone opened a new era of mobile
phone interaction and services. The unique
combination of multimedia contents,
intuitive multi-touch display controls,
accelerometer and much more created
also a demand for new operator services
dedicated only for a single group of
subscribers.
Operators around the world specify this
group of iPhone users as high-tech –
high potential customers with a distinctive
technology and quality demand. The
unique services offered for this iPhone
customer base like the Visual Voice Mail
Box create additional quality process
demands at each network operator.
The Keynote SIGOS SITE System offers
dedicated iPhone tests to simply fit into
all QoS test procedures performed via
SITE without any additional effort. At the
same time measurements and KPIs
provide clear evidence of the service
availability and performance focussed on
this group of high-tech – high potential
customers.
Up to the hype with iPhone tests
Read the target address from the SMS and openconnectivity via APN to the Visual Voice Mailbox Server
Download the new message from the VisualVoice Mailbox Server to the device
Receive an SMS notification for a new message
Phot
o ©
T-M
obile
AG
executed every e.g. 15 minutes
Available iPhone Visual Voicemail KPIs:
duration
Failure Rates
SITE Test Applications
> iPhone
SIT
E T
EST
SYSTE
M
Leave a reference message on the Visual Voice Mailbox Server
Test before yourcredibility breaks down!
Wireless Application Protocol technology,
and its correct functionality are vital to
today’s mobile networks and the need
to increase the amount of data usage by
customers. To attract and maintain
customers as data users requires that
content must be interesting and up to
date, which creates risk with the constant
change of Portal structure and individual
page format.
Keynote SIGOS has designed the WAP
1.x /2.0 Test Cases to prevent the drama
of a protracted breakdown in operation
becoming reality and to indentify
unavailable pages or incorrect links,
thereby reinforcing the subscriber’s
existing trust and acceptance of WAP
services.
What about the reliabilityof your WAP services?
33
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, GSM Gb,
UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS,
CDMA2000
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Scalable architecture: from stand-alone
system to widely distributed system
Detailed test reports
Testing availability of WAP portals
Resource allocation for different users
or groups
Request pages over WAP 1.x or WAP 2.0
WML/XHTML/CSS decoding
Content check
Location based services
Throughput measurements
WTP/WSP/W-HTTP traces
Features
Available WAP KPIs:
GPRS attach duration
PDP context activation duration
PDP setup connect duration
PDP IP UP duration
WAP get duration
SITE Test Applications
> WAP
SIT
E T
EST
SYSTE
M
What about mobile Internet browsing?
34
The combination of high throughput
protocols such as WLAN, EDGE and HSDPA
along with the variety of today’s multi-
functional, big screen handsets open
many new possibilities. The network
operators need to ensure that accessing
the internet directly via http, https and
ftp via a mobile device, provides a similar
experience to the customer as their home
or office fixed network internet connection.
Response, accessibility, Throughput and
so on are major performance indicators
for monitoring the quality of service. In
addition, the SITE Web Browsing test can
access websites, fill in forms, receive
cookies, initiate secure transactions,
download contents etc.
Be sure your service is at its peak in
coping with today’s demands!
Features
Simulation of real subscriber behaviour
Interfaces: GSM /GPRS Um, GSM Gb, UMTS Uu,
HSDPA, HSUPA, EDGE, Iu PS, CDMA2000,
WLAN, Ethernet
Simulation of different browsers,
e.g. Netscape, MSIE, Mozilla Firefox
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Chains of user interaction on a web
application, e.g. a full e-commerce session
HTTP post/get request methods
HTTPS (SSL) for secure transactions
Cookie handling
Follow links both by name or URL
SITE Test Applications
> Web Browsing, IP
SIT
E T
EST
SYSTE
M
Testing Servicessuch as:
Send and Check e-mail
Send MMS and SMS over a Web Portal
Check Cookies
Limited check of HTML page content (keywords, images)
HTML parsing
35
Example: Send MMS to a non MMS compatible mobileClient (A) sends MMS to Mobile (B).
(B) receives an SMS notification with a Web Link possibly with password.
(B) starts a Web session by sending this Web Link (URL) to an operator Web Portal.
Web Portal responses and asks (B) for his authentication.
(B) sends authentication (e.g. mobile no., possibly with password).
Web Portal responses with MMS.
Available Web Browsing KPIs:
GPRS attach duration
PDP context activation duration
PDP setup connect duration
PDP IP UP duration
Web Browsing duration
> Web Browsing, IP
Client (B)
Receive legacynotification per SMS
Extract Web Link
MMS Client (A)
Send MMS
OperatorsWeb PortalMobile Web Browser
Authentication
URL response
(with html form)
URL request
Start BrowserSession
URL response (with MMS)
SITE
1.
2.
4.
6.
5.
3.
UMTS UuGSM Um
1.
2.
4.
6.
5.
3.
SIT
E T
EST
SYSTE
M
Phot
o ©
T-M
obile
AG
Business at every location, direct e-mail
and internet is today’s life. Due to this,
the number of worldwide Wireless LAN
(WLAN) access points and users is
continuously growing. Many mobile
network operators offer this type of
convenient internet access to their
customers. The existing customer SIM
card is the preferred most secure solution
for identification and authentication to
this service.
If customers discover that the service is
unreliable or inconvenient to use, they
will soon retreat. In a competitive market
it is essential to maximize quality,
reliability and usability along with the
fastest possible time to market. With
SITE WLAN it’s easy to test the availability,
the access and the performance of hot
spots in a flexible, continuous and
accurate way.
Wireless LAN for mobile operators –Test the availability and services!
36
SITE Test Applications
> WLAN
SIT
E TE
ST
SYSTE
M
Testing Servicessuch as:
Search for available WLAN networks in
the hot spot area
Entering SSID of WLAN network
Entering WEP network key
Receiving IP address via DHCP
Receiving DNS servers and default IP
gateway from the backbone IP network
Payment/Billing procedures
SITE Test System Architecture for WLANwith CU, CLU, GSM-Probe, SIM Multiplexer and the components of public networks
like hot-spots with Internet access and public terrestrial mobile network with backbone.
37
Features
Simulation of real subscriber behaviour
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Interfaces: WLAN
WLAN 802.11
SSID – Network search
WLAN authentication
Payment/Billing
Detailed test reports
Available WLAN KPIs:
Number of packets sent
Number of packets received
round trip delay
> WLAN
DHCP: Dynamic host configuration protocolDNS: Domain name systemSSID: Service Set Id
(Identifies the WLAN network to attach)WEP: Wired Equivalent Privacy
(Encryption/Security mechanism for WLAN)
SITECentral Unit
SIM Multiplexer
Access Point Server
CompactLocal Unit
HotSpot
Um, Uu Probe
WLAN Probe
PLMN
Internet
Um, Uu
LAN
WLANSIT
E T
EST
SYSTE
M
What about your streaming applications?
38
Today, almost every major event, e.g.
sport, news or society events can be
accessed via real-time multimedia streams
on a mobile phone. These multimedia
applications become more and more
important in the wireless and mobile
community.
To make sure that customers can enjoy
these new and exciting premium services,
it is most important to guarantee an
impeccable streaming service. Using the
industry standard protocols RTP and RTSP
the SITE system is up-to-date with the
latest technology. Scheduled and contin-
uous tests make sure that multimedia
streams deliver the desired contents and
the required quality even to the largest
possible groups.
Features
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu,
HSDPA, HSUPA, WLAN, EDGE, Iu PS, CDMA2000
Simulation of different browsers,
e.g. Mozilla Firefox, Netscape, MSIE
Central SIM Multiplexer: infinite
number of SIM cards can be managed
Parallel subsessions per stream,
e.g. video and audio
Send streamed multimedia over IP
TCP or UDP transport protocols
Measurement interval in multiple
of 100 milliseconds
Used industry standard RTP/RTSP
SITE Test Applications
> Streaming
SIT
E T
EST
SYSTE
M
SITE Architecture for StreamingBecause higher bandwidth rates have become available to
mobile users the use of real time multimedia applications
has grown dramatically. To ensure the mobile customer enjoys
a positive experience, the streaming data transfer has to be
tested with SITE Streaming. For the solution an RTP/RTSP
client is used to download the data (e.g. audio and video).
39
RTSP / RTPRTSP (Real Time Streaming Protocol) is a client-server
multimedia presentation control protocol, designed to address
the needs for efficient delivery of streamed multimedia over
IP networks. The actual transmission is done by the Real-
time Transport Protocol (RTP).
> Streaming
Available Streaming KPIs:
GPRS attach duration
PDP context activation duration
PDP setup connect duration
PDP IP UP duration
RTSP packets loss percent video
RTSP packets loss percent audio
RTSP packets received video
RTSP packets received audio
SIM Multiplexer
WLANAccess Point
RTSP Server
CompactLocal Unit
GSMProbe
WLAN Probe
SITECentral Unit
Test Case
GPRS
IP
Socket Interface
RTP
RTSP
UDP
LAN/DSL/WLAN
PLMN
Internet
LAN
WLAN
SIT
E T
EST
SYSTE
M
40
High quality for Video Telephony using
3G UMTS is an absolute must, without
which it is used perhaps once, and then
never again by your customers!
A high expectation regarding quality of
service is set by the mobile UMTS
subscriber, as the premium cost invoked
by use of the service will always
increase customer sensitivity. Due to
competitive pressure, It is mandatory for
wireless service providers to increase
their subscriber’s average revenue
quickly by successfully launching new
services such as video telephony. At the
same time, they must also maintain the
same stable, consistent quality their
customers have come to expect.
The implementation of this technology
often involves complex interaction
between network nodes supplied by
different manufacturers, and therefore
constant automated testing should be
applied to check initial configurations,
and then provide long term monitoring
of the service.
Do you provide reliable video telephonyin 3G UMTS?
SITE provides the solution to
easily ensure the availability of
your video telephony service,
and to maintain its efficiency
and quality.
Features
Simulation of real subscriber behaviour
Interfaces: UMTS Uu, HSDPA, HSUPA
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Real End-to-End (mobile-to-mobile)
Video Telephony
Usage of SITE’s standard 3G interfaces – no
special hardware required
Usage of standardized or customer
specific video/audio sequences
Usage of a market leading protocol stack
SITE Test Applications
> Video Telephony
SIT
E T
EST
SYSTE
M
41
Specific test case results: Detailed Error Codes from the VT stacks
VT setup time
Measurements for data quality (delays, drops)
Trace information for advanced analysis
Video telephony with SITEVideo Telephony is a key service for 3G. Mobile
VT is based on 3G-324M/H.324M protocol
stack which is the “mobile” extension of the
H.324 stack. Currently the only reliable way for
VT calls is to use a 64 kbps circuit-switched
connection to avoid delays as much as
possible. So VT is a real high performance
service for mobile networks and it is currently
only possible via 3G networks.
Phot
o ©
T-M
obile
AG
PLMN
> Video Telephony
3G UMTS Probe 3G UMTS Probe
Available Video telephony KPIs:
Video send duration
Video call duration
Video file size
H245 setup duration A
H245 setup duration B
Audio send duration
H223 setup duration A
H223 setup duration B
CS Bearer establish duration
Call Control H.324Mstack
Call ControlH.324Mstack
Test case Test case
SITE Test System
Video-codingH.263
MPEG-4
Voice CodingAMR
Control ProtocolH.245
MultimediaMultiplexing
H.223
SIT
E T
EST
SYSTE
M
42
UMTS opens a new world of possibilities
with multimedia applications. Customized
infotainment like streaming video, video
messaging, mobile TV and video
telephony offer a unique opportunity to
create a market for highly personalized
and truly inimitable mobility services.
For mobile customers the quality of
services is decisive for acceptance;
especially for motion picture based
services, quality is the key factor to
success.
SITE delivers perceptual quality measure-
ments to reproduce the subscriber’s
quality impression mapped to the mean
opinion score (MOS), similar to other
quality tests.
Be sure that your network’s new multi-
media applications are more then just
moving colour pixels.
Is your network Video Quality excellent?
Features
Simulation of real subscriber behaviour
Interfaces: UMTS Uu, HSDPA, HSUPA
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Customer specific video reference files
are easy to integrate
Real End-to-End Testing of real-time video
services (video telephony, video streaming,
video messaging)
Objective MOS Video Quality result values
from 1-5 (bad, poor, fair, good, excellent)
Many further measurements
PEVQ analysis is based on human model of
visual perception
SITE Test Applications
> Video Quality
SIT
E T
EST
SYSTE
M
43
QoS testing solution for Video Quality:
Send a video file from A-Side to B-Side. Perform
Video Quality check by playing a video reference
file from A-Side to B-Side and check the received
video signals against the reference video signals
using the standardized PEVQ algorithm.
One crucial result KPI is the objective ‘mean
opinion score’ (MOS). The scale values can be
interpreted from bad to excellent.
Phot
o ©
T-M
obile
AG
> Video Quality
=
Available KPIs e.g.:
MOS value
delays
brightness
contrast
distortion indicators
…
play Video File record
A-Side
Reference Video File
B-Side
Reference Video File
PEVQAlgorithm
Recorded Video File
Impairment GradeExcellent 5Good 4Fair 3Poor 2Bad 1
SIT
E T
EST
SYSTE
M
44
SITE solution is a powerful tool to
guarantee Service Assurance and generate
leading KPIs for operator networks. Quality
of subscriber’s experience is not only
driven by static service usage but also
by service deployment on the move.
Mobility truly represents subscribers’
experience in the network.
To cover the mobility aspect SITE offers
the capability to calculate KPIs for moving
subscribers performing end-to-end services
in addition to static subscriber probes.
These mobility tests are geared for
vehicles like taxis, trucks or trains.
Consequently they are called SITE ‘Drive
Service Tests’. Equivalent to the static
Local Units SITE collects a variety of
network measurements from moving
subscriber probes, so-called Mobile Local
Units (MLU). The information is processed
to KPIs and displayed on a brightly
coloured geographic map.
Drive Service TestingWhat’s your customers’ experience on the move?
Enhanced Service Assurance:
Independent view of end-to-end
quality for static & moving customers
Customer Experience:
Reproduce customer’s experience
on the move
Geographic View:
of your network quality – KPIs
displayed on map
Features
Autonomous System
No engineer needs to be present in the vehicle
Easy Installation and Removal
Once the MLU has been installed, no
further human interaction required
Network Optimization
Troubleshooting & optimization for new
technology networks
Benchmarking
Comparison with quality of competitors’ networks
Interfaces
All SITE air interface probes supported
Investment Protection
Compatible extension to existing SITE solution
securing current investment into Keynote
SIGOS products
SITE Test Concepts
> Drive Service Testing
SIT
E T
EST
SYSTE
M
45
Functionality of Drive Service Testing
The Mobile Local Unit (MLU) is connected to
the electronic board system of a vehicle. In case
of cars the MLU is automatically started once
the engine is started.
Fully automated test cases, even beyond the
automation grade of previous SITE System
ensure that absolutely no human interaction is
required after first installation in a vehicle and
test case set up of an MLU.
> Drive Service Testing
As no permanent IP connection between MLU
and Central Unit can be guaranteed all the time,
since there will be gaps in coverage, the
communication is realized via an e-mail server.
The MLU sends its results and receives additional
administrative commands via e-mails.
SIT
E T
EST
SYSTE
M
Clients
GPS Position
Customer’sMap Server
Central Unit
SIM Multiplexer
Static LU
Mobile LUin train
Permanent IP Connection
Non-Permanent IP Connection
Mobile LUin car
LAN/WAN
Geographic View (GIS)
46
The opportunity for mobile operators to
sell exciting new mobile content and
handsets is enormous, but the variety of
available services like MMS, Video
Streaming and Web Browsing may cause
problems when using different handsets.
How can these new devices and services
be properly tested in a cost-effective way
that ultimately leads to increased
revenue and customer satisfaction?
We can help you with a powerful
tool to test all your services, simulating
the large variety of handsets in your
network. – No labour intensive and high
cost manual testing!
Do handsets work perfectlyin your mobile network?
Features
Simulation of real subscriber behaviourCentral SIM Multiplexer: infinite numberof SIM cards can be managedInterfaces: GSM/GPRS Um, GSM Gb, UMTS Uu,HSDPA, HSUPA, EDGE, Iu PSReal End-to-End content test of available handsets on the marketValidation of received contents withmobile profiles
Database with a large collection of mobiledevices and their relevant parametersNew customer or country specific handsetscan easily be integratedSupport of many services: e.g. WAP1.x /WML,WAP2.0/XHTML, MMS, Video Streaming(e.g. Mobile TV)
SITE Test Concepts
> Handset Simulation
SIT
E T
EST
SYSTE
M
47
Handsets need to be testedSITE tests specific handset characteristics against
network services and device specific monitoring
of pages with fixed content/ URLs. The following
important content questions are validated:
Color Support
Check if device is capable of displaying colored images
Image Size
Comparison of all downloaded images with maximum height and width of the device
Content Support
Check (based on HTTP/WTP accept header) if device can decode downloaded content
Data Format
Check if the downloaded content is valid
Phot
o ©
T-M
obile
AG
SITE Test Case RecorderThis recorder is an easy tool for intuitive creation
of test cases e.g. WAP, Web Browsing or whatever
you need. It is particularly for use in handset
simulation tests. Each click on a hyperlink
creates a URL download test step and a trace
of all browser actions, like HTTP-GET-Requests,
which are shown live whilst the developer is
browsing. (See also chapter “Overview”)
> Handset Simulation
SITE Test System
LAN/WAN
via UMTS UuGSM/GPRS Um
GSM Gb, HSDPA,HSUPA, EDGE
ContentServer
WAPProxy/Gateway
MMSCSIM Multiplexer
Central Unit
Local Unit
Your benefits
Intuitive Recording of browsing actions
=> No drag ‘n’ drop anymore
Support of HTML forms
Easy creation & adaptation of browsing sessions
SITE integrated
Received page content at a glance
KPIs for each browsing action
User defined measurements / KPIs can be
added with SITE Test Case Editor
Whole session can be ‘Replayed’ during
development to evaluate the test case
SIT
E T
EST
SYSTE
M
The trace of the recorded sessionis shown live during development
SIM Box Detection –Make sure your roaming revenues are not being detoured
The fraudulent usage of SIM boxes
remains a big issue to various
network operators around the world.
The revenue leakage caused often
stays unnoticed, hence no or only
little action is taken.
SIM boxes have multiple negative effects
on operators, roaming hub providers and
customers alike, e.g.:
revenue loss due to call redirection
roaming calls are intercepted, redirected
and terminated whilst being re-conducted
via the fraudulent SIM box, creating a
cost / revenue shifting along the way
revenue loss due to service inaccessibility
SIM boxes have the negative effect that
multiple popular services, e.g. voice
mailbox, may not be available. Revenue
loss and unhappy customers is the
consequence
revenue loss through missing callbacks
due to the redirection of calls none or
wrong CLIs will be displayed at the
recipient’s side; immediate impact is the
inability to “call back” resulting in a
significant loss of roaming revenue
image loss through bad QoS
SIM boxes redirect calls over inadequate,
highly compressed IP connections,
resulting in poor voice quality. Call setup
time is extended which also leads to the
impression of an overall bad roaming
QoS of the home network operator.
SITE Test Concepts
> SIM Box Detection
SIT
E T
EST
SYSTE
M
Features
Reliable detection of SIM boxes
Preserve the revenues you are entitled to
Cost-effective concept for SIM box detection
Ensure first-class end user experience through
quick elimination of SIM boxes
Hight test density possible while avoiding
network congestions
www.keynote-sigos.com
Pho
to ©
T-M
obile
AG
49
SIM Box Detection is a fully implemented
feature. The concept follows a very cost-
effective strategy: at the first step, SIM Box
Detection tests generate results without the
necessity to establish a speech channel. This
allows a high test density without possible
network congestion. These results lay the
foundation for step two: narrowing down the
probability of SIM boxes being in operation
on certain routes by identifying suspicious
MSISDNs. Once SIM boxes have been
identified, the operator can then block these
suspicious SIMs. Trace files and additional
tools provide the option to identify the actual
SIM box location, allowing operators to fight
back on revenue.
SIM Box Detection in two steps
Situation:The A-Party at the visited country (VPMN)
calls the B-party at the home country (HPMN)
> SIM Box Detection
notOK
SIM box
Network
Network
ASubscriber
BSubscriber
ASubscriber
BSubscriber
Visited Country (VPMN)OK
Network Network
Home Country (HPMN)
Detour
Visited Country (VPMN) Home Country (HPMN)
Detour situation:The international call is intercepted and terminated by a SIM box located in your home country (HPMN). The
call is transferred to the B-party by a SIM box, e.g. transforming the original international call into a domestic
call whilst bypassing your network.
Normal situation:The call is being forwarded through an international roaming network and terminated at your home network (HPMN).
Internationalcall transfer
Internationalcall transfer
SIT
E T
EST
SYSTE
M
For all network operators Revenue
Assurance is of major importance. The
operator must provide fair and accurate
billing to the customer and also avoid
revenue leakage from services being
incorrectly rated and invoiced. In most
countries accuracy of metering and
billing is mandatory to comply with legal
regulations.
Money makes the world go round –what happens if the networks metering, rating and
billing is not correct?
50
Call Generation
CDR Comparison
Billing and Rating Verification
How to guarantee
correct billing?Today manual tests only provide
inaccurate, untrustworthy and in most
cases very expensive results. To ensure
correct billing a precise and reliable
Revenue Assurance system is essential.
With SITE scheduled, continuous testing
of all services provides maximum
assurance that all calls are being
correctly billed.
Features
Simulation of real subscriber behaviour
Interfaces: GMS/GPRS Um, GSM Gb, UMTS Uu,
HSDPA, HSUPA, CDMA2000, ISDN S0, GSM A,
ISUP, INAP
Scalable architecture: from stand-alone
system to widely distributed system
Central SIM Multiplexer: infinite number
of SIM cards can be managed
CDR generation
CDR comparison
Billing and Rating
Invoice comparison
Resource allocation for different users or groups
Detailed test reports
Revenue stream audit
Covering billing aspects of outbound roaming
SITE Test Concepts
> Revenue Assurance
SIT
E T
EST
SYSTE
M
51
Time based Calls (e.g. speech)
A NumberB NumberCall Type
Begin of call for both filesDifference of begin of callCall duration for both filesDifference of call duration
Volume based Calls (e.g. GPRS-data)
A NumberB NumberCall Type
Begin of call for both filesDifference of begin of callData Volume for both filesDifference of data volume
Event based Calls (e.g. SMS)
A NumberB NumberCall Type
Time stamp from both files
SITE generates and compares output data like:
The SITE Call Detail Record (CDR) Comparison
provides a mechanism to match MSC call
records against SITE generated CDRs. Thus, the
correctness can be verified. Discrepancies
between the MSC CDR and the corresponding
SITE KPIs are calculated. And tolerances of CDR-
pair differences can be passed or failed. Thus
an independent means of minimizing Revenue
Leakage and ensuring the end customer is
subject to a fair and legally compliant charging
process. Scenarios such as basic call, SMS etc.
are used to generate CDRs from the network
elements. These standard network CDRs are
handled by the operators Mediation, Rating and
Billing Systems.
CDR Comparison
* Customization required
Operator CDRs SITE CDRs
CDR Comparison
Filter*
CDR Import* CDR Import
(unrated)(rated/unrated)
TariffModel*
RatingBilling Verification
Live Network
Unrated CDRsRated CDRs
> Revenue Assurance – CDR Comparison
Mediation Systems
Live CDRs
Comparison Results
Reference CDRs
Reports
CDRs
CDRPostprocessing
Test Call Generation
SITE Test System
Actual Customer Usage
Billing
SITE
TariffModel
SIT
E T
EST
SYSTE
M
52
With the SITE Billing and Rating concept the
actual price of a test case scenario dependent
upon the defined customer price plan can be
generated. This allows a simple comparison to
be made with the actual bill generated by the
network’s billing system.
With this concept there are test cases for the
services like basic call, SMS, MMS, WAP and
HTTP which write their own independently
measured CDRs into a data table. The billing
job then takes these CDRs during a specified
time period, and rates them according to the
pricing plan of the specific subscriber (Tariff
Model). The calculated price for each Test Case
is then written to the rated reference CDR table.
Furthermore, the reference of the invoice total
for a given period, is calculated and returned
as a result of the billing job. Then the live
invoice total is calculated and compared with
the reference invoice. Thus SITE Invoice
comparison creates measurements indicating
the correctness or discrepancies of invoices.
SITE CDR Comparison, including the price
comparison, can be used to identify the CDRs
that cause billing discrepancies.
The trace of the billing job can be viewed with
the SITE User Interface. This trace contains on
each line the rating (price) information
generated for each of the CDRs within the
billing job. Other details include the Service
Type and the event related time stamps. The
trace also contains the invoice total for the
whole billing job.
Billing and Rating Verification
A central part of SITE Billing and Rating concept
is the implementation of the price plans. A table
driven Tariff Model is built to replicate the price
plans and billing rules of the network operator.
The tables can be easily modified later, in the
case of changes to the price plan or associated
rules.
The billing job is defined and scheduled in the
same way as normal test cases. For the
parameterization of the billing job the user has
to provide a subscriber number, a tariff name
and a time period for which the bill shall be
created.
The SITE Billing and Rating concept again
enhances the Return on Investment (ROI) for
the SITE system. Now another vitally important
department, Revenue Assurance (RA), can also
become a user of the SITE system to perform
essential checks on the billing process.
The screenshot shows an example of a trace
SITE Test Concepts
> Revenue Assurance – Billing and Rating
SIT
E T
EST
SYSTE
M
Today, subscribers expect all frequently
used mobile services to work reliably
everywhere in the world. Thus, the quality
and availability of services inside and
outside the home network becomes
increasingly important in the battle for
customers.
A large list of international roaming
agreements seems to be the key to
success.
However, most operators simply suffer
from a lack of manpower to perform all
IREG specified test sets like IR 24, 26,
27, 29, 32, 35, 50 and 60 for often well
over 200 Roaming partners.
The Keynote SIGOS distributed test
system covers the complete network
and locations, even abroad with
remote test probes and virtual SIM
card transfer.
What about your inbound roaming services?
Keynote SIGOS has facilitated IREG testing to run periodically and automatically,
using all your roaming partner SIM cards. All sets of IREG tests will generate
an ITU-T standardized report for all your roaming partners.
For Outbound Roaming see chapter “Global Roamer”
Features
Simulation of real subscriber behaviour
Interfaces: GSM/GPRS Um, GSM Gb, GSM A,
UMTS Uu, HSDPA, HSUPA, EDGE,
lu CS, lu PS, PSTN, ISDN So
Scalable architecture: from stand-alone
system to widely distributed system
Central SIM Multiplexer: infinite number
of SIM cards can be managed
Detailed IREG reports
Resource allocation for different
users or groups
Tests according: IREG 24, 26, 27, 29, 32,
35, 50, 60 from GSM MoU
Available Roaming KPIs:
Roaming – IREG
Barring: barring activation durationbarring deactivation duration
Forwarding: forwarding activation durationforwarding deactivation duration
SMS MO MT: SMS send durationSMS deliver durationSMS end-to-end duration
Basic call: call setup alert durationcall establish duration
SITE Test Concepts
> Roaming – Inbound Roaming (IREG)
53
SIT
E T
EST
SYSTE
M
54
The newly defined GRQ (Global Roaming
Quality) / IR.81 standards – developed
by the GSMA in co-operation with selected
partners like Keynote SIGOS – provides
a comprehensive framework for pro-active
testing, reactive monitoring and assurance
of end-to-end roaming services quality.
Key to a global perspective on roaming
quality is consistency of measurements
and thus comparability between home
network and visited networks, regardless
of monitoring and testing methods used.
Consistency and comparability of QoS
tests for Inbound and Outbound Roaming
With SITE and GlobalRoamer,
Keynote SIGOS covers all
specified parameters / KPIs of
IREG – IR.81 for active roaming
end-to-end testing.What are the GRQ Quality of Service Parameters?
About 40 parameters / KPIs have been identified by defining
5 stages of service usage for Voice, Data and SMS:
Network access
Service accessibility
Connection establishment
Connection sustainability
Connection quality
As an additional service Keynote SIGOS
offers special managed service packages
on GlobalRoamer. With these you can
introduce the standardized GSMA SLA
monitoring approach without administra-
tive or engineering effort on your part.
SITE Test Concepts
> Global Roaming Quality (GRQ)
SIT
E T
EST
SYSTE
M
Both mobile network operatorscan monitor and test on baseof standard parameters thatfollowed a comparison of SLAsand KPIs for QoS.
Roaming SLA
BA
RoamingQoS
Standard monitoringmethods e.g. daily, monthly
Parameters
KPIa
KPIb
KPIc
1 2 3 4
Mobile Network Operator A
RoamingQoS
Standard monitoringmethods e.g. daily, monthly
Parameters 1 2 3 4
Mobile Network Operator B
ReconciliationCompare results Problem Reporting Troubleshooting Escalation
KPIa
KPIb
KPIc
55
Iu CS / Iu PS over IPfor testing circuit and packet switchedcore network components (e.g. MSC and SGSN)
MAPHLR and VLR Test Suite, specified byKeynote SIGOS
IN/CAMEL TESTSfor SSP and SCP on CAP or INAP
SS7for SCCP, TCAP and ISUP
ISUP INTERCONNECTION, CONFORMANCEITU-T Q.784 & Q.788ETSI ETS 300 356-31/32/33 Basic CallsETSI ETS 300 356-34/35/36 Suppl. Services
GSM – Gbfor testing core network components of GPRSpacket domain (e.g. SGSN)
GSM – A (BSSAP)for testing of MSCs
SITE Protocol Test
SITE Protocol Test
SITE is a flexible solution, which offers an
extensive library of available test cases, that
fit with the majority of services defined in the
mobile network standards and popular
implementations of other additional network
features. These tests enable operators to test
the End-to-End functionality of their network.
However, it may be necessary for a network
operator to examine the detailed signalling
protocols that support their services, or
implement a non-standard interconnection
between internal network nodes or external
network operators.
Core Network TestingKeynote SIGOS offers core network protocol
tests on various core network interfaces in GSM,
GPRS, UMTS and IN environments which are
available with the SITE test system.
Protocol tests are needed to analyse the
network’s behaviour in detail and to reach a
high degree of interoperability between networks
and network components. Keynote SIGOS
engineers have developed test applications on
SITE and have supported various network
operators and vendors with its integration tests.
Layer 3 TraceKeynote SIGOS offers 3G Layer 3 tracing which
is very important for core network testing. The
primary goal is to get a deeper insight into the
message flow and the protocol data exchanged
between mobile station and network. On most
Qualcomm-based 3G probes traces of the Layer
3 (NAS) signalling messages exchanged are
recorded.
Keynote SIGOS supplements the 3G Layer 3
NAS tracing with selectively recorded information
from Radio Resource Control (RRC) signalling
messages, employing appropriate protocol
filtering techniques.
SIT
E T
EST
SYSTE
M
Improve your IN / CAMEL test strategy!
Keynote SIGOS offers you a fully
automated IN / CAMEL test system for
preparing your own network
for Camel roaming requirements
End-to-End testing with real
roaming partners
preparing your IN platform (SSP, SCP)
CAMEL is the keyword for
intelligent service roaming
within GSM, GPRS and
UMTS networks.
For the differentiation of mobile market
competitors the IN services play a major
role. Above all, the customers demand a
roaming capability that functions exactly
as it would in the home environment.
With most networks having a majority of
Prepaid customers, and the special billing
requirements and checks that must be
made by the home network, the testing
of CAMEL is an essential requirement for
the mobile operator.
56
Your benefits
Reduction of testing effort for IN/CAMEL tests
Preparation of the own network components
for inbound and outbound roaming
(SCP and SSP with high quality)
Simulation of the complete foreign
PLMN at CAP, INAP, MAP, ISUP for inbound
and outbound roaming
Full test system control for simulation
of end-user behaviour at Um
No real roaming partner’s network required
Excluding protocol problems before
End-to-End tests
Automated re-execution for regression tests
Fully automated IR.32 tests
SITE Protocol Testing
> IN / CAMEL
SIT
E T
EST
SYSTE
M
Testing of IN/CAMEL in the UMTS-GSM-ISDN network environment
The introduction of IN or CAMEL based services
affects various interfaces of the network. In
order to reduce the implementation risks of
services, all involved components have to be
tested on the related internal interfaces of the
network. For this kind of core network protocol
tests, the simulation of several components is
necessary.
The figure below points out which interfaces
and network components should be tested for
introducing IN or CAMEL services.
According to the network architecture Keynote
SIGOS has developed test scenarios for tests
on all relevant interfaces adjacent to the
GSM/GPRS/ISDN core networks. These kind of
tests allow the vendor or network provider to
test either single network components or their
own network without any real connection to
other networks.
The SITE Test System offers simulation and tests
of IN/CAMEL on the interfaces UMTS Uu,
GSM/GPRS Um, ISDN S0, ISDN ISUP, GSM MAP
(3), GSM A, GSM Gb, CAP and INAP.
57
Test interfaces
Core network protocoltests with SITE
Um
MAP
CAP
MAP
ISUP
ISDN S0a/b
ISUP CAP INAPGSM A
MAP
MAP
GSM Gb
A orISUP Gb
CSE /SCP
INAP
MSC/SSPSGSN/SSP
MSC/SSP
CAPHLR
Fixed Network
SGSN/SSP
A orISUP
Test System SITE IN/CAMEL
Gb
> IN / CAMEL
SIT
E T
EST
SYSTE
M
58
GlobalRoamer – the easiest way to solveyour Roaming Test needs
Test the service availability and performance for
your customers when they roam to other networks
The ChallengeCustomers demand and expect a high
quality and reliable service from their
chosen network operator and a similar
seamless experience regardless of where
they are currently in the world.
By introducing new technologies and
services like Streaming, Video
Telephony, UMTS and HSDPA, networks
become more and more complex,
interference-prone and increasingly
complicated to administer.
Permanent surveillance of roaming
networks is indispensable but inevitably
extremely complicated due to the lack
of operational visibility of the roaming
partners networks.
Centralized SIM Multiplexing technologymakes your SIMs travel the world!All services can be tested (speech, data,messaging...)Web-based, secure and convenientuser interfaceDaily e-mail reportsFlexible scheduling of test campaigns(once only, periodically)
Daily /weekly/monthly reporting –graphical displayAutomated alarming based on yourthreshold settingsCDRs, KPIs and traces for billing andtroubleshooting
Features
GlobalRoamer
> Outbound Roaming
Glo
bal
Roa
mer
The SolutionGlobalRoamer allows you to verify that all
services are available to your roaming customers
worldwide. By means of the Keynote SIGOS SIM
Multiplexing technology your SIMs are capable
of being virtually transmitted to any of our
extensive global network of remote test stations
where the actual testing is performed.
Tests can be generated on an individual
immediate ad-hoc basis, or as a fully automated
group of tests via the flexible test case scheduler.
Sophisticated reporting facilities enable the
visualization of the results, which can be
generated at any required time or sent
periodically via email reporting.
59
All you have to do is:
Send your test SIM cards to Keynote SIGOS!
Access the worldwide test network via the internet!
Define and start tests and collect the results!
> Outbound Roaming
Increased roaming revenue due to betterservice availability and performanceIncreased Roaming Customer SatisfactionNo CAPEXReduce your mean-time-to-repair inidentifying/resolving problems24 hour testing possibleFull worldwide control of Roaming tests soRoaming partners’ support is not needed
Test of new roaming services beforecommercial launchComplete overview of outbound Roamingperformance at any timeReduced costs for manual testing
Benefits
Glo
bal
Roam
er
SIM Multiplexer
60
Ad-Hoc testing and pro-active monitoring
in one combined solution!
GlobalRoamer provides a very powerful test
environment for network or service engineers:
Secure web-based, ad-hoc and periodic
testing environment
Ultimate flexibility in terms of parameter
setting and SIM card selection
Extensive library of predefined test cases,
easily adaptable
Targeted troubleshooting and detailed analysis
based on call traces and CDRs
GlobalRoamer provides automated,
pro-active testing of roaming services:
Pro-active monitoring assures optimal
service for your outbound roamers
Continuous network surveillance with
graphical reports
Predefined management reports based on
the most important KPIs
Ultimate flexibility in report generation and
threshold setting
Tailored service view sorted by geography,
operator and service
Automated e-mail alarms directly to the
technical engineer
Automated e-mail reports
GlobalRoamer
> Outbound Roaming
Glo
bal
Roam
er
SMS, MMS, WAP, GPRS, UMTS, HSPA, Voice & Video Quality, CLI
delivery, CF to mailbox, Prepaid CAMEL, USSD call back, PLMN selection
The GlobalRoamer deployment is ongoing with new locations added continuously.
Please contact us for the current installation base!
Worldwide testingToday you can already test over 250 mobile networks worldwide in more than 90 countries.
Currently covered are the following countries:
AfghanistanAlgeriaAngolaArgentinaAustraliaAustriaBahamasBahrainBangladeshBarbadosBelarusBelgiumBermudaBosnia andHerzegovinaBrazilBruneiBulgariaCambodiaCanada
Cape VerdeChileChinaColombiaCook IslandsCosta RicaCroatiaCyprusCzech RepublicDenmarkDom. RepublicEgyptEstoniaFiji IslandsFinlandFranceGermanyGreeceHong KongHungary
IcelandIndia IndonesiaIrelandIsraelItalyJamaicaJapanJordanKoreaLa ReunionLebanonLichtensteinLithuaniaLuxembourgMacedoniaMadagascarMalaysiaMauritaniaMexico
MoroccoNetherlandsNew ZealandNigeriaNorwayPakistanPanamaPeruPhilippinesPolandPortugalRomaniaRussiaSaudi ArabiaSerbiaSingaporeSlovakiaSloveniaSouth AfricaSpain
Sri LankaSwedenSwitzerlandTaiwanTajikistanThailandTunisiaTurkeyTurkmenistanTurks andCaicos IslandsUKUkraineUnited ArabEmiratesUSAUzbekistanVenezuelaVietnam
Who benefits from GlobalRoamer?There are several departments which will benefit from GlobalRoamer.
Keynote SIGOS helps to solve questions!
Over 250 networks can be tested today
Management:
How to increase and protect highly profitable
roaming revenue whilst improving quality for
premium customers?
Network operations:
How to keep expected roaming services
working to expectation whilst CAPEX budget
is being squeezed?
Core network and service engineering:
How to ensure new roaming services work at
launch?
Service quality:
How to measure the actual experience of
highest value roaming customers?
Customer Care:
How to troubleshoot roaming problems
in real-time?
Revenue assurance:
How to verify that the TAP files from roaming
partners are correct?
61
> Outbound Roaming
Glo
bal
Roam
er
62
Gerrit Raymakers(Vodafone NL)
“…The biggest profit we yield by using
GlobalRoamer is the improvement of our GPRS
roaming service. By testing this service on a
daily basis we were able to notice disturbances
prior to customer complaints being reported.
Before we had GlobalRoamer, these tests had
to be done manually; in other words we had
to contact other operators and ask them to
perform these tests. This proved to be very
time-consuming and the frequency of these
tests were at a much lower rate than with
GlobalRoamer.
[…] Our experience has taught us that network
changes can lead to serious roaming problems
and, of course, you want to detect these as
soon as possible in order that the customers
are less inconvenienced.
To summarize, we can say that we are
enthusiastic about GlobalRoamer. It has helped
us in several cases to detect network errors
and because we were able to identify those
errors at an early stage we were able to
decrease the resolve time.”
Ilse De Kee (Base Belgium)
“Using GlobalRoamer, we realized that the
success rate of our CAMEL calls was only
around 50%! Additional to that, we then
realized that another 50% of the successful
tests weren’t billed! Thanks to GlobalRoamer,
we could detect this and immediately take the
respective actions.”
Kjartan Briem(OG Vodafone Iceland)
“The chart demonstrates how we could
decrease the amount of Roaming errors.
This improvement was a combination of three
actions: the automatic roaming testing with
the GlobalRoamer service, a new international
carrier connection and the ASR measurements
on international links.”
What our customers say
Registered roaming problems
Num
ber of
pro
blem
sJu
l
Aug
Sep
Oct
Nov Dec Jan
Feb
Mar
Apr
May Jun Jul
Aug
Sep
Oct
Nov
GlobalRoamer
> Outbound Roaming
Glo
bal
Roam
er
In the liberalized and highly innovative and fast paced
telecommunications market, new products and services
are introduced at very short notice. This means that
complex processes have to be constantly adjusted,
thus generating a need for testing and quality
measurement with independent, reliable and trustworthy
solutions.
The introduction of new services, especially in respect
of being on time and budget, depends on the efficiency
of testing and the availability of appropriate service
quality management tools.
Professional ServicesWe at Keynote SIGOS are striving to support our
customers in each and every phase of their testing
requirements. Under the umbrella of “Keynote SIGOS
Professional Services” we provide a focussed collection
of support and consulting services.
project implementation
training
maintenance
system hosting
managed services
solution consulting
Professional Services –for an error-free network!
63
Professional Services
> Your Needs – Our Services
Pro
fess
ional
Ser
vice
s
Maintenance contracts offer support through
multiple channels: hotline support, on-site
or remote support. Of course, maintenance
of hard- and software components is
included as well.
Training on our solutions can be provided
either on site or at our headquarters in
Germany, and can be supplemented by
web-aided meetings. We offer training
tailored to users or administrators or we
develop specific training schedules
according to your requirements.
64
System Hosting refers to our world-wide
roaming test infrastructure GlobalRoamer.
Customers gain access to this extensive
and comprehensive network for roaming
testing and do not need to worry about a
thing.
During Project Implementation we assist
you in determining the best possible
solution for your requirements. With our
expertise gained over two decades in the
implementation of large-scale as well as
niche projects we will help you find the
optimal solution for efficient and successful
project realization.
Professional Services
> Your Needs – Our Services
Pro
fess
ional
Ser
vice
s
Professional Services
ProjectImplementation
(SITE)
MaintenanceContract(SITE)
Hosted System(GlobalRoamer)
TrainingManagedServices
SolutionConsulting
With different levels of Managed Services
packages we take further load off our
customers’ shoulders: let Keynote SIGOS
manage the operation and / or administra-
tion of your tests. This can be either on a
project basis on special occasions, e. g.
Olympic Games, or as part of your supply
chain on a long-term basis.
Our experts are available for Solution
Consulting at any stage of your project.
From systems integration to project
management to development of test
concepts and coaching during and after
project implementation. You can always
rely on our expertise.
65
> Your Needs – Our Services
Test Specification and DevelopmentNetwork Component Tests (Protocol Tests)
SIM Tests and Tests for SIM Toolkit Applications
Service Tests (End-to-End Service)
Mobile Phone Type Approval Tests (2G, 3G)
TTCN Specification & Validation
SW Development
Service Development
(specifications and reviews)
System and Network Integration
• UMTS – Network Integration and
Interoperability GSM-UMTS
• Interconnection (fixed, wireless)
Outsourced Test Services for:
• Acceptance Tests for Networks
• Type Approval Tests for Mobiles
(GSM, GPRS, UMTS)
• Network Launch Tests
• Service Tests (GSM, GPRS, UMTS, IN, IP)
• International Roaming Tests
• Billing Tests (fixed, wireless network)
Engineering Services
Senior Consulting Services
Standardisation (ETSI, ITU-T)
Test Strategies
Process Optimisation
Network Management & Network Optimising
Project Management
Pro
fess
ional
Ser
vice
s
�6�� ���
�6�� ���
�6�� ���
�,��� ����,����
;%# ��
;,����
=�%��,
=����
=,%� ��
��� ��
�7��&��6�
��� ��
������
�(�$�
�6�� ���
;�������
� � )
�&�%�
� � �, �
��,�, �
�";
)�!%������(!%�� �����
�6�� ���
�6�� ���
-��% �)
-� ���
�� ��
�����
$,�� ��
���% �)
9������
���������#���������!
�6�� ���
� �7 ��
��& )
�,����
�6�� ���
;7��# �I �
= &� ��
=,���� - ��
�����=� 77 :�%%�
�� ��� �����6��'�����
���6�
#��
!���
!,� ��
9 % ��
9 ,��� ��
+����
+�����
� %������
" ,)�;� #�
"���� 8����
"�,�&;'���
& �
�6�� ��� �6�� ���
;���% �6�� ���
��
�,��� ���
�6�� ���
������������
���% �)
�� %�
! 7 �&�� �
8,3� #,��
9 ��)���
9 %�
+��&��% �)�
����,� %
�� ��
�,���
"��#�
"%�: ��
"%�:���
"6 ��
9 ) � �� �
�;�
�� �)
< #�
�6�� ���
;'�& ���� �
= ��% )��&
� #�)�
�&��
$�������
��)�
��)�����
9 % ���
� ���� �
"��� 6���
"��8 ��
� �� �
�& �% �)
>����
+��<� % �)
;,��� %�
�6�� ��� �6�� ���
�6�� ���
�6�� ��� �6�� ���
�6�� ���
"���7��% �)
�,����
�!
��� ���
��
�������������
!������"��" #$!%�����&�'��� ���(�)��*��+,�� #����� ��
-��.*�/�0����(�12��- 3.*�/�0����(�12�4((��'�5����������������
��������������������