www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

W:47pt W:47pt

CASE STUDY

Testing Web Services Helps Leading Software Company Reduce Browser Consumption of Data by 89%

CCS-UK002-1215

The Client is a Norwegian software company, known for its family of web browsers with over 350 million users worldwide.

About the Client

www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

Key Requirements

Conduct comparative analysis of performance metrics for CPU usage, battery performance, and memory usage across multiple Android devices and different browsers in various network scenarios.

Benchmark mobile performance to capture page load times and measure data download sizes for Google, Facebook, YouTube, Wikipedia, and Yahoo on various browsers including Opera, Opera Mini, Firefox, Chrome, Dolphin, UC 9.8, UC Mini and Maxthon using multiple mobile devices.

Key Business Challenges

Diverse set of testing conditions involving 6 different websites for multiple devices and browsers.

Lack of a clear set of identified performance metrics or parameters in the beginning of the project such as data usage, battery performance or the CPU usage.

Technical Challenges: Due to apps being in production, there was no control on the Test Data set, and test scripts had to be monitored and tweaked each day. Identifying the right mobile device for benchmarking requirements was a huge task in itself.

Continuous usage and data traffic consumption by devices under test resulted in the devices throwing exception errors, decreased the in clock-speed, and slowed down the performance of the device. Even the Opera Mini Browser was not able to render HTML5/Flash pages.

Types of Testing Performed comprehensive end-to-end Mobile Battery Performance Testing, Mobile Performance Benchmarking, and Mobile Functional Testing on 5 devices using the latest available Android OS versions.

The Client was launching a new version of its browser and wanted to analyse and improve its browser performance across multiple operating systems for different devices in varied sets of geographical and network scenarios. They wanted to:

The complexity arose due to the possibility of multiple combinations of different scenarios and lack of clearly defined set of performance metrics at the beginning of the project. Some key challenges included:

Testing Tools The testing was executed using Watchdog Lite, Data Monitor, Memory filler, Battery monitoring and Battery watch tool, Hyperterminal Tool, CPU utility tools, Experitest, SeeTest, TestNG framework, and System Info.

www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

Solutions ProvidedCigniti conducted a tool feasibility; recommended, and approved the identified mobile testing tool, and tailored its performance test methodologies to suit the Opera context & requirements.

Cigniti reconfigured its internal Mobile Test Lab with identified devices, OS, and network carrier.

Some unique out of box things were implemented to have the optimum setup, such as the session time was cut down from a single 3 hour session to 6 sessions of 30 minutes each to replicate the best user behavior; best practices for mobile testing were implemented and adopted in order to avoid device slow down, such as shutting down the device while charging.

Key BenefitsAs a result of tests performed by Cigniti, it was established that:

The rigorous development and execution of test scripts for 20,000 iterations ensured an ideal average page load time covering multiple scenarios.

As a value add, Cigniti also provided client-side front-end page recommendations using 3rd party tools like YSlow and Dynatrace – AJAX edition.

The client browser, on an average, consumed 89% less data as compared to other browsers. The client browser provided 26% more battery life as compared to other browsers.

Cigniti Technologies Limited (BSE: 534758, www.cigniti.com), Global Leaders in Independent Software Testing (IST) Services, is headquartered at Hyderabad, India. Cigniti’s 1800+ career testers are spread across US, UK, India, Australia, and Canada. Cigniti is the world’s first IST Services Company to be appraised at CMMI-SVC v1.3, Maturity Level 5, and is also ISO 9001:2008 & ISO 27001:2013 certified. Cigniti’s test offerings include Quality Engineering, Advisory & Transformation, Next Generation Testing, and Core Testing. Over the last decade, Cigniti has helped Enterprises and ISVs build quality software while improving time-to-market and reducing cost of quality. Cigniti has translated its R&D into SMART Tools™ that accelerate testing and help improve the quality of services delivered to clients. Cigniti has India's first of its kind Robotics Test Lab, a Mobile Cloud Test Lab with HP & Experitest, a Cloud-enabled Performance Test Lab, and an IoT & Smart Meter Lab. Gartner has positioned Cigniti as a Challenger in its Magic Quadrant for Application Testing Services Worldwide, 2015. Forrester cites Cigniti among the 9 services firms and systems integrators working to enable Quality at Speed. NelsonHall ranks Cigniti Technologies as a Leader in Software Testing NEAT Charts. Everest Group recognizes Cigniti as a Major Contender with a “Best in Class” rating for Buyer satisfaction in the PEAK Matrix™ for Independent Testing Services, while Forbes recognizes Cigniti as Asia’s 200 best under-billion companies. Cigniti has been awarded a place on the Crown Commercial Service latest G-Cloud 6 framework for providing Lot 4: Specialist Cloud Services that will provide public sector enterprises better access to Cigniti's expertise. Cigniti is also a recipient of the prestigious Frost and Sullivan Customer Value Leadership Award for Global Automated Software Testing Services category consecutively in 2014 and 2015. Cigniti’s CSR initiative, Project Cignificance, aims to impact 1 million+ lives through education as an enabler.

About Cigniti

www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

Global Leaders in Independent Software Testing Services

USCigniti Inc.

433 E Las Colinas Blvd,

Suite 1300,

Irving, TX 75039

972.756.0622

IndiaCigniti Technologies Ltd.

6th Floor, ORION Block, “The V” (Ascendas)

Plot #17 Software Units Layout

Madhapur, Hyderabad-500081

040-4038 2255

040-3070 2255

AustraliaCigniti Technologies (Australia) Pty Ltd

Sydney

Level 13, 135 King Street

Sydney, NSW 2000

+61 2 8973 7579

Canberra

Tower A, Level 5, 7 London Circuit

Canberra, ACT, 2601

+61 2 6169 4145

UKCigniti Technologies (UK) Limited

9 Devonshire Square

London

EC2M 4YF

+44 (0)20 36911385

CanadaCigniti Inc

2425 Matheson Boulevard East,

7th floor, Suite 731

Mississauga, Ontario

L4W 5K4

647.951.5943

Melbourne

Level 28, 303 Collins Street

Melbourne, VIC 3000

+61 3 9678 9111

For Other Informationinfo@cigniti.com

facebook.com/cignititechnologies

linkedin.com/company/cigniti-inc

youtube.com/cignititechnologies

slideshare.net/cigniti cigniti.com/blog

twitter.com/cigniti