Date post: | 13-Jan-2015 |
Category: |
Technology |
Upload: | einfochips |
View: | 394 times |
Download: | 0 times |
AQuA TestBorgA Software Cyborg for Automated Quality Assurance
Android Trends
Test Automation Tools Landscape
Comparative Analysis
Typical Challenges vs. Possible Solution
AQuA TestBorg as A Solution
Success Stories
Agenda
2
Android Trends
Behind the 'Internet of Things' Is Android—and It's Everywhere
Android not limited to Smartphones and Tablets resulting in - Complex interactions between connected devices and smart sensors
- Highly customized Android for specific tasks
- Stringent performance requirements
Complex and Time Consuming QA 3
Test Automation Tools Landscape
Cloud based Application Testing
User Interface Testing
Functional Testing In-car Navigation
Home Automation In-flight Entertainment
Office Automation
System & Solution Validation
Compliance Test Suite (CTS)
Performance Testing
Functional Testing
Target Market
4
Comparative Analysis
5
Typical Android QA Challenges
Device and OS Fragmentation
Limited Market Window
Cost Performance Pressures
Complexity / Reliability
6
Challenge: Device and OS fragmentation
Critical Challenges
• Migrating to newer OS versions (every 6 months)
• Ensure backward compatibility
• Compliance Test Suite (CTS) for Device & Application
• 399 Devices required to achieve 90% app test coverage
A Probable Solution CTS support for latest Android versions
Re-usable test assets across OS versions / Devices
7
Challenge: Limited Market Window
Critical Challenges
• QA and testing gates an early product release
• Manual testing is time consuming
• Exhaustive efforts in resolving identified bugs during QA cycle
A Probable Solution Parallel Remote Testing on multiple devices
In-built analytics that can help debug bugs faster
8
Challenge: Price Performance Pressures
Critical Challenges
• Intense competition
• Long QA cycles without automation
• Additional efforts to implement
automation
A Probable Solution Scriptless automation
Re-usable automation scripts across OS/Devices
Screen Replication
9
Challenge: Complexity / Reliability
Critical Challenges
• Highly customized Android stack for embedded device
• Stringent performance requirements
• Complex M2M and user interactions
A Probable Solution Automate and validate M2M interactions
Stress testing to ensure reliability
10
AQuA TestBorg, The eInfochips Solution
11
Unified Platform End to end solution testing covering real-life user scenarios
Execution Intelligence, Batch Testing Automated regression across scalable distributed test environment for faster time to market
Scriptless Test Automation Intelligent record and playback enabling 35% effort reduction
Device Agnostic Test Automation Record on one device and run across device / screen / OS
Comprehensive System Validation Pre-integrated Compliance Test Automation, Performance and benchmarking test assets
Insightful Reporting In-built analytics to shorten debug cycle by 25%
Extensive Integration Options Integration with existing ALM, Test Management, Build Integration Management
11
12
Success Story : Video Conferencing Device
User Interface and Functional Test Automation of Android based Video Conferencing Device
Challenges
• 1000+ manual test cases for• Validation for external events from Web interface• Testing the cross interaction of the applications on the device.• Automating of testcases which interacts between two devices.
Example: Calling from one device & receiving call from another device.
AQA as A Solution
• Overnight regressions on multiple devices to accelerate QA cycle• Web Automation integration to validate interaction between
device and web interface • Ability to test interaction between two conferencing devices in a
single testcase to achieve better coverage
Benefits Achieved 61% test automation, reducing the QA effort by 40%
13
Success Story : In-Flight Entertainment Manufacturer Challenges
• Android ICS based, handheld device for IFE with multiple native applications• Multiple variants for different aircrafts, resulting into complex test beds• Remote testing of devices in aircrafts and manual efforts in collecting data
AQA as A Solution
• Automated Rack Testing using AQA • Remote and parallel CTS testing consisting 21,000 Test cases • Automated result updates and report generation of test run • Comparison Reports across builds and variants • In-built Analytics for faster debug of the failed testcases • Consolidated reports and graphs via test management feature of AQA for better tracking
Benefits• QA Cycle time reduction by ~28%• Effort reduction by 45%
LAN2
LAN1
AQA Test Suite
Thank you
14
For more information and AQuA TestBorg Demo, write us at [email protected] or visit www.einfochips.com