Date post: | 08-Dec-2015 |
Category: |
Documents |
Upload: | andra-gabriela |
View: | 217 times |
Download: | 0 times |
5 Secrets to a Successful Mobile Application Testing Strategy
25th Jun 2014
Ajay Balamurugadas / Sundaresan Krishnaswami
www.maas360.com
Today’s Agenda
• 5 key elements of a robust test repository
• Addressing Android testing pain points
• Android vs iOS: Do you change your
testing strategy?
• Best practices for cross platform testing
• Building the tacit knowledge in testing
teams
• Q & A
#MaaS360test
Poll Question #1:
• What are your prime challenges in mobile
application testing?
a. Device/Brand level fragmentation
b. API level fragmentation
c. Inconsistent UI and UX
d. Lack of test devices
e. Lack of knowledge of mobile application testing techniques
f. All of the above
#MaaS360test
Resources For a Robust Test Repository
Credits: http://thetesteye.com/posters/TheTestEye_SoftwareQualityCharacteristics.pdf
#MaaS360test
Poll Question #2:
• Does your organization suffer from Android
fragmentation?
a. Yes
b. No
c. Somewhat
#MaaS360test
Secret #2: Addressing Android Fragmentation
Key Challenges:
• Many devices to test
• Several different form factors
• Different operating system flavors
• Application backward compatibility
• App architecture
• API compatibility
• Hardware integration
#MaaS360test
Android Fragmentation: How Do We Tackle It?
• Normalize the device for performance, latest OS, most used
• Listen to your users – Google Play, forums,etc.
• Application layout for different screen dimensions
• API behavior
• Mobile app functionality for different device hardware
• Follow AQuA best practices while building and testing apps
– http://www.appqualityalliance.org/
#MaaS360test
Secret #3: Android vs iOS: Do you Change Your Testing Strategy? • What type of app is this: hybrid or native?
– Hybrid apps
• Most hybrid apps are built for the browser
• You can start testing from a browser on your desktop
– Native apps
• Build a traceability matrix for your functionalities
• Identify key operating system differences
• Build your foundation (testing techniques)
• Build a Mobile testing ready reckoner
• Analyze & identify the tools you would require – Android Debug Bridge, iPhone Configuration Utility, Log collectors
• Understand the OS specific design guidelines and test for them – Example: Gestures for different screens
#MaaS360test
Secret #4: Best Good Practices for Cross Platform Testing • Device Settings
– Understand the device settings on each platform
– What is unique to each of the platforms
• Consistency heuristics – Do a side by side comparison of two devices – one platform each
– Note the differences and report them
• Test, Learn, Test Approach – Test on one platform, understand the feature, test on another later
• Compare and contrast approach – Use a mind map or simple checklist
– Have a cross-platform team test together
• Stop worrying about cross-platform much
#MaaS360test
Poll Question #3:
• If your organization were to conduct an
assessment test on your testing team or
yourself, will the score be 75% and above?
a. Yes
b. No
c. May be
#MaaS360test
• Bug blitz
• Dogfooding those apps
• Internal competitions
• Training sessions
• Virtual conferences
Secret #5: Tips to Build Tacit Knowledge in Testing Teams
#MaaS360test
MaaS360 App Works Because…
• Use case based approach – Why do we need this feature?
– Write complete end to end scenarios, stories
– Checklist of previous field issues
• Test on real devices (and not emulators)
• Bring Your Own Device (BYOD) to test
• Listen to users – App reviews on Google Play, App store, etc.
– Connect with users on app forums
• Bug blitz and internal contests – Other people’s views
#MaaS360test
MaaS360 App Works Because…
• Continuous learning – Testing feeds on Ministry of Testing
– Learn from platform-centric conferences like WWDC and Google I/O
– In-house workshops and hands-on training
– Field issue analysis
– Analytics based learning
#MaaS360test
MaaS360 App Security Test Checklist
1. Safeguard app data via secure containers
2. Data encryption – Database, passwords, payloads
3. Network communication – HTTPs URLs, MITM attacks
4. Inter-app communication – Certificate based trust, web-service based trust
5. Privacy and permissions – Respect user privacy, logging sensitive information, obtain only required
permissions
#MaaS360test
Mobile Application Testing: Ready Reckoner
• Test for app behavior in the cloud and secure wipe conditions
• Test for secure app data communications and platform specific design guidelines
• Test for app store pre-submission guidelines
• Test with your own ready reckoner; share it
• Test, test and test for more positive ratings on the app store
• Read the book: Tap into Mobile Application Testing by Johnathan Kohl for enhancing your testing skills
#MaaS360test
Connect with the MaaS360 Community
• Past Webinars (http://www.maas360.com/maasters/webinars)
– Building Secure Mobile Applications Using MaaS360 SDK and IBM Worklight
– Android 4.3 and Windows 8.1 -The Next Milestones in Mobile Device Management & BYOD
– Achieve Enterprise Mobile Security with MaaS360 MDM and Dual Persona
– The Evolution of BYOD - Are You Set-Up for Success?
• Plus lots of How-To content in our Resources section
– The Ten Commandments of Bring Your Own Device (BYOD) • http://links.maas360.com/tenCommandments
– Does Android Dream of Enterprise Adoption? • https://links.maas360.com/doesAndroidDream
#MaaS360test
Get Started Today!
Set-up
Get access to a
free, fully
functional trial
for 30 days
Manage
Start managing,
securing, and
supporting devices,
apps, and docs
Provision
Instantly enroll
and configure
your mobile
devices
#MaaS360test