Marketing Update

Make Continuous Delivery for Mobile Applications a RealityDan McFall Vice President of Mobility Solutions

1

AgendaCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Disclaimer on Manual TestingWe LOVE manual testing and it WILL NOT go away.Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

About Continuous Delivery

DevOps(development + operations) * (design,build,support)Dev = coders, testersOps = systems engineers, DBAs, network engineers, security team (infrastructure to make app successful)Attempts to un-silo development and implementationLast falls to be eradicated on the waterfall river Ops takes up Scrum, AgileInfrastructure elements may be configurable, versionable (CPU, memory, bandwidth, etc.)Configuration specified, and mounted as part of development and QA in cooperationNo surprises when its doneBackend services virtualized to promote parallel development

Continuous Delivery DefinitionContinuous delivery(CD) is asoftware engineeringapproach in which teams produce software in short cycles, ensuring that the software can be reliably released at any time.[1]It aims at building, testing, and releasing software faster and more frequently. The approach helps reduce the cost, time, and risk of delivering changes by allowing for more incremental updates to applications in production. A straightforward and repeatable deployment process is important for continuous delivery.Source: WikipediaCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Continuous [Insert Name] Tools

The goal: continuous deploymentReduce IT deployment riskEliminate it worked on my system scenariosBreak silos among developers, testers, release managers, operationsPredict and make visibleFocus on business outcomesPuppet Labs: high-performingIT groups experience 60 timesfewer bugs andMTTR 168 times faster

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

The Difference Between the CDs

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Why do I care about it?

All Mobile Indicators Are Still GreenBy 2013, 6B of the worlds 7B people had cell phones; 4.5B had toilets91 Per cent of US population owns a cell phone61 per cent smartphonesWorldwide, 33 per cent are smartphonesThere are more phones and tablets than peopleICD estimated 72.1M wearables in 2015 + 173%Gartner predicts 26B connected IoT objects by 20201B smartphone sales = 2x that of PCs

University of AlabamaCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

In 2014, mobile passed desktop for most time spent on the internetSmartphones spreading faster than any technology in history1More mobile-only users than desktop-only users in 2015Mobile use additive to desktop overall2In May, 2015, Google reported more searches on mobile web than desktopin 10 countries including US and Japan

1MIT Technology Review2 Wall Street Journal

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

$0.28 per app downloadUniversity of Alabama

Apple, Google App Stores Are StrongCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Key FactorsMobility still gaining momentumBut the bulk of enterprises havent really got startedEnterprise is app/web that represents the business to customers, partners, employeesEnterprise is not Apple, Google, Uber, Crossy-Road, Netflix, Hulu (app is the business)For enterprise, the current mobile ecosystem is too hard to useCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

What Are The Challenges?Checkout, debug on real devicesMake DevOps real in mobility (so far, not so much)Google, et al talk about 100s to 1000s of deployments a day in webManage consumerized, automated mobile release cyclesAutomate deploymentManage UX testingFully automate regression testing, incremental change managementIncorporate APM, platform identity, and reliability experience into the decision processMeasure whos doing what with apps/webpagesCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Continuous testing is the most difficult part of the application lifecycle process but can yield the highest returns in terms of user time and perceived application stability- IBMCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.Continuous Testing is The Hard Part

Mobile DevOps AutomationTwo questions:Are we ready?Are we still ready?Prime determiners of brand quality:Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Constant monitoringShort feedback loops

The CD Gap (Web vs. Mobile)Facebook (mobile)Updated and refreshed every two weeks Google (web)8 minutes from code commit to liveCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Why the Gap?

The Real Device QuestionEmulators do not have the following:BatteriesGPSAccelerometerVariant CPU\GPU capabilities

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

So the choice is whether to use the simulators/emulations that come with iOS and Android or to use real devices. Well, first off.the simulators & emulators are free, however they are just software mockups. , They may act like devices, but they in fact are not real devices. Meaning, theres no battery, there are no phone hardware components. And any simulated hardware capabilities are mockups. What if your app needs GPS, heavy accelerometer requirements? Additionally, even though you can select the different devices in your simulator/emulator, its still not the *real* CPU. May be good for initial testing during the Dev phase, but when you get into serious testingno matter what you call it: System, Integration, UAT, etc.the only way to be completely *SURE* is to test your app on a real device. Another way to state thatlets say, heaven forbid, that your customer facing banking app crashes on the new iPhone 6s Plus and it just cost your company a lot of money. Youre in a meeting with the CIO and hes reviewing the testing process and he asks, Did we test this app on a real iPhone 6s Plus? Do you think hed be happy with a negative answer?

Another endorsement of using real devices, Infosys (a large services company) did a study..

19

Mobility upends enterprise developmentApple and Google show little understanding and no practical interest in enterprise mobile developmentBillions $ from the consumer space may be a little distractingTethered culture creates a void otherwise filled by virtualizationFails at supporting mobile Agile and mobile DevOps:No continuous integration, automated testing as part of deploymentNo rapid deployment, incremental change, collaboration, DevOps supportYet there is a tsunami of OS levels and devices

The tethered-tool culture cannot support modern engineering practices because it wipes out virtualization.Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

21

Mobility demands a virtualized approachA device cloud can resuscitate proven engineering practicesRestores Agile development, DevOps Cultures, reduced time-to-marketRestores continuous integrationRestores automated testing as part of deploymentRestores automated, rapid deploymentRe-enables rapid, incremental changeShares virtualizations key characteristic: rapid access to production-equivalent systems

A device cloud fills the black hole created by the gap between the Apple, Google tethered culture and state of the art software engineering.Freedom! -- the device cloud unplugs enterprises from the restrictions of the tethered model.

Other CriteriaAPM monitoring results input to deployment manager User monitoring results input to deployment managerPerformance criteriaPath criteriaCompletion criteriaUX survey (subjective) results input to deployment manager# of stars predictionBrand assessmentIn-house testers or crowd testersCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

APM (Application Performance Monitoring)Performance and availabilityTrends user timing, single-page websitesStatistics about devices, OSsWhich app features are being usedResources usedDevice and network timingBottleneck detectionCrash reporting

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

UI, Unit Test CaseDevelopmentUI, Unit Test Case ManagementAutomatedBuildContinuous IntegrationLiveAutomated Continuous Deployment

AutomatedBatchTestingUX,APMInputsManualTestInputs

ResultsManagement

UI, Unit Test CaseConfiguration

DevelopmentAutomated Continuous TestDeploymentManagerTest Case DevelopmentCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.A deviceCloud at the center of your CD cycle

deviceConnectCore of the Enterprise Mobile App InfrastructureTM

Device cloud mobile app development infrastructurePublic device cloudOutsourced infrastructure managementGlobal System IntegratorsOn-premises device cloudPerformanceFlexibilityAdaptability to process

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Team Support. Simplified.Plug-and-play in standard office environmentStandard power outlet, Ethernet LAN connectPlug devices into USB portsUp and running!

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

Development Tools

Automated TestingContinuous Integration

On Premise, Private Device Cloud

Development Teams

QA Teams

Mobile World

deviceConnectCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

About Mobile Labs

Corporate Overview

HQ: Atlanta, GA

Founded in 2011 - Atlanta, GAGlobal organization with offices in US, Europe and IndiaCopyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

31

Corporate OverviewProvide the following solutions to the Global 2000:deviceConnect, a private mobile device cloud that enables the secure management and accessibility of mobile test devices, mobile applications and test datadeviceBridge, a patent pending technology that creates a virtual tether between the devices being managed in deviceConnect and development\automation technologies that required local USB connectivityMobile Labs Trust, one automation option for deviceConnect, extends HPs UFT to real mobile devices, providing mobile application test automation utilizing the same skills testers use for Web/desktop testing Our mission: Bringing Order to the Chaos of Mobile App Testing

Copyright 2016 Mobile Labs l Confidential and Proprietary I All Rights Reserved.

32

Thank You!Phone+1 404.214.5804Emailinfo@mobilelabsinc.comWebwww.mobilelabsinc.comVideo DemoFree TrialMobile Testing ResourcesBlog