Post on 22-Nov-2014
description
transcript
The Valueof Quality
Topics
The Real Valueof Software Development
Complex Software is Everywhere!
Product Lines of Code
Typical Order Entry System 1,2 Million
F-22 Raptor 1,2 Million
Space Shuttle 2 Million
Microsoft Word 2 Million
F-35 Joint Strike Fighter 5,7 Million
Typical Airline Reservation System 6 Million
Mercedes Benz S Class 29 Million
The ability to use, develop, integrate and deliver custom software is strategic for most organizations
However, unlike other strategic business processes, there are often large gaps – which creates risk:No consistent processes are being applied to the development and management of custom software.
Reporting on developer productivity, software quality and business value is missing.
Development processes and activities are not predictable and repeatable.
Complexity of software (and value opportunities) grow without associated maturity and team capabilities
Business Runs On Software
How well a firm executes itsbusiness strategies is tied to how
good it is at creating and managing
custom applications!David Chappell
BUT
Software development is difficult, takes a long time, costs a lot of money and
often fails!The Voice of Experience
At First, It‘s Easy
Over Time, Things Get Complicated ...
So, Management Is Added …
… And Process …
… Which Leads To Specialization …
… And Adding Of Indirect Labor …
But Wait – There’s More!
Business demand outpaces the abilityof developers to deliver applications
60
40
20
0
-20
-40
Market Conditions
Business Requirements
Application Delivery
60
40
20
0
-20
-40
60
40
20
0
-20
-40
Remote Access
Value Delivery Impediments
No Progress Monitoring
Unmanageable Complexity
Lack of KPIs and Insight
Loss of Focus
Non-Repeatable Work
Business Requirements Grow Exponentially
Inconsistent (or no) Processes
Poor Communication Across Functional Silos
Unpredictable Results
Hidden Risks
Wasted Time and Effort
Scope Creep
ALM is the marriage of
Business Management and
Software Engineering!
Monitor
OperateWorking software in productionValue realized
The Value Delivery Cycle
“Conventional” QA
QA
Testing postimplementation. Mostly
manual with limitedautomation.
UAT
UAT post implementation
and systemstesting
Operationsreadiness
verification
Pre-deploymentverification
Document requirements as BRDs and
functional specs
Write code to implement
requirements
Business Value of Quality Enablement
From “Testing“ to “Quality Enablement“
Measuring Quality
Common Quality Issues and Blockers
Blocker: Misunderstood Requirements
Requirements don’t reflect customer intentRework, long delivery cycles and frustration.
Storyboarding ToolGraphical mockups and visual prototypes in new PowerPoint add-on reducemisunderstandings and clarify intent.
Feedback ManagerStand-alone feedback tool allows stakeholders to provide comprehensive feedbackon any artifact, including storyboards, directly to development teams.
Problem
Solution
Solution
Misunderstood Requirements
Session 06Operations and Feedback
Blocker: Quality is an Afterthought
Quality not built in from the startFailure to meet user needs, rework, long delivery cycles and customer dissatisfaction.
Unit TestingExtensible unit test framework targets specific needs or technologies to ensure code correctness.
Fakes and stubs frameworkPowerful mocking framework to simplify unit testing and isolate logic.
Problem
Solution
Solution
Session 03Test Specification and Execution
Blocker: Unmet User Expectations
Delivered functionality fails to satisfy usersFailure to meet user needs, rework, long delivery cycles and customer dissatisfaction.
Problem
Solution
Exploratory TestingAd-hoc exploratory tests help uncover usability and consistency issues, and resultin actionable bugs and reusable test cases.
Session 03Test Specification and Execution
Blocker: Unmet Operations Readiness
Delivered code fails to perform as plannedFailure to meet IT maintenance needs, rework, long delivery cycles and customer dissatisfaction.
Web TestingLightweight web tests validate correct functionality and behavior, both in testing and production.
Load TestingPowerful load test frameworks simulates thousands of simultaneous usersto ensure performance, stability and uptime.
Problem
Solution
Solution
Blocker: Can’t Get Actionable Feedback
Delayed feedback on code changesFixing critical bugs takes a long time, increases in context switching,rework and long delivery cycles.
Continuous IntegrationBuild, deploy and test complex applications on every check-in toquickly identify problematic code changes.
Lab ManagementSelf-service test lab provisioning speeds manual and automated build-deploy-test feedback cycles.
Problem
Solution
Solution
Sessions 03 and 06Operations and FeedbackTest Specification and Execution
Limited Visibility into Quality States
Lack of visibility into overall qualitySlows fixes of bugs, increases context switching, rework and long delivery cycles.
ReportingOut-of-the-box and ad-hoc reports track quality against requirements,builds, releases and other artifacts.
Problem
Solution
Session 04Test Controlling and Tracking
Blocker: Operational Requirements Not Met
Production errors not caught quickly enoughLonger bug fix cycle times, customer dissatisfaction, and costly remediation.
Monitor in-production applicationsManagement pack templates make real time monitoring of production applications easy.
Problem
Solution
Session 05Test Infrastructure
Disparate Management Tools
Isolated tools and workflowsPoor communication, longer production bug fix cycle times, and customer dissatisfaction.
Integrated Incident management toolsCommon view of incidents to both Operations and Development.
Shared artifactsReuse development artifacts, such as tests, inside System Center to reducerework and discover production issues early.
Problem
Solution
Solution
Production Incidents Hard to Debug and Resolve
Production errorsDifficult to identify root cause, debug code and resolve defects.
Actionable diagnosticsIntelliTrace in production to speed debugging and code fix.
Translatable artifactsSystem Center logs can be converted to IntelliTrace logs for developer use.
Problem
Solution
Solution
Slow Feedback Creates Waste
Slow feedbackTime lags between work and feedback result in wasted time, increased context switching, and rework.
Lab ManagementSelf service test lab provisioning speed build-deploy-test feedback cycle.
Problem
Solution
Session 06Operations and Feedback
Software Testing with Visual Studio
Save time and reduce risksIntegrated test tools
Advanced test toolsintegrated
solution
Continuously deliver value
storyboard and user feedback tools
Visual Studio 2012 Quality Enablement
Analysts praise Visual Studio 2012