Software Testing with Microsoft Test Manager 11 and Lab Management 11

Brian KellerSr. Technical EvangelistVisual Studio

I work here…

…on this…

…and this.

http://bit.ly/ThisWeekC9

I blog here:http://blogs.msdn.com/briankel

ALM Hands-On-Labs and VM• 6 ALM Hands-On-Labs +

Hyper-V Virtual Machine

• Downloadable from http://aka.ms/VS11ALMVM

Adding Lab Management

http://aka.ms/LAB11

http://tinyurl.com/ALM2010Book http://tinyurl.com/TFSBook

Agenda• Manual Testing• Formal Test Case Management• Exploratory Testing

• Lab Management• Standard Environments• Build-Deploy-Test Workflows

• Tracking Quality

USS Yorktown, SmartShip

• crew member entered 0 in a data entry field, caused a “divide by 0” error that shut down propulsion

• dead in the water for 2hrs 45mins

Ariane 5 Flight 501

• re-used code from Ariane 4, but took a different flight path because of different booster design

• conversation from 64bit float to 16bit signed int caused overflow (exception handler was disabled for perf reasons)

• cost: > $370 million @ 1996 prices

F-22 Raptor

• deploying overseas to Japan the first time

• crossed international dateline, computers crashed losing all navigation and communications systems

• clear weather allowed them to follow tankers back to Hawaii

Raptor is likely the most advanced manned aircraft that will ever fly…

Training

Conditioning

Climbing

Training Phase

Cost of Failure

Development

Test

Release

Software Phase

Cost of Bugs

Generalist Specialist

Manual Testing Some scripting

Creates scripts to set up lab, create data

Strong scripting skills

Some coding skills

Strong coding

Develops automated testing procedures

Expert coding skills

Tester Segmentation

Black Box Testing

White Box Testing

API Testing

70% of testing happens here

majority of test tools target here

What usually happens when a testerfinds a bug?

Graphic by Jeff Atwood (CodingHorror.com)

Visual Studio 2010

DemosFormal vs. Exploratory Testing

Manual Testing Improvements• Exploratory Testing• Rich text test steps• Code coverage• HTML5 automation• Metro style application testing• Better Lab Management administration

http://www.speakflow.com/View.aspx?presentationID=ac460729-6cce-4deb-8f09-5faa5873f027&mode=presentLocally

DemosLab Management 11

Lord Kelvin, 1824-1907

“…you cannot manage what you cannot measure.”

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

Q&A

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.