Managing Test Labs Without the Headaches Visual Studio 2012

Imaginet and ALM…Efficiently Build Better Software

Agenda

• Lab Management Overview– Demo: Creating a Standard Environment

• Version Comparison– Agents– Standard Environments

• Workflow Impact– Demo: Implementing a BDT workflow in

a Standard Environment

Test Environments

• Group of machines configured to support testing of a system

• Generally…– Shared resources– IT and/or Dev Controlled

• Configuration• Reconfiguration• Backup/Restore• Deployment

Web Server

Database Server

App Server

Lab Management

• Create and manage virtual or standard test environments

• Take snapshots or revert to existing snapshots for virtual environments

• Interact with test environment through the Environment Viewer

• Support for shared or isolated virtual environments

• Define and use test settings for environments

• Facilitate automated build/deploy/test

Virtual and Standard Test Environments

Environment #2aEnvironment #1 Environment #2bVirtual Machine Server(s)

Environment #2a

VM1

VM2

VM3

Environment #2b

VM4

VM5

VM6

Logical Lab Architecture

Team Foundation Server

Lab Management

Test Management

Build Management

Work Item Tracking

Version Control

Reporting

Test Controller(s)

Build Controller(s)

Standard Environment(s)

Hyper-

V H

ost

(s)

System Center Virtual Machine Manager

(SCVMM)

Vir

tual

Envir

onm

ent(

s)

Lib

rary

Serv

er(

s)

Microsoft Test Manager (Lab Center and Environment Viewer)

DEMONSTRATION

• Using MTM’s Lab Center to Create a Standard Environment

Agenda

• Lab Management Overview– Demo: Creating a Standard Environment

• Version Comparison– Agents– Standard Environments

• Workflow Impact– Demo: Implementing a BDT workflow in

a Standard Environment

Lab Management 2010

• First Generation product

• Core Functionality– Physical & Virtual Test Environments– Build-Deploy-Test (BDT) Workflow*– Test Environment Snapshots*– Environment Viewer– Identical network-isolated environments*

* Out-of-the-box for Hyper-V only

Changes in Lab Management 2012

• Simplified Agent Configuration

• SCVMM 2012 and Clustered Host Support

• Standard Environments

Simplified Agent Configuration

• Visual Studio 2010 – Three agent types installed on client machine:

• Test• Build• Lab Agent

• Visual Studio 2012– Single agent (Test) automatically installed during

environment creation

Agents

• Installed on “client” machines

• Three agent types:– Test Agent – Enables automated

testing on the client machine– Build Agent – Enables automated

deployment to the client machine– Lab Agent – Enables Network

Isolation (2010 Only)

• Available on the Lab Management media (Test and Lab) or the TFS media (Build)

• Can be installed/maintained using the VMPrepTool

Test Controllers and Agents

Figure from MSDN documentation

Standard Environment (2012) with Build Agents

System #1

Build Controllers and Agents

Build(Compile)

Build(Deploy)

Automated build and deployment is through Build Controllers and Agents.

Team Foundation

Server

Build Controller(s)

Build Server(s)

(with Build Agents)

Virtual Environment with

Build Agents

System #2

Etc.

VM #1

VM #2

Etc.

Virtual Machine Server(s)

Lab Agents (2010 Only)

Environment A

VM1+Agent

VM2+Agent

VM3+Agent

Environment B

VM1+Agent

VM2+Agent

VM3+Agent

Environment C

VM1+Agent

VM2+Agent

VM3+Agent

Standard Environments

• Environments composed of non-Hyper-V machines:– Physical machines– VMWare– Other non-Microsoft virtualization technologies

• Lab management features available without SCVMM and Hyper-V:– Automated Deploy– Automated Testing

• Easy to get started testing using Lab Management

Environment Comparison

Capability Virtual Environments

Standard Environments

TestingRun manual tests Supported Supported

Run coded UI and other automated tests Supported Supported

File rich bugs using diagnostic adapters Supported Supported

Build deployment

Automatic build-deploy-test workflow Supported Supported

Environments creation and management

Automatically install test agent into machines of the environment Supported Supported

Create environment from VM template Supported Not supported

Start/stop/snapshot environment Supported Not supported

Connect using Environment Viewer Supported Supported

Run multiple copies of an environment at the same time using network isolation Supported Not supported

Comparison of Installation Process

Virtual Environments

• Prerequisites:– TFS 2010 or TFS 2012

• SCVMM Admin Console on the TFS

– Virtual machine host server(s):• Windows Server 2008 or later (R2

or 2012 recommended)• Hyper-V• SCVMM Server• Library server

• Process:– Configure Lab Management using

the TFS Admin Console– Import virtual machines– Install agents as needed– Create environments, templates,

etc. in library

Standard Environments

• Prerequisites: – TFS 2010 or TFS 2012

• Process:– Install agents on existing physical

(or non-Hyper-V virtual) machines• ‘Automatic’ with TFS 2012

– Create environments based those machines

Agenda

• Lab Management Overview– Demo: Creating a Standard Environment

• Version Comparison– Agents– Standard Environments

• Workflow Impact– Demo: Implementing a BDT workflow in

a Standard Environment

TFS Build Process

Build Workflow

DEVDEV

DEV

TFS Version Control

C#

EXE

Manual Test Workflow

QA QA

Rich Bug

Run Tests in Standard

Environment

Developer Workflow

Review Rich Bug

DEV

Bug fix checked into

TFS

Implementing a BDT Workflow

• Configure Team Foundation Build Service for your team project collection

• Set up a test controller and register it with your team project collection

• Set up a lab environment– SCVMM, or – Standard (physical, VMWare, other virtualization platform)

• To run automated tests after deployment– Create a test plan with test case(s)– Create automated test(s) and link to test case(s)– Create test settings for the automated test(s)

• Create deployment scripts for your application(s)• Configure BDT workflow

DEMONSTRATION

• Implementing a Build-Deploy-Test Workflow using a Standard Environment

Want to know more...?

Imaginet’s New Visual Studio 2012 Website!

http://visualstudio.imaginet.com

Visit Imaginet’s new Visual Studio 2012 website, your one-stop hub for all your Visual Studio 2012 needs!

For attendees of today’s session that fill out the survey

FREE Imaginet On DemandWeb Training Subscription Offer

Complete our Post-Webcast survey, and receive 1 free Imaginet On Demand web training subscription, good for 1 person for 1 month!! The survey will be emailed to you immediately after this webcast is over.

What is Imaginet On Demand? Imaginet is proud to announce our newest web-based training program called Imaginet On Demand, your source for the best Application Lifecycle Management (ALM) training on the internet. Imaginet On Demand is a subscription-based training program centric to the Visual Studio ALM tools, including Visual Studio, Team Foundation Server (TFS), Microsoft Test Manager, and Microsoft Visual Studio Lab Management. Learn the new tools of Visual Studio at your pace, from wherever you want. It's that simple!

Need Help with YOUR Lab Management Setup?

• Includes designing, installing, and configuring Microsoft’s virtual test lab management software.

• Learn best practices for using with Lab Management

• Support and training for your team

• Includes a high-level ALM assessment

Imaginet’s Visual Studio 2012Lab Management 10-day Quickstart

Interested? Just email us at info@imaginet.com.

Top Gun Academy Training Classes

• Other Imaginet Training Classes– ALM

• Microsoft Visual Studio & TFS 2012 – Skills Upgrade (2 days)• Overview Training with Microsoft Visual Studio 2012 ALM Tools (4 days)• Overview Training with Microsoft Visual Studio 2010 ALM Tools (4 days)• Testers Training with Microsoft Visual Studio 2012 ALM Tools (4 days)• Testers Training with Microsoft Visual Studio 2010 ALM Tools (4 days)• Developers Training with Microsoft Visual Studio 2012 ALM Tools (4 days)• Developers Training with Microsoft Visual Studio 2010 ALM Tools (4 days)• Imaginet On Demand Online Web Training

– Scrum/Kanban• Professional Scrum Foundations (PSF) (2 days)• Professional Scrum Master (PSM) (2 days)• Professional Scrum Developer (PSD) (5 days)• Professional Scrum Master (PSM) Using Microsoft ALM (3 days)• Accredited Core Kanban Using Microsoft ALM (3 days)

To register or for more information, please visit our website here: http://www.imaginet.com/ or contact us: info@imaginet.com

TFS / Visual Studio 2012

Remaining Workshops & Webcasts:

• Lean, Kanban, and TFS • December 3 (1:00-2:30pm CT)

• Approaches to Kanban with TFS• December 6 (1:00-2:30pm CT)• December 20 (1:00-2:30pm CT)

• Streamline Your Testing with Visual Studio 2012 Testing Tools• December 13 (1:00-2:30pm CT)

• Getting Started with Coded UI Testing: Building Your First Automated Test• December 17 (1:00-2:30pm CT)

Email us at:info@imaginet.com

ALM Planning & Implementation ServicesALM Planning • ALM Assessment & Envisioning Workshops

(3 or 5 days)• VS & TFS Migration Planning Workshop (5

days)• TFS Deployment Planning* (5 days)• Visual SourceSafe to TFS Migration

Planning* (3 Days)• Visual Studio Quality Tools Deployment

Planning* (5 days)

Upgrade• TFS 2010 Adoption Quick Start (5 or 10

days)• TFS 2012 Adoption Quick Start (5 or 10

days)• TFS 2010 Upgrade Quick Start (10 days)• TFS 2012 Upgrade Quick Start (10 days)

Remote Support• Remote Support for TFS & Visual Studio

Lab• Visual Studio Lab Management Quick Start

(10 days)

Testing• Manual Testing with Test Manager Quick

Start (5 days)• Visual Studio Testing Tools Quick Start (10

days)• Visual Studio Automated Testing Quick Start

(5 days)• Visual Studio Load Testing Quick Start (5 or

10 Days)

Builds• Automated Build & Release Management

Quick Start (5 days)• Automated Build Center of Excellence (CoE)

Database• Visual Studio Database Tools Quick Start (10

days)

Integrations• Team Foundation Server (TFS) & Project

Server Integration Quick Start (10 days)• TFS & Quality Center Integration/Migration

Quick Start (10 days)

Phone: 1-800-989-6022Email: info@imaginet.com

Website: www.imaginet.comFacebook: www.facebook.com/justimaginetTwitter: www.twitter.com/justimaginetSlideshare: www.slideshare.net/imaginet

Attend a Webinar: www.imaginet.com/webinarsAttend a Training Class: www.imaginet.com/training

Want to know more...?