+ All Categories
Home > Documents > Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Date post: 15-Dec-2015
Category:
Upload: rita-waldren
View: 221 times
Download: 0 times
Share this document with a friend
Popular Tags:
35
Alan Page Microsoft Software Testing at Microsoft:
Transcript
Page 1: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Alan PageMicrosoft

Software Testing at Microsoft:

Page 2: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Microsoft ProductsNearly 300 Products Released in last 12 Months

Page 3: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Some Numbers

Page 4: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

More than 90,000 Employees World Wide

Page 5: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

More than 38,000 Engineers

Page 6: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Nearly 10,000 Testers

Page 7: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Testing at Microsoft

First tester hired in 1979 (high school intern)

First full-time tester hired in 1983

First “wave” of tester hiring in 1985

Page 8: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

In the beginning…

“You will design, execute and document tests of application software”

Requirements: background in math, computers, programming

Page 9: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

SDETs at Microsoft

Emphasis on Technical SkillsCode to understand and solve problems

Page 10: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

SDETs at Microsoft

Equal Career PathsTest / Development / Management

Page 11: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Development

Test

Team Makeup: Feature Team Triad

Program Management

Page 12: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Team Makeup: The Quartet for Software as a Service

Operations

Development

Test

Program Management

Page 13: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

VP or General Manager

Product Unit Manager

Dev Test PM

Product Unit Manger

Dev Test PM

Organizational Structures (1)"The PUMdom"

Page 14: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

President or Senior Vice President

GM or VP of Dev

Dev Managers Architects

GM or VP of Test

Test Managers

Test Architects

GM or VP of Program Mgmt

PM Managers Etc.

Organizational Structures (2)"The Triad"

Page 15: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Software DevelopmentWorkflow and Test Execution

Page 16: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Abort Checkin

Test CITsDistributed

Submit to Source Depot

Dev or Test?

Dev Test

Test CITsDistributed

No

Yes

Pri0 Bug Exists?

Abort Checkin

PassedFailed Submit

Build product / test*

Dev CITs Distributed

Create Pri0 BugEmail Test Owner

No

Yes

Pri0 Bug Exists?

Page 17: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.
Page 18: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.
Page 19: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

The Future

Page 20: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

TestingChallenges

or – variations on the same old stuff

Page 21: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Testing Challenges

Over-testing, under-testingand

millions and millions of tests

Page 22: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Testing Challenges

Data, data, data

Page 23: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Testing Challenges

ConcurrencyScale

Screens and the Cloud

Page 24: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Testing Challenges

The test / development relationship

andorganizational agility

Page 25: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Testing Challenges

Community and collaboration-

If only we knew what we knew

Page 26: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Productivity GamesRecapturing discretionary

time

http://productivitygames.blogspot.com/http://seriousgames.org/

Page 27: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Ribbon Hero

Page 28: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Localization Testing

• Hard, Large-Scale Problem

• Windows 7 ships in 100 languages

• Thousands of Strings and Screens per Release

Page 30: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.
Page 31: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Amplify Skill with Volume

Individual dialects, nuances, hard to detect with a single vendor – crowd does a better job

Page 32: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Reduce cost with Discovery & Instrumentation

No need to install

Telemetry to direct effort

Page 33: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

Results

Significant Quality Improvements for Windows 7Positive Impact on Ship Schedule

Team Morale and Subsidiary Engagement

Total Screens Reviewed: Over 500,000

Total Number of Reviewers: Over 4,500

Screens per Reviewer: Average 119

Page 34: Alan Page Microsoft. Microsoft Products Nearly 300 Products Released in last 12 Months.

http://angryweasel.com/bloghttp://twitter.com/alanpage


Recommended