Phil Hunter - Automation Presentation 1
Automation Testing Presentation
Phil Hunter
Phil Hunter - Automation Presentation 2
Contents
IntroductionWhat is test automation and why is it useful?Choosing the right automation toolUsing an automation tool to automate the taskSummaryQuestions?
Phil Hunter - Automation Presentation 3
Introduction
Phil Hunter - Automation Presentation 4
Introduction
Automation TaskAdvise how best to automate test the Incident
Form
Goal of the presentationShow how I chose the correct automation toolShow how I would use that tool to test the Incident
Form
Phil Hunter - Automation Presentation 5
What is Test Automation?
Phil Hunter - Automation Presentation 6
What is Test Automation?
“Test automation is using software to control the execution of tests and comparing the actual outcomes against expected outcomes”- Automated Defect Prevention (Huizinga +Kolawa)
2 main types:Code-driven Testing (Unit, Performance, Load)GUI Testing (Functional)
Phil Hunter - Automation Presentation 7
What is Test Automation
Where does automation come in?Manual Testing
Test requirements gathering and analysisTest PlanTest DesignTest Implementation and ExecutionDefects reporting and trackingTest Closure
Phil Hunter - Automation Presentation 8
Why is it useful?
Phil Hunter - Automation Presentation 9
Why is it useful?
Even with the best manual testing processes bugs can still creep in and often reappear
Automated software testing is the best way to increase the effectiveness, efficiency and coverage of testing the software
Phil Hunter - Automation Presentation 10
Why is it Useful?Saves time and money
Reduces time in repeating tests manually (Regression Testing)
Automated tests can repeatedly at no additional costTime saved translates into money saved
Improves accuracyTesters can make mistakes (tired, monotonous)Automated tests perform same steps precisely each
time and never forget to record detailed results
Phil Hunter - Automation Presentation 11
Why is it Useful?Increases test coverage
Increases depth and scopeCan look inside application (see memory contents,
data tables, file contents, internal program states) and see if they behave as expected
Can execute thousands different complex test cases during every test run
Testers freed from repetitive manual testing so they have more time to create new automated tests to add to existing automated tests
Phil Hunter - Automation Presentation 12
Why is it Useful?Does what manual testing cannot
Can simulate tens to thousands of virtual users interacting with the network, software or application
Helps developers and testersDevelopers can catch problems before sending
application to testers (automated unit testing)Saves developers time and increases confidence
Improves team moraleRemoves repetitive tasks and frees up time for
more challenging and rewarding projects and tasks
Phil Hunter - Automation Presentation 13
Choosing the Right Automation Tool
Phil Hunter - Automation Presentation 14
Choosing the Right Automation Tool
List of automated toolsHP Unified Functional Testing (UFT)HP Quick Test Professional (QTP)Visual Studio Test ProfessionalSeleniumWatirWatijRational Functional TesterTestComplete
Phil Hunter - Automation Presentation 15
Choosing the Right Automation Tool
Selenium, Watir, WatijWeb based testing tools
Visual Studio Test ProfessionalHas record/playback featureUsed for applications development in Visual
Studio/ .NETHard to edit the automation once completedVS Premium + Ultimate more effective but more
costly
Phil Hunter - Automation Presentation 16
Choosing the Right Automation Tool
HP Unified Functional Testing (UFT), Rational Functional TesterMainly limited to functional testingBetter tools available for priceOther tools more highly recommended
Phil Hunter - Automation Presentation 17
Choosing the Right Automation Tool
HP Quick Test Professional vs TestCompleteShowdown
Phil Hunter - Automation Presentation 18
Choosing the Right Automation Tool
QTP (Advantages)50% market shareMainly Functional automationRecord/Playback featureSupports testing of mobile, web based and
desktop applications, Windows, web services and databases
Descriptive programming a big bonus (not justified in cost)
Phil Hunter - Automation Presentation 19
Choosing the Right Automation Tool
QTP (Disadvantages)Only uses VBScriptHigh cost
Phil Hunter - Automation Presentation 20
Choosing the Right Automation Tool
TestComplete (Advantages)Affordable and significantly cheaper per license
than QTPFlexible switching between applications (e.g. from
web to .NET to Java) in single script sessionReliableSupports Data Driven TestingAllows Object MappingOrganise tests into multi-level treesStrong User communityEasy to learn
Phil Hunter - Automation Presentation 21
Choosing the Right Automation Tool
Supports 5 scripting languages (VBScript, Jscript, DelphiScript, C++Script, C#Script)
Supports different testing methods (Unit, Functional, Regression, Keyword, Web testing, distributed, load, coverage, data-driven, manual)
Supports Microsoft Windows Server 2008 (both 32-bit and 64-bit editions
TestComplete (Disadvantages)Didn’t integrate with HP TestDirector or Quality
Center though there is a new beta version released that does integrate
Phil Hunter - Automation Presentation 22
Choosing the Right Automation Tool
HP Quick Test Professional vs TestCompleteShowdown
Phil Hunter - Automation Presentation 23
Choosing the Right Automation Tool
Winner- TestComplete
Phil Hunter - Automation Presentation 24
Using Automation Tool to Automate the Task
Phil Hunter - Automation Presentation 25
Using Automation Tool to Automate the Task
Task - How to automate test the incident form
Use existing Test Cases to create automation testsUse the GUI Record/Playback feature
Known as Keyword TestingKeyword Tests can be edited using Keyword Test EditorVisualisor Panel shows screenshots in Keyword Test
Editor which can be clicked on and editedKeyword tests arranged into test cases and test cases
into test suites
Phil Hunter - Automation Presentation 26
Using Automation Tool to Automate the Task
Keyword TestLog records everything that happened in the test
Any new functionality can be added to already existing automated tests by creating and adding more keyword tests using keyword test editor
Checkpoints are used in keyword tests for verifying data (expected/actual outcomes)Checkpoints use data-driven testing (uses external
data sources to input range of data values; useful for increasing test coverage)
Phil Hunter - Automation Presentation 27
Using Automation Tool to Automate the Task
Operations are actions performed during Keyowrd TestsOrganised into categories (logging, test, checkpoint)
and each of them has a number of associated operations (e.g. property checkpoint, log message, compare files, data driven loop etc)
Wizards help with operations (e.g. checkpoint wizard helps with property checkpoint, table checkpoint, web service checkpoint etc)
Object references
Phil Hunter - Automation Presentation 28
Using Automation Tool to Automate the Task
Phil Hunter - Automation Presentation 29
Summary
Phil Hunter - Automation Presentation 30
Summary
IntroductionWhat is test automation and why is it useful?Choosing the right automation toolUsing automation tool to automate the task
Phil Hunter - Automation Presentation 31
Questions?