Keyword-driven Test Automation Framework

transcript

Keyword-driven Test Automation FrameworkConcept, features, architecture

Misha Suboch

Topics Covered

Features

Workflow

Future

Test Automation Framework

Architecture

TAF is a program which helps to perform automation testing effectively. Let us see TAF:

Presentation agenda

1. Features and Advantages

2. Usage Workflow

3. Architecture

4. Artifacts

5. Implementation in Your Project

6. TAF Core Features

Features and Advantages1

Features

Keyword-Driven1

Product-independent2

Tool-Independent3

Maintainability4

• Business Logic• GUI Objects• Steps• Utilities

Advantages

Keyword-driven

Product-independent

Compatible with any automation tools on the market

Aligned with Continuous Integration Frameworks

(single entry point, unified test reports, etc.)

Workflow2

Automation with TAF

Initialization1

Usage • Run Test Scenarios• Create New Test Scenarios

Development

• Study Application• Mock up Test Scenarios• Implement Scenarios• Debug /Verify

Maintainability • Tune for New Build• Implement New Steps

Architecture3

High-Level Architecture

TAF Core

Bug List

Test Scenario 1

Test Scenario 2

Test Scenario NTestComplete TAF

Custom Automation tool

Another Automation tool

Run TAF.exe

Test Reports

Tool Specific

Detailed Architecture

TAF Core, Responsibilities

Read ConfigsRead Test Suite/Unified Test ScenarioRead Bug ListLoad DataConstant variables• Stores• Substitute• Calculate Expressions

Create Execution ListRun Automation Tool TAFExecution Optional (Cleanup) CommandCreate Reports

TAF.exe Config

TAF Core Source Code

TAF Core code is generated using Test-Driven Development approach, it is very well structured and covered by unit tests (more than 300 passed unit tests validates TAF Core quality).

Detailed Architecture

Communication between TAF Core and Automation Tool TAF

1.When scenario is read and parsed, TAF Core generate Execution List and run Automation Tool TAF.

2.After executing all tests, Automation Tool TAF generates Test Results Summary and exits.

3.TAF Core reads Test Results Summary and generates final results.

Automation Tool TAFTAF Core

ExecutionList.txt

TestResultsSummary.txt

Automation Tool TAF

Driver Controller

Test Cases

Actions

Verifies

ScreensFrames

Utilities

Scripts

Test Scenarios

Tool Status of TAF support

SilkTest Supported

TestComplete Supported (TAF Core)

Quicktest Pro Supported (TAF Core)

Watir Supported (TAF Core)

Selenium Supported (TAF Core)

Controller in TestComplete

Step Implementation

TestComplete, TAF Detailed Log

Artifacts4

Unified Test Scenario

Test Result Report for Scenario

Metrics Summary, Passed

Test Result Report for Scenario

Summary, Failed

Summary, Failed with Bug Link

Summary, Known Issue

Implementation in Your Project5

How to Proceed and Take Advantage of TAF

Get Test Complete TAF / Watir TAF / QTP TAF

Develop test scenarios

Implement steps

Automation with TestComplete, Watir or QTP:

Automation with another tool:

Implement controller

Develop test scenarios

Implement steps

TAF Core Features6

TAF Core Features: Overview

1. Unique keywords in test scenarios allow you to generate unique text and numbers in specified format

2. Ability to run several test scenarios at once, even if written in different automation tools

3. Ability to use the same test scenario for different automation tools, when one tool could not cover all test configurations (browsers/OS).

4. Unified test results (in .xml) across different automation tools/projects/applications provide integration options with external tools (like Cruise Control).

5. Ability to mark failed test cases as known issue and link to related bugs in test results.

6. Keywords Feature: Load/Repeat keywords allow to create data-driven test cases. Application keyword allow you to work in one test scenario (or even in one test case) with different applications.

TAF Core Features:

Overview8. Arithmetic expressions calculation and Variables

values substitution. Ability to exchange variables values between different test scenarios, automation tools or even when different test scenarios should be run one by one on different servers.

9. Unified test scenario could be easily accessed for review by customer or business analyst (no programming knowledge required)

10. Working with results: Auto-archiving of previous test results. Test results contains information about what workstation/server was used for scripts run, when and which TAF Core version they were generated by.

11. Extensive configuration features: execution (run selected tests/complete scenario), results output, logging, etc.

Test Automation Framework

Misha Subochmisha.suboch@gmail.com

Keyword-driven Test Automation Framework

Technology