Date post: | 29-Mar-2015 |
Category: |
Documents |
Upload: | parker-stonehouse |
View: | 221 times |
Download: | 3 times |
© Telcordia Technologies 2004 – All Rights Reserved
AETG Web Service Tutorial
AETG is a service mark of Telcordia Technologies.Telcordia Technologies - Licensed MaterialAccess to this tutorial is provided solely to the registered users who have agreed to access and use the AETG Web Service according to the terms of the “Click-on license agreement” accepted during the registration process.
Page – 2
© Telcordia Technologies 2004 – All Rights Reserved
AETG Web Service
Create tests for:– Communications protocols– Feature interaction– Interoperability– Graphical User Interfaces (GUIs)– Contracts– etc.
Improves tester productivity by allowing a tester to create more, higher quality tests
Page – 3
© Telcordia Technologies 2004 – All Rights Reserved
AETG Web Service
WHAT - Helps testers design test sets. – Is especially helpful where combinatorial explosion of
input combinations is a problem. HOW - Tester provides input parameters and
parameter values. – AETG Web provides test cases with a specific value
for each parameter. AETG Web lets you choose the degree of
interaction between the parameters– E.g., degree of interaction = 2 means pair-wise
combinations
Page – 4
© Telcordia Technologies 2004 – All Rights Reserved
Example Scenario, part 1
Call Processing– Consider testing telephone-switch software – A call has the following characteristics:
Call Type: one of Local, Long Distance, International Billing: one of Caller, Collect, 800 Access: one of Loop, ISDN, PBX Result: one of Success, Busy, Blocked
– This scenario uses 4 input parameters, each with 3 possible values
Just using valid values in this example All combinations are valid.
Page – 5
© Telcordia Technologies 2004 – All Rights Reserved
Example Scenario, part 2
Each call characteristic is called a field– The AETG term for a test parameter
Values and relationships among fields appear in a relation
– The AETG term for a collection of fields that together model a test scenario
The AETG model that you will build in this tutorial will have:
– 4 fields (“call type”, etc.)– 1 relation with the 3 values for each field (“local”, etc.)
This basic example does not use any compounds or constraints
Page – 6
© Telcordia Technologies 2004 – All Rights Reserved
Numbers of Tests
Consider just 2 parameters: Call Type and Billing– Each has 3 distinct values. We need 3 x 3 = 9 tests to
test all possible combinations of two parameters. Consider all 4 parameters
– Testing all possible combinations of the 4 parameters requires 3 x 3 x 3 x 3 = 81 tests.
AETG Web can cover all pair-wise combinations of these 4 parameters with only 9 tests.
Page – 7
© Telcordia Technologies 2004 – All Rights Reserved
Using the AETG Web Service for the Example
In the basic tutorial you will– Create a Test Specification (TS)
Specify fields Specify relations (field interactions) Specify valid values
No invalid values
– Generate test sets– View, download, and print test sets
Page – 8
© Telcordia Technologies 2004 – All Rights Reserved
AETG Web Service - Access
Access URLhttp://aetgweb.argreenhouse.com
– Note that all access to the service uses secure http (i.e., https)
Any modern web browser should work– E.g., Firefox, Internet Explorer, Netscape, Mozilla
Page – 9
© Telcordia Technologies 2004 – All Rights Reserved
Click on “Log In”underRegisteredUsers
Access to user documentation requires login.
Please checkthe news page occasionally.
Home Page
Page – 10
© Telcordia Technologies 2004 – All Rights Reserved
Enter your user name & password to start a new session.
Please do not bookmark this page.
Note the “lock” icon in the browser.
Login Page
Page – 11
© Telcordia Technologies 2004 – All Rights Reserved
Bookmark this page!
Welcome Page
Page – 12
© Telcordia Technologies 2004 – All Rights Reserved
Steps to create a New Test Specification
1. Pick a name and create an empty test specification
2. Open the test specification for edit
3. Create all required fields in the spec
4. Create a relation
5. Select fields for that relation
6. Enter values for each field in the relation
Refer to Section 2 : Starting a Test Generation Session in the User Manual
Page – 13
© Telcordia Technologies 2004 – All Rights Reserved
This page shows folders and test specifications that you have defined.
Links allow you to create, delete, rename, etc.
Manage Specifications
Page – 14
© Telcordia Technologies 2004 – All Rights Reserved
Enter a new name (“calls”) and click on the “Add” link to create an empty test specification.
Enter name for the new specification
Page – 15
© Telcordia Technologies 2004 – All Rights Reserved
Select the specification name in the list box and click on the “Edit” link to open it.
Edit the newly created specification
Page – 16
© Telcordia Technologies 2004 – All Rights Reserved
Enter each field name, and click on the “Add” link.
Field names from the example:
Call_TypeBillingAccessResult
Create fields in the test specification
Page – 17
© Telcordia Technologies 2004 – All Rights Reserved
Fields created in the test specification
Page – 18
© Telcordia Technologies 2004 – All Rights Reserved
Enter a relation name, then click on the “Add” link.
Create a relation in the test specification
Page – 19
© Telcordia Technologies 2004 – All Rights Reserved
Next, click on the “Select Components” link to add fields to the relation.
Empty relation created in the test specification
Page – 20
© Telcordia Technologies 2004 – All Rights Reserved
Select all the fields, click on the >>Add>>” link.
Select fields for the newly created relation
Page – 21
© Telcordia Technologies 2004 – All Rights Reserved
All fields are now in the “Used” column. Click on the “Submit Selections” link at the bottom to save the changes.
Fields selected for the newly created relation
Page – 22
© Telcordia Technologies 2004 – All Rights Reserved
Click on the “Edit values” link next.
Relation with fields
Page – 23
© Telcordia Technologies 2004 – All Rights Reserved
Enter values, one per line, in the text boxes.
Click on the “Submit values” link to save changes.
Enter values for fields in the relation
Page – 24
© Telcordia Technologies 2004 – All Rights Reserved
Click on the “Generate tests” link next.
Generate tests
Page – 25
© Telcordia Technologies 2004 – All Rights Reserved
Output from test generator (top)
Next slide, please.
Page – 26
© Telcordia Technologies 2004 – All Rights Reserved
Click on the “View all test cases” link next.
Output from test generator (scrolled down)
Page – 27
© Telcordia Technologies 2004 – All Rights Reserved
Click on the “XML” link to view as XML.
Overview of generated tests
Page – 28
© Telcordia Technologies 2004 – All Rights Reserved
XML is easily processed by programs, such as in a test harness.
View generated tests as XML
Page – 29
© Telcordia Technologies 2004 – All Rights Reserved
View generated tests as spreadsheet (“DIF”)
Click on the “DIF” link from the results overview page to save or view the tests in spreadsheet format.
Page – 30
© Telcordia Technologies 2004 – All Rights Reserved
Duplicate Values
For performance, load balancing, or user data simulation purposes, we may want to ensure that certain values are represented more often than others
AETG Web will accept duplicate values for a parameter. Duplicate values are treated as if they are distinct.
Page – 31
© Telcordia Technologies 2004 – All Rights Reserved
Exercise
Modify the relation by inserting a duplicate value 800 for the parameter billing, then generate tests
– How many valid tuples does it find?– Are there more tests?– Does 800 occur more often than other values?
Remove the duplicate value & submit the relation.
Page – 32
© Telcordia Technologies 2004 – All Rights Reserved
Test Seeds
Seeds are used to specify tests that must be in the test set (for example, you specify pairwise interaction, but you want a particular triple to be in the test set)
Page – 33
© Telcordia Technologies 2004 – All Rights Reserved
Add seed tests
Click on the “Edit seeds” link to specify seed tests.
Page – 34
© Telcordia Technologies 2004 – All Rights Reserved
Choose values for seed tests
Use the pull-down selection boxes to choose a value for each member of the seed tuple, then click on the “Submit values” link to save changes.
Then click “Generate Tests”
Page – 35
© Telcordia Technologies 2004 – All Rights Reserved
Re-generate to include seed tests
Pairs covered by the seed are taken into account, so the addition of this seed test does not increase the total number of cases.
Choosing a different seed can cause the generator to require 9 or even 10 cases. The starting point has a big influence.
Page – 36
© Telcordia Technologies 2004 – All Rights Reserved
Generated tests with a seed test
The seed is the last test. Note that the valid tests are different from those created without the seed.
Page – 37
© Telcordia Technologies 2004 – All Rights Reserved
Exercises
Create a second seed for the relation, view the spec, and generate tests
Delete the seeds for the relation Generate tests for Interaction degree of
– 3 (triples)– 1 (no pair-wise coverage requested)
Note how many tests are created in each case