Post on 19-Apr-2018
transcript
3/23/2015
1
© 2015 TRICENTIS GmbH. All rights reserved. 1
Accelerate. Innovate. Automate.
1© 2013 TRICENTIS Technology & Consulting GmbH. All rights reserved.
Tosca for
TRICENTIS | Ernst Jan Smit
© 2015 TRICENTIS GmbH. All rights reserved. 4
Pick two?
Time-to-market
Cost Quality
Logos: Tricentis customer base, extract
Most of our customers need to optimize
all three project dimension!
3/23/2015
2
© 2014 Tricentis GmbH. All rights reserved. 6
25%
Source: TRICENTIS® customer projects
Effort/# of test cases
100%
0%
50%
Test Case
Specification
Manual Testing
(Execution)
Automated Testing
(Setup, Maintenance
and Execution)
risk coverage
What‘s the problem? A typical test project
Automation levels are low
because of it’s difficult to
automate!
If you don’t know how much
risk coverage you have,
you’ll end up with
far too many test cases!
Not effective enough
Not efficient enough
?
COM_B19
© 2015 TRICENTIS GmbH. All rights reserved. 7
Top 3 Pain-Points in Testing
Time-to-
marketCost Quality
1 Too many test cases
with insufficient/
unclear risk coverage
TestCase Quality
affected affectedaffected
2 Required test data is
missing or requires
high generation effort
Missing Test Data
affected affectedaffected
3 Manual testing No test automation in
place, key-users can’t
deliver required manual
test
affected affectedaffected
3/23/2015
3
© 2014 Tricentis GmbH. All rights reserved. 8
Automation – not without a foundation!
A methodological, structural basis is
needed for test automation – otherwise
it will just get bogged down
Sustainability, next to efficiency and
effectiveness, is the most essential
criterion for success
© 2014 Tricentis GmbH. All rights reserved. 9
3+ Steps to Optimized Testing
Optimize Automate
Test Case Quality
1
Avoid redundancies
Maximized, measurable contribution to
risk coverage for each test case
3/23/2015
4
© 2014 Tricentis GmbH. All rights reserved. 10
3+ Steps to Optimized Testing
Optimize Automate
Test Case Quality
1
Test Data Provisioning
2
Tailored test data
Automated provisioning and
management
© 2014 Tricentis GmbH. All rights reserved. 11
3+ Steps to Optimized Testing
Test
Automation
3
… using the right test access
(UI/nonUI)
… model-based to solve the
maintenance problem
Optimize Automate
Test Case Quality
1
Test Data Provisioning
2
3/23/2015
5
© 2015 TRICENTIS GmbH. All rights reserved. 12
Adobe Flex
E2E Test Automation with Tosca
ERP
CRM
SRM
SCM
PLM
Enterprise
Portal
SAP
BusinessObjectsTM
SAP HANA®
Mobile
EPM (BPC)
© 2015 TRICENTIS GmbH. All rights reserved. 15
Tricentis Tosca Testsuite
Virtualize – Orchestrated Service Virtualization
Technology Integration
Optimize
Risk Coverage
Optimizer
Manage
Test Data
Provisioning
Automate
Model-Based Test
Automation
Target Applications
Reporting & Dashboard
3/23/2015
6
© 2015 TRICENTIS GmbH. All rights reserved. 16
Virtualize – Service Virtualization & Orchestration
Manage
Test Data
Provisioning
Automate
Model-Based Test
Automation
Reporting & Dashboard
Tricentis Tosca Testsuite
Aligns business priorities to test planning & execution
Generates the fewest test cases to maximize risk coverage
Shifts focus from Test Coverage to Risk Coverage
Optimize
Risk Coverage
Optimizer
© 2015 TRICENTIS GmbH. All rights reserved. 17
Coverage of business risks is key
Order2Cash is a complex process with multiple steps, systems
and departments involved, including sales, service, finance, engineering,
operations, and logistics.
A customer orders
some items from
your company by
creating a sales
order.
Your company
decides to deliver
the items ordered
by the customer.
This is recorded
by creating a
outbound delivery
document.
Once the items
are available for
sending to the
customer, you
post goods
issue which
reduces your
inventory and
puts the delivery
in transit. This
will create a
material
document.
You finally
create a sales
billing document.
This will have a
corresponding
accounting
document
created
Now you can
check the whole
document flow and
compare the order
against saved
master order
Picking is a
process where
you guide the
system to take
the required
goods from
warehouse.
Transfer order is
created.
Example
Create Sales Order
VL01n VL02n VF01 VF03LT03
Outbound Delivery
Transfer Order forDelivery
Post Goods Issue
Billing Document
Check Document
Flow
VA01
3/23/2015
7
© 2015 TRICENTIS GmbH. All rights reserved. 18
Coverage of business risks is key
Sales Organization
Material/Product
Customer Type
Order Type
Count
14
15
5
2
Total # Test Cases
x
x
x
=2,100
M-1000
Customer
EU
Standard
Order
FRA
Channel 10
TC 1 TC 2
F01
Customer
nonEU
Rush Order
FRA
Channel 16
…TC 148
M05
Customer
EU
Standard
Order
Standard
FRA
…TC 2100
Quantity 0
Dunning 3
Rush Order
HAM
Group 13
33
Required TCs
Risk Coverage 33%11% 95%
Create Sales OrderVA01
© 2015 TRICENTIS GmbH. All rights reserved. 19
No time to test all combinations!
Create Sales Order
VL01n VL02n VF01 VF03LT03
Outbound Delivery
Transfer Order forDelivery
Post Goods Issue
Billing Document
Check Document
Flow
VA01
2,100 1,200 1,380 290 2,450 650x x x x x =
33
16
18
8
32
11
+
+
+
+
+ = 118
1.60604E+18
Max out risk coverage whilst
minimizing test efforts. * … awarded by the scientific community
3/23/2015
8
© 2015 Tricentis. All rights reserved. 20
Test Case & Data Design
© 2015 TRICENTIS GmbH. All rights reserved. 21
Linear Q SM - TestCases with max. effectiveness
100 %
Test coverage
Effort
50 %0 %
Exponential
increase
Linear increase up to near
100 % test coverage
3/23/2015
9
© 2015 TRICENTIS GmbH. All rights reserved. 22
Source: Customer Projects TRICENTIS®
Total effort/costs
100%
0%
50%
Test Case
Specification
25%
Manual
Test
Execution
75%
Automation
Finding
and
Preparing
Test Data
Execution
of
Test Cases
50 - 75% of manual
execution costs!insufficient control of
test data
Synthetic Test Data Engine
© 2015 TRICENTIS GmbH. All rights reserved. 23
Virtualize – Service Virtualization & Orchestration
Automate
Model-Based Test
Automation
Reporting & Dashboard
Optimize
Risk Coverage
Optimizer
Manage
Test Data
Provisioning
Tricentis Tosca Testsuite
Provides tailored test data basis for test execution
Reduces effort in manual test execution by 40 – 50 %
Stateful test data management is key for high automation rates
3/23/2015
10
© 2015 TRICENTIS GmbH. All rights reserved. 24
The magic triangle of test efficiency
Automatic TestCase execution
Automatic creation/adaptation of test data
objects
© 2015 TRICENTIS GmbH. All rights reserved. 25
Virtualize – Service Virtualization & Orchestration
Reporting & Dashboard
Manage
Test Data
Provisioning
Optimize
Risk Coverage
Optimizer
Automate
Model-Based Test
Automation
Tricentis Tosca Testsuite
Enables extreme automation (rates > 90%)
Covers UI and nonUI test automation
Enables seamless transition from manual to automated testing
3/23/2015
11
© 2014 Tricentis GmbH. All rights reserved. 26
The Maintenance Problem
Example:
“…select invoice with the car registration number VIC-3456”
CheckBox Click,
“/usr/cntlCONTAINER/she
llcont/
shell[2]/chbx[1,3]”
Does your business unit understand this instruction?
Is this instruction stable?
Checkbox Name Reg Number Invoice
John Smith NSW-1234 90035560
Jim Courier NSW-2345 90035561
John Cook VIC-3456 90035562
Tim Rebhorn VIC-4567 90035563
Dale Howard WA-5678 90035564
Frank Rose WA-6789 90035565
© 2014 Tricentis GmbH. All rights reserved. 27
Model Based Test Automation
CheckBox Click,
“/usr/cntlCONTAINER/she
llcont/
shell[2]/chbx[1,3]”
Example:
Do you understand the business instruction?
Do you remember it?
“…select invoice with the car registration number VIC-3456”
3/23/2015
12
© 2015 TRICENTIS GmbH. All rights reserved. 29
No time for scripting
Create Sales Order
VA01
© 2015 TRICENTIS GmbH. All rights reserved. 30Source: Automated Tosca Test Case, Order2Cash
No time for scripting
Tr
List of SAP Transactions
1. VA01 Create Sales Order
2. VL01n Create Delivery Note for Sales Order
3. LT03 Create Transfer Order for Delivery
4. VL02n Change Outbound Delivery
5. VF01 Create Billing Document
6. VF03 Display Billing Document
Create Sales Order
VL01n VL02n VF01 VF03LT03
Outbound Delivery
Transfer Order forDelivery
Post Goods Issue
Billing Document
Check Document
Flow
VA01
Our customers achieve unprecedented automation rates
with no need for programmers.
3/23/2015
13
© 2015 Tricentis. All rights reserved. 31
System Under Test
Test Cases
Model(s)
Technologydecoupling
Business
SAP Test Automation Architecture
SAP GUI
SAP Application
Server
SAP WebGUI
Tricentis Tosca Testsuite
SAP Fiori
© 2015 Tricentis. All rights reserved. 32
TOSCA
SAP
TOSCA Next Gen SAP Accelerator Package
NextGen Package
MM
SD
PP
QM
PMPS
FICO
Asset
Costing
3/23/2015
14
© 2015 Tricentis. All rights reserved. 33
• 671 SAP Transaction are automated in vanilla SAP application
• The automated test scripts can be easily tailored to suit
customer requirements
• Automated Change Impact Analyzer would help to identify the
gap between vanilla and customer SAP landscape.
• Enabling Auto remediation feature will help to correct the Test
scripts.
• The test data needs to be changed as per customer
requirements for test execution.
TOSCA Next Gen SAP Accelerator Features
© 2015 Tricentis. All rights reserved. 34
Modules
• Comprehensive unique modules
• No redundancies
• Easy to maintain
12 Modules
serves 3 Transaction
with no redundancies
3/23/2015
15
© 2015 Tricentis. All rights reserved. 35
Test Cases – Structure
Test Cases are stored according to SAP Menu hierarchy
© 2015 TRICENTIS GmbH. All rights reserved. 38
Test Configuration
SAP Solution Manager 7.1 (or higher) Tricentis Tosca TestSuite
Test CaseExt. TestCase
Test PackageExecution List
Execution Log
Execute Test Script
Execution Status
Most Powerful Integration with SAP Solman
Service Desk
Synchronisation
Test Case Design
Requirements
Create Solman Testscript
IncidentCreate linked incident
Business Blueprint
Dyn. TBOMs Create Dynamic TBOM
Business Process
Change AnalyzerSubmit Execution List
3/23/2015
16
© 2015 TRICENTIS GmbH. All rights reserved. 43
Top 3 Pain-Points - Summary
1 TestCase Quality
2 Missing Test Data
3 Manual testing
Reduced number of test casesOptimize
Risk Coverage
Optimizer
Highest risk coverage
Pain-Points Tosca Testsuite Your benefits
Manage
Test Data
Provisioning
Tailored test data
Never run out of them
Automate
Model-Based Test
Automation
Business readable
Avoid maintenance trap
Accelerated set-up (transaction re-use)
© 2015 Tricentis. All rights reserved. 44
Requirement Phase
Plan & DesignTest case
developmentExecution
Analysis & Closure
• Analysis of the requirements
• Review the requirement specifications (RS)
• Manage changes to the RS
• Establish traceability
• Review & Sign off
• Breaking the requirement to modules
• Design test scenarios
• Prepare the test plan
• Automation feasibility & framework
• Plan tools usage
• Design test cases• Gather Test data
requirements• Partial
Automation• Update
traceability• Upload Test
cases to QC• Identify
automation TCs
• Assign Test cases to consultants by SAP Modules
• Execute manual test cases
• Co-ordinate with SAP Consultants to complete End to End Test
• Log defects• Retest• Perform partial
automation • Record test results
• Co-ordinate with SAP Consultants to on Test Completion results
• Potential Defects retesting
• Generate the report for Manual test and Auto execution
• Test Artifacts
Traditional Testing Vs TOSCA Next GenTraditional Testing
TOSCA SAP Next Gen - An efficient and effective way of testing
Requirement Phase
Plan, Design & Develop
ExecutionAnalysis &
Closure
Understand client SAP Landscape & Modules
Deploy Next Gen SAP Work pack
Analyze customer landscape with TOCSA Next Gen Accelerator
Extract relevant Automated Tcode from Next Gen
Review & Sign off
Auto Remediate transactions to customer SAP Environment
Link Transactions to test scenarios
Auto End to End Test scripts
Maximize AutomationMinimal Manual Test
cases Integrated
o Test Datao Identify Risko Apply OA
Sync with Auto upload to test management tools
Un attended Test execution
Log defectsAnalysisAuto Re-testRecord test resultsTest Closure Business User
Involvement
Test
Coordination
Test Coverage
Multiple Test
Runs
3/23/2015
17
© 2015 TRICENTIS GmbH. All rights reserved. 47
More information
Please contact:
Ernst Jan Smit
Sales Manager Benelux
Tricentis NL BV
Prins Bernhardplein 200, 1097 JB Amsterdam, The Netherlands
o - +43 1 263 2409, m - +31 6 11 533103
e – e.smit@tricentis.com
© 2015 TRICENTIS GmbH. All rights reserved. 4848© 2013 TRICENTIS Technology & Consulting GmbH. All rights reserved.
Thank you!