Annual OW2 conference
25/11/2010
OW2 – Middleware in Action
Salome-TMF A test management tool
that connects the tests team to those of development
Annual OW2 conference
24-25 November 2010
Summary
x Acpqualife
x A short entrance
� History: Ow2 the relay between contributors
x Features
� Requirements / Test Plan / Campaigns / Defects
� Positioning in the life cycle development
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
� Connection with other project management tools (Redmine, Jira)
� The next step
x Deployment example
� Jedeclare project, Salome at the heart of the development team
� Use in integration testing of electronic payments solutions
x Annex
� For details,
07/11/2010 2
Acpqualife ?
x ACP is a company of
Engineering and Computer
dedicated to New Information
Technologies, specializing in
the development of
applications based around
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
applications based around
Architectures N / Third.
x Strong capitalization around
the Electronic Banking.
x QUALIFE specializes in the
business of testing and
qualification of Information
Systems.
� Training , ISTQB/CFTL
26
47
17
Tests Développement & Production Management / Architecture
http://www.acpqualife.com/
Salome TMF
A short entrance
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
A short entrance
�History
07/11/2010 4
A short entrance - History
xSalome-TMF was created in 2002 by France Telecom
� Mikael Marche
xFirsts contributors
� France Telecom R&D development leader
� EDF
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
� EDF
� Xerox
x In 2009, FT stop the development
� EDF build 3.1 release for its needs
� Acpqualife is a Salome’s User for its software activity
• The most popular open source's test tool in our company
• � We joined the community
507/11/2010
Ow2 the relay between contributors
xApril 2009, meeting of Salome-TMF’s community
� Organised by Mikael Marche
� Who can take the lead?
� Do we agree with the objectives of the next release?
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
xNovember 2009
� Partnership between FT and acpqualife for skills transferts
� Prepare common communication with FT/EDF/Acpqualife
x In 2010 ACPQualife take the project’s lead.
� Edit the release 3.2
� http://www.Acpqualife.com
607/11/2010
Acpqualife Involvment
xEnsure the perenity of Salome
�Principal contributor
• Define the next steps of project development
�Coordinate development
Test the new releases
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
� Test the new releases
�Offer support to user
• On Ow2 forum
• Professional : for company
707/11/2010
Salome TMF
Features
Requirements / Test Plan /
Campaigns / Defects / Data
Environments
8
Execute
Features overview
Plugins
• Salome
• Users
Administration
• Access
• Rights
Project
A plugin architecture – easily adaptable to customer needs
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
• Identify
• Qualify
Manage
Requirements
• Design
• Details
Design Tests
• Environments
• Data Set
• Parameters
• Scripts
Manage data
• Run tests
• Automation
• Data sets
ExecuteTest •Manage Defects
•Reports
Evaluate
Import / Export Edit Reports
07/11/2010 9
Qualification Process & Salome TMF
Strategy / Plan
Requirements
Test Strategy
Schedule
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
Executions
Design
Results
Test Plan
DefectsRuns
Campaigns
Tests results
List of
defects
Test
Reports
End Test Project Report
07/11/2010 10
Qualification Process & Salome TMF (1/2)
xTraceability : Requirements <-> Tests <-> Defects during all along the tests process.
Requirements DefectsTests
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
Campaigns
Release /Data Environments
07/11/2010 11
Salome TMF
Central positioned in the life cycle
development
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
development
Adapt to
Agility, Rapid Developments, Short and iterative
cycles, connects to other open-sources
12
Positioning in the life cycle development
Requirements &Business General
Design
Acceptance TestBlack box
xUse by developments team for Units tests,
integration test, validation tests
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.07/11/2010 13
Technical GlobalTechnical GlobalDesign &
Functional DetailDesign
Technical DetailDesign & code
ComponentIntegration Test
Unit Test
SystemIntegration Test
Validation Test
Junit
Beanshell
Abbot
ScriptRunner
Sélenium
Connected to other project management tools
xConnected to Jira
� Fills in automatically Jira with defects detected during tests
campaigns run from Salome TMF
� Improve defects resolution and documentation
• Usage of development management tool
Link defect to release
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
• Link defect to release
� Make dialog easier between development team and tests team
xConnected to Redmine (3.2.2)
� Same objective than Jira
� Open source
� An open view for test project management & agility development
1407/11/2010
Salome TMF
2011
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
2011
�The next step
07/11/2010 15
The next step
xAdapt test project management for agility development
� Insert Agility vocabulary
� New concepts : user story, release, sprint…
� Monitored tests project
xNeed to move to a new architecture Web2 – V4.0
Needs CONTRIBUTORS
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
Need to move to a new architecture Web2 – V4.0
� To insure Robustness, reliability, respond time
� better integrate it with existing software engineering
tools
� An important release, too much works
07/11/2010 16
Salome TMF
Deployment examples
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
Deployment examples
�JDC
�Electronics payment solutions
07/11/2010 17
Jedeclare
xCustomer: Extelia,
� Outsourcing and dematerialization of documents and procedures
xProject: Scurried Web portal for social taxes
• VAT, taxes declaration,
xUseNumber
Tests cases
Equiv
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
xUse
� Requirements
� Test Plan
� Data management
• Parameters
� Run Selenium tests with Junit plugin
xShare tests, Save time for design tests
07/11/2010 18
Tests cases
Flow going 36 792 tests
Vat : 72
TDFC : 720
Return flow 16 152 tests
Andiamo – Electronic payment solutions
xCustomer: Accarda
� The market leader in Swiss for client cards
xProject: integration project of PowerCard from HPS
� Electronic banking
� Industrialize the qualification for electronic banking projects
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
� Industrialize the qualification for electronic banking projects
xUse
� Requirements
� Test Plan
� Automation with AQ Salome plug-in / AQ
xVolumetry
� 250 tests, 16 campaigns
07/11/2010 19
Industrialize the qualification for electronic
banking projects
xSimulate live environment of electronic banking
� Tests should be inserted inside the process banking
• Create card, card movements (purshases), bank compensation,
replenishment of account, batch
� Simulate a daily, monthly, annual process of banking
� Save time when running tests
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
� Save time when running tests
xVery complex process
� A huge task
� Manually Impossible
xProject requirements:
� Monitor the project of test progress
� Share tests information between stakeholders
07/11/2010 20
Industrialize integrations tools
xCreate a Qualification Automate linked with Salome
� Automatic execution of test cases related to a campaign
� Simulation of events in a IS
AQ Target
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.07/11/2010 21
x AQ-Actions solicit Target via entry points known as AQ-DataSources: Ex JDBC
connection, TCP, SSH, etc ....
x Each test case « AQ-Automatised » is composed with AQ-Actions.
Qualification Automate (AQ) 1/2
AQ-ActionTarget environment
AQ-DataSources
In Salomé TMF Test Plan
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
x An AQ-Action is composed by 2 distinct actions:
� Principal: generating a solicitation on the target system
� Check: checking results
x Two type of AQ-Action :
� Standard : integrated into the kernel of AQ
� Specifics: store in a database specific for the project (Library actions depending the project)
22
Target environmentCible
(AQ-Target)
AQ-Action
x When creating a test campaign, each AQ-action is scheduled in chronological
order (dates absolute / relative) or absolute order (encrypted)
Qualification Automate (AQ) 2/2
AQ-Action 1.1 AQ-Action 2.1 AQ-Action 1.3
Test Case 1
AQ-Action 1.2
Test Case 2
Test Campaigns
In Salomé TMF Campaigns
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
x An AQ-Action is identify by a Tag and a parameter list which will be
transformed by AQ when running an Execution
Example :
SQL ( &SQL, ListeDesCartesInvalides.sql, TRACE, 123 )
23
AQ-Action 1.1 AQ-Action 2.1 AQ-Action 1.3
scheduling
AQ-Action 1.2
TagParameters
Description
Attended Result Check
Tag
AQ-Salome Plugin
x Interface AQ with Salome
� Design tests case
� Specify parameters for AQ
� Organize campaigns, chronological order
� Launch , Stop executions
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
� Choose the AQ target (which env. Is involved?)
� Visualize results & log
x Link between AQ and Salome is established by messages:
� Status of running execution
� Launch executions (AQ-Execution)
� AQ-Execution status: running, satisfied, or not…
x After analyze, can modify results (success, ko, generate Defects)
24
Salome and AQ: Industrialize the
qualification for electronic banking projects
xSuccess of the project:
� Integration test project finished in time
� Quality was good
� Capitalization for next releases
� Regression test
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
� Regression test
xVery complex process can be simulated
� Could be use to simulated complex process
� Adaptable to other context
xSalome TMF a plugin architecture
� Very useful and simple to adapt to its needs
07/11/2010 25
Help and support from Acpqualife
xServices tests offer
xDevelopment
Forfaits MigrationIntegration Tests Forfaits IntegrationInstallation packages
MaintenanceSpecifics Developments
Tooling Customization
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
xTraining
xSupport
xSalomé +
MaintenanceSpecifics Developments
Salome’straining
Silver Gold Platine
AQ Salomé Plugins +
Salome TMF
Annexes
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
Annexes
�Salome Screen shot
�AQ Salome screen shot
� Release V4
07/11/2010 27
Requirements
xDefine Requirement with its description and risk analysis
� Category : functional, Security, …
� Priority (from business), complexity (from iT)
� Status requirement : to validate, validate, …
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.Salomé-TMF –– p28
Requirements Coverage
x…..
1 – Select a
requirement tree
2 – Tests coverage
Reqs
Campaigns
Tests
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
3 – Percent of
coverage
Salomé-TMF –– p29
Requirements satisfactions
xSatisfaction: Analyse the result of execution
� Percent of tests with last execution = passed
Reqs
Campaigns
Tests
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
Percent of tests passed on total of
tests needs for the coverage
Salomé-TMF –– p30
Test Plan
xDesign tests : organize by Family and suite
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.Salomé-TMF –– p31
Test Plan
xDesign step
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.Salomé-TMF –– p32
Manage Campaigns
xOrganize Campaigns, Executions, Visualized defectsCampaigns
Tests Defects
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.Salomé-TMF –– p33
Defects linked to the campaign
Manage Campaigns : Run a test
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.Salomé-TMF –– p34
Defects with plugin Jira
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.35
Salomé-TMF –– p35
Defects with plugin Mantis
x Manage Defects
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.Salomé-TMF –– p36
Manage data
xOrganize parameters in logical environments
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.Salomé-TMF –– p37
Reports
xGenerate reports
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
rapportmultiframe.html
Salomé-TMF –– p38
AQ Plugin: Define integration
environnement
xDefine AQ-Targets et AQ-DataSources
� Where to play Where to store
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.07/11/2010 39
AQ Plugin: Define tests in test plan
xDesign tests: type = AQ Automated
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.07/11/2010 40
Create AQ-Action
Tag with parameters:
Function store in AQ
which will be run during
campaigns
Salome TMF: ReleaseV4
Impacts Benefits
3-tier architecture Single deployment, easy upgrade, increased
performance (relative to the model applets)
either in time or memory consumption
Layered architecture Robustness, modularity, Maintenance,
Automated Testing
Modern Architecture Promotes the participation of committers to the
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.07/11/2010 41
Modern Architecture Promotes the participation of committers to the
project
Service layer based on Spring Including simplified transaction management
which will ensure consistency and data integrity
Data Access Layer Multi Data base
Presentation layer with GWT
2.1
Promotes the participation of committers to the
project (more modern technology), cross-
browser, Web 2.0 GUI modern and light, GUI
testable via Selenium
Release V4 : Architecture
xPhysical architecture
xLogical architecture
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
xLogical architecture
07/11/2010 42
Presentation layer
Logical layer
Datalayer
Organisation
x Speaker� Véronique Théault – Acpqualife
� Associate Director in charge of qualification offers
Rich experience of 11 years in IT companies, having held various positions in management development, Veronique Théault specializes in software testing. A challenge and a passion which led in 2002 to create and animate, with Marc Durupt, the company Qualife, specialized in the trades of the test.
• Email : [email protected]
OW2 Annual Conference 2010, November 24-25, La Cantine, Paris.
www.ow2.org.
• Email : [email protected]
• Phone: +33 (0)6 88 78 02 14
• Other contact : Delphine Huon [email protected] +33 (0)6 87 08 59 08
� Acpqualife• 900, rue Ampère Pôle d’activité d’Aix en Provence
13851 Aix en Provence Cedex 03
• Phone: +33 (0)4 42 91 42 99
xTitle : Salome-TMF a Test Management tool that connects the tests team to those of development
07/11/2010 43