The Four Essential Elements of LSEG QA Solutions 

Exactpro11 November 2015

Quality Assurance & Related Software Development for Innovative Trading SystemsTel: +7 495 640 2460, +1 415 830 38 49www.exactpro.com

2

FrAgile Process

Crowd-sourced Testing

Formal Verification Methodologies

Cognitive Technology

Quality Assurance Trends

Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

3

FrAgile Process

Test is DeadIdeas before ProductsHappy Software DevelopersSoftware Engineer in Test

Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

4

Crowd-Sourced Testing

Immediate Feedback from Diverse User BaseInstrumentation is Required to Process Data

Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

5

Formal Methods

Model CheckingTheorem ProvingStatic AnalysisVerification

http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?id=2006-001A

Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

6

What’s Next?

Can We Learn from Other Industries?

Be Both Faster and Safe

Who Had the Most Severe Problems with Technology?

Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

7

Proposed Approach

Build Software to Test Software

Test Tool Sophistication should Match Platform’s Complexity

Testability is Required

Parallel Stream for Test Harness

The Software will Break Anyway

A Good Robot is Required to Survive in Robot Apocalypse

Summer Glau – The Sarah Connor ChroniclesGrace Park - Battlestar Galactica

Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

Active Testing Tool to Simulate Transaction Flow

Orders

Trades

Market Data

• Tibco• IBM MQ• jDBC• TCP• HTTP• SOAP• FTP• FTSE• Reuters• Fidessa• EMAPI• QuantHouse• MillenniumIT• SOLA• ASTS• GATElab

• FIX and dialects, • including 4.2, 4.3, 4.4, 5.0• FIXML• ITCH• FAST• ISO SWIFT

Configurable Multi-Protocol Test Connectivity

Clear and Simple CSV-based Test Case Format

Drop by Drop Turns into a Mighty Regression Library

Keyword Driven Testing

Automated Test ExecutionBig Button Framework

Unattended Test Runs for Continuous Integration

User Friendly Web Front-End

Report reflects the Difference Between an Expected Outcome and an Actual

Expected vs. Actual

Purifying & Cleansing 

Sailfish is like WATER

Foundation of the Electronic Trading Architecture

Complex Operational Schedules 

Identify and Exterminate Pests

Built-in Schedule Support

Step by Step Testing

Industry-Standard Solutions

• SWIFT• HTTP• SOAP• FTP• MQ• ISO 20022• etc.

ClearTH is like EARTH

Simulate Algo Traders’ Behaviour

Subscribe to Market Data

Use Trading Systems to Test Trading Systems

Simulate Low-Latency Execution Environment

• Powerful• Scalable• Realistic• Multi-Threaded• Java Agents

Dashboard to Monitor Trading Algorithms

Gather Execution Efficiency Stats

Run your Platform alongside with Test Algos

Reference Test Harness for Trading Algorithms

Will Your Platform Melt at the Confluence of Functional and Non-Functional Testing?

Trigger Minirobots and Illuminate the Hidden Defects

Minirobots are like FIRE

• Passive testing is a software testing technique that observes the system without interaction.  

• Passive testing tool doesn't generate any messages itself. It captures the traffic and stores it for analysis.

• Shsha is a tool that can gather all the evidence you need. Invisible to the system under test, it raises testing efficiency to a different level.

• Post-transactional tool• Analyzes clients' activity • Parses and displays logs in a user-friendly way• Parses messages and then puts each to a data base table where each column corresponds to each message field• Allows making summarized reports, etc.• Easy to understand GUI

Incoming signals FIX and dialects: FAST, SWIFT, ITCH, HTTP, SOAP

Use of Shsha:• Load results analysis, NFT metrics• Toxic issues investigation• On-boarding client certification• Market Surveillance

Target SUT:• Trading Platforms,• Market Data Delivery• Post-Trade Systems• Surveillance systems• Audit and regulatory requirements

Client Onboarding

Fast, Clear, and Weightless

Shsha is like AIR

Build Software to Test Software