19
©Neotys. All Rights Reserved. Neotys White Paper – Dynatrace Integration with NeoLoad Dynatrace Integration with NeoLoad A Neotys Whitepaper
©Neotys. All Rights Reserved.
Neotys White Paper – Dynatrace Integration with NeoLoad
Dynatrace Integration with
NeoLoad A Neotys Whitepaper
2
Neotys White Paper – Dynatrace Integration with NeoLoad
Table of Contents
Introduction ........................................................................................................................................... 3
NeoLoad Custom Actions .................................................................................................................... 3
Dynatrace API Token ............................................................................................................................ 5
Dynatrace Tags ..................................................................................................................................... 6
Using the Dynatrace Plugin ................................................................................................................. 7
Test settings in NeoLoad ..................................................................................................................... 7
Identify the Load Testing Traffic in Dynatrace (tagging the traffic) ................................................. 9
NeoLoad Web Subscription ............................................................................................................... 12
Where Will I Find NeoLoad Metrics in Dynatrace? .......................................................................... 12
Where will I find Dynatrace metrics in NeoLoad? ........................................................................... 17
About Neotys ....................................................................................................................................... 19
3
Neotys White Paper – Dynatrace Integration with NeoLoad
Introduction By Henrik Rexed, Partner Solution Advocate As you may know, NeoLoad has an integration with several APM products on the market today:
• Dynatrace AppMon • AppDynamics • CA APM • NewRelic
Dynatrace
It has been two years since Dynatrace has released their current platform with built-in AI engine. While seeing the demonstration of their newest version, I suddenly imagined the value of their AI during a load test. To be clear though, I hadn't augmented our existing AppMon integration, because of my obsession with Dynatrace AI. After using NeoLoad SDK and a few lines of code, I had the new version of the Dynatrace integration in front of me. I proceeded to conduct a few tests with Andreas Grabner. I was impressed by Dynatrace's capacity to identify problems/bottlenecks during a load test. For more details on the test done with Andreas, I suggest you to watch this Dynatrace perfclinic. Step by step, you will know how you could take advantage of the new integration of Dynatrace. Dynatrace allows several options to build load testing integrations:
• Bidirectional metrics sharing between load testing platform and Dynatrace • “Tagging” of web requests generated
The new version of the NeoLoad/Dynatrace integration is available here, and takes
advantage of all the options provided by Dynatrace.
Let’s see how you could take advantage of this new integration.
NeoLoad Custom Actions First, you need to download the 2 Dynatrace plug-ins:
• DynatraceMonitoring : This plugin will retrieve data from Dynatrace in NeoLoad and
4
Neotys White Paper – Dynatrace Integration with NeoLoad
send NeoLoad metrics to Dynatrace.
• DynatraceEvent : This plugin sends custom events in Dynatrace on each service used by the application. Each event will have the details of the test: NeoLoad Scenario name / NeoLoad project / NeoLoad test name
Like every custom action provided in our Github account, you will need to store them in the following directory: <NeoLoad Installation folder>/extlib or if you want to link it to a specific project: <neoload project>/lib/extlib Once restarted you will find the Dynatrace plugin in the logical action tree view:
Then, you will have to configure the Dynatrace plugin by setting the following parameters:
5
Neotys White Paper – Dynatrace Integration with NeoLoad
The Dynatrace plugin requires to have:
• The Dynatrace API token • The account ID if you are using a Dynatrace live environment • The hostname of your managed environment • Dynatrace tags
Dynatrace API Token In order to let NeoLoad sends statistic to Dynatrace, you will need to generate a Dynatrace API Token:
• In Settings, go to the Dynatrace API from the integration menu. • You will need to generate a new API for the usage of the Dynatrace integration.
6
Neotys White Paper – Dynatrace Integration with NeoLoad
Dynatrace Tags The Dynatrace plugin is sending information to every service having specific tags. I recommend to define tags for each service used by the application. In order to create manual tags, you will have to select:
• Transaction and Services • Select each service used by your application • Click properties and tags • Create new tag
7
Neotys White Paper – Dynatrace Integration with NeoLoad
Using the Dynatrace Plugin The Dynatrace plugin will require a dedicated UserPath having:
• In the action block: o DynatraceMonitoring action o The pacing of the action container needs to be set at 30s minimum (API calls
limitation set by Dynatrace)
• The end container o DynatraceEvent action
Test settings in NeoLoad
8
Neotys White Paper – Dynatrace Integration with NeoLoad
Because the Dynatrace integration will be executed within a UserPath, you need to define one population containing your “Dynatrace” user.
If you want to use the Dynatrace integration during a load test you have to include the “Dynatrace population” with the following settings:
• Duration: same duration than your test • Load Variation policy: Constant Load with one virtual user • Load generator used for the Dynatrace population: Localhost
9
Neotys White Paper – Dynatrace Integration with NeoLoad
Identify the Load Testing Traffic in Dynatrace
(tagging the traffic) Similar to Appmon, Dynatrace is able to identify the synthetic traffic generated by load testing solutions based to http header information. The main difference with Appmon is that Dynatrace is not forcing fixed headers. It is possible to define custom tags in the headers, post parameters etc. In order to be able to use Dynatrace following features it is required to configure the “request attributes” mechanism in Dynatrace:
• purepath • service flow
1. Request NeoLoad to add the Dynatrace headers in every http request generated: In NeoLoad, go to preferences/Project settings/Dynatrace and check the “enable Dynatrace information”
10
Neotys White Paper – Dynatrace Integration with NeoLoad
• NeoLoad will generate the following headers:
x-dynaTrace: SI=NeoLoad; VU=0;SN=EasyTravel_Search&booking;PC=/;ID=8;NA=Actions.Home+Page.;GR=Default zone;TE=Dynatrace_PerfClinic-Check-EasyTravel_Search&booking-58438-1508488063328 The header information included in the x-dynatrace parameter is the one required by Appmon’s old integration. We are going to take advantage of the similar information but we have to configure Dynatrace to detect the information sent by NeoLoad. 2. Define the request attributes In Dynatrace: From the header sent by NeoLoad, we will limit the configuration on the most useful information:
• the NeoLoad UserPath name -> SN • The Load testing solution name -> SI • the transaction name -> NA • Load generator location (useful if you are generating load from the cloud) -> GR • request generated by NeoLoad -> PC
To configure request attributes rules in Dynatrace, you will have to go to: • Settings / server-side service monitoring
11
Neotys White Paper – Dynatrace Integration with NeoLoad
• Create a rule for each piece of information sent by NeoLoad:
• Request attribute source: Http request header • Parameter name: x-dynatrace • Preprocess by extraction substring: between:
12
Neotys White Paper – Dynatrace Integration with NeoLoad
o NA= and; (for getting the NeoLoad transactions) o SI= and; (to detect NeoLoad traffic) o SN= and; (to detect the userpath name) o GR= and; (to detect the load generator zone of the virtual user)
NeoLoad Web Subscription The Dynatrace plugin is using NeoLoad web API to send statistics to Dynatrace such as :
• user load • hit/s • average request duration • average transaction response time • Number of failures • Downloaded bytes • Downloaded bytes/s • Iteration in Failure • Iteration in sSuccess • Request in failure • Request in success • request in success/s • request in failure/s • failure rate • Transaction in success • Transaction in failure • Transaction in success/s • Transaction in failure/s
It means that the Dynatrace integration requires:
• NeoLoad license with the following module: • Integration (to receive Dynatrace data) • Dynatrace module (for the request tagging) • NeoLoad web Module
• A NeoLoad web subscription • A Dynatrace account
Where Will I Find NeoLoad Metrics in Dynatrace? NeoLoad custom metrics: In order to see the NeoLoad metrics in your Dynatrace dashboard, you will have to:
13
Neotys White Paper – Dynatrace Integration with NeoLoad
• Create custom charts:
All the NeoLoad data are prefixed with « NeoLoad ». You will be able to find them by typing in the “build chart” drop down list. If you select the metrics you will be able to find the NeoLoad data:
14
Neotys White Paper – Dynatrace Integration with NeoLoad
If you click on “show details”, you will be able to reach the NeoLoad web dashboard related to the data display in your dashboard. In order to analyze your data, creating a dedicated dashboard would make you life easier. This dashboard will combine:
• NeoLoad metrics • Problems • Any technical details on the behavior of architecture.
All the traffic tagged will be available in:
• Transaction & services • Select dynamic request • select the request attribute tab
15
Neotys White Paper – Dynatrace Integration with NeoLoad
By selecting one of the NeoLoad transactions, then you will then be able to take advantage of:
• purepath • service flow
NeoLoad custom Events
16
Neotys White Paper – Dynatrace Integration with NeoLoad
At the end of the test, DynatraceEvents is creating a custom event on each service used by the application. If you want to see those events, you simply have to open the details of one of your services.
17
Neotys White Paper – Dynatrace Integration with NeoLoad
Where will I find Dynatrace metrics in NeoLoad? The Dynatrace metrics retrieved by the DynatraceMonitoring action is limited to technical metrics on:
• Services • Infrastructure
All the retrieved Dynatrace data would be available in NeoLoad in Graphs/External data.
18
Neotys White Paper – Dynatrace Integration with NeoLoad
19
Neotys White Paper – Dynatrace Integration with NeoLoad
About Neotys The success of your digital strategy relies on your ability to deliver fast and reliable software, regularly. Creating great software quickly, using an optimized performance testing process is your competitive advantage – Agile and DevOps are part of the solution. Neotys has over 12 years of development investment into NeoLoad – the performance testing platform designed to accelerate Agile and DevOps processes. It’s built by engineers who recognized that in order to achieve their own Agile adoption objective, they needed to create a product that could facilitate superior load and performance testing continuously. The end result – up to 10x faster test creation and maintenance with NeoLoad. We truly believe that the Performance Engineer can become the critical application performance partner providing the best testing coverage while respecting the cadence of the Continuous Delivery process. As performance becomes the responsibility of the wider team, continued delivery of an optimized performance testing platform is what drives our work every day. For more information about Neotys and NeoLoad visit: www.neotys.com or contact [email protected]
Neotys and NeoLoad are registered trademarks of Neotys SAS in the USA and others countries. All other trademarks are the property of their respective owners. Copyright © Neotys. All rights reserved. No reproduction, in whole or in part, without written permission.
