Post on 22-Feb-2018
transcript
Manuel HoßfeldLeitender Systemberater, Business Unit Database TechnologiesOracle Deutschland B.V. & Co. KG
Application Quality Management /Application Performance Management
Einleitung: APM / AQM – Worum geht’s?Annahme: Grundsätzliches Performance-Monitoring ist
da und funktioniert auch, aber meistens... rein Server-basiert reaktiv nur rückblickend
Idee: Wie wäre es wenn man.. ...die Perspektive des Endbenutzers berücksichtigen könnte? ...proaktiv geplante Veränderung testet bevor sich diese negativ
auswirken können? ...Monitoring, Analyse und Testing kombiniert einsetzen könnte -
„End to End“?
APM mit RUEI(Real User Experience Insight)
Business <-> IT „Disconnect“
What the business wants to know • How many users accessed my application in last x days?• How come only 1 out 8 people visiting the process actually logged a service request?• Which customers/partners did the orders come from?• What percentage of these orders did I process correctly and if an error occurred – what
error?
What IT can only respond with • The application was up 99% of the time• We had 200 concurrent sessions at peak load• Every server and service in the order management application met it’s performance and
availability SLA• When faults were logged, we are able to resolve them within 2 hours
User Experience Challenges
User Experience Management: 2 Approaches
2
True User Performance, all users, 24/7
Complete Session Reporting /Replay
Total application Coverage, all functions
Trend reporting, defined user
Service Availability Reporting
Cover many protocols / technologies
Recorded Sessions
1
Real User Monitoring
Synthetic Monitoring
Page response 2
Real User Monitoring: Session Capture
Client IP & Location
Requested URL
Cookie / Session ID
Source URL / POST & GET information
Response / Time?
TCP Status, Server Err, Website Err, etc
Content Scan of Body/Header
Delivered / Time?
User Abort
Network Timed Out
Page request
1
Browser Acks
3
Real User Experience Insight Reporting
• Geo-location Reporting• Enterprise Manager console data presentation• Executive dashboards• Extensive KPI and SLA monitoring• Full alerting capabilities
Some highlights
• Replay of Full User Sessions• Integrated Diagnostics• User Flow performance analyses• Customized reporting• Trend analyses• Full data integration with Oracle business Intelligence
Real User Experience Insight ReportingSome highlights
AQM mit ATS (u.a.)
(Application Testing Suite)
AQM Lösungen von Oracle
Testing Application Changes
Testing Infrastructure Changes
Test Data and Lab Management
Oracle Functional
Testing
Oracle Load
Testing
Oracle Test
Manager
SQL Performance Analyzer
Application Replay
Data Discovery and Modeling
Data Subsetting
Database Replay
Data Masking
New
New New
Oracle Application Testing Suite (ATS)
• Powerful, integrated solution for ensuring application quality.
Oracle Functional Testing
Oracle Test Manager Oracle Load Testing
• Supports: • Functional/regression testing• Load/Performance testing• Test Management• Web, Siebel, EBS/Forms, ADF, Adobe ® Flex, Database & WebServices
• Reduce scripting time by ~50%
Oracle Application Testing Suite 9.3
• Automatic script generation• Load/Performance test Scripts generated using RUEI and Real Application Testing
• Smart integration with EM Diagnostics• JVM Diagnostics for mid-tier
• DB Diagnostics for DB-tier
• DB Profiles for Oracle Database
Oracle OpenScript (ATS)
Mo
du
lesOpenScript
WebLoad
Functional
SiebelLoad
Functional
FORMSLoad
Functional
ADFLoad
Functional
????
Eclipse Platform
OpenScript Framework (API)
Fo
un
datio
n
…
Web
Services
Load
Functional
Existing JAVA Know-how
can be used to create
OpenScript modules...
-Adding functionality or
protocols to the platform
OpenScript
Graphic or Code View – Your ChoiceGraphic or Code View – Your Choice
Tester Perspective (Default)
Details View
Results View
Script View
Snapshot
Details View
• Provides additional info on script & playback results
• Info linked to nodes in Tree View• Page / window screenshots • Browser / HTML content• Request / Response headers
• Info linked to nodes in Results View• Script playback Results Report• Results for individual script nodes (screenshots, HTML,
headers)• Comparison view of record results vs. playback results
Results Report
Comparison
Functional Testing (ATS)
Oracle Functional Testing
Key Benefits
• Single unified scripting platform based on Oracle OpenScript
• JAVA/Eclipse based IDE
• Different perspectives/views• Non-technical users (GUI, declarative)• Technical users (JAVA code UI)
• Support for Web 2.0, SOA and Oracle applications
Easy to use, best-in-class functional test automation tool
OpenScript Data Table
Key Benefits
• Easier way to work with data driven scripts
• Manipulate test datafrom within OpenScript
New
Spreadsheet-like data table for Functional test scripts
OpenScript Object Details View
Key Benefits
• Structured view of all the objects of the selected modules, such as
• DOM tree of html pages• ADF UI Components tree for ADF applications• Forms element tree of a forms applications
• Accelerates viewing the object path, adding tests, and saving objects to an object library.
New
Accelerate working with objects and adding tests
Optimized testing for Oracle Applications
OpenScript
Web
ServicesFusion/
ADF
EBS/
FORMS
SiebelWeb Database Adobe ® Flex ®
Accelerators
Application Testing Suite Testing Accelerators
Automatic script creation for Oracle Applications
• ”Zero” effort load script creation for Oracle Applications
‒ No need to record scripts manually
• Support for Oracle e-Business Suite, Siebel, JD Edwards...
• Export real user sessions from Oracle Real User Experience Insight (RUEI) as Load scripts for Oracle Load Testing for realistic scenarios or synthetic testing of user sessions with issues...
Generate load test scripts from RUEI
Load Testing (ATS)
Oracle Load Testing
Key Benefits
• Oracle infrastructure included • Weblogic 11g• Oracle 11g Enterprise Edition
• Scalable automatic content validation
• Comprehensive performance monitors
• Web-based reporting interface• Easy to use real-time data views• Extensive analysis capabilities
Eliminate performance bottlenecks in your applications
Oracle Database and Java DiagnosticsOracle Enterprise Manager integration to Oracle Load Testing
Level 3: Measure Server-Side Transaction Performance with EM diagnostics
Level 2: Measure Infrastructure Performance under load with ServerStats
Level 1: Measure End-User Performance under load
Oracle Database Diagnostics Integration
Key Benefits
• Oracle Load Testing integration with Oracle Diagnostics Pack for Oracle databases
• ADDM & AWR reports directly in the Oracle Load Testing console
Easier database related trouble-shooting during load tests
New
Load testing – finding your bottlenecks...
Oracle Database
Application Under Test Oracle Load Testing
Monitoring the performance with Enterprise Manager
Bottlenecks are frequently found in the database tier (especially for packaged applications).Oracle Load Testing offers a unique integration into Enterprise Manager to simplifyidentification of these bottlenecks and automatic advice on how to address them.
• Tuning requires expertise and is time consuming• Performance and Workload Data Capture
• System Statistics, Wait Information, SQL Statistics, etc.
• Analysis• What types of operations database is spending most time on?
• Which resources is the database bottlenecked on?
• What is causing these bottlenecks?
• What can be done to resolve the problem?
• Problem Resolution• If multiple problems identified, which is most critical?
• How much performance gain is expected if ….???
Tuning Challenges
Run a load test against your application...
Monitor application through EM and OLT...
The tested applications database CPU load is high. This is seen in Oracle Load Testing’s ServerStats monitoring or external solutions like Oracle Enterprise Manager Grid Control
Access diagnostics reports from OLT
After the load test is completed:
The Automatic Workload Repository (AWR) and the Automatic Database Diagnostic Monitor (ADDM) reports for the selected session is loaded in the OLT console.
‒ AWR report provides a detailed
report of the statistics collected during the load session
‒ ADDM report analyzes snapshots taken by the AWR during the session to identify potential performance bottlenecks
Identify, impact, cause, recommendation...
ADDM report findings and Recommendations----------------------------
Finding 1: Hard Parse Due to Literal UsageImpact is .85 active sessions, 84.84% of total activity.--------------------------------------------------------SQL statements were not shared due to the usage of literals. This resulted inadditional hard parses which were consuming significant database time.
Recommendation 1: Application AnalysisEstimated benefit is .86 active sessions, 84.84% of total activity.-------------------------------------------------------------------ActionInvestigate application logic for possible use of bind variables insteadof literals.ActionAlternatively, you may set the parameter "cursor_sharing" to "force".
Identifies the performance bottlenecks
Estimates the impact of the problem
Drills down to the root cause
Gives recommendations & suggests the estimated
benefit
Provides specific actions to correct the problem
Weitere Informationen
• Application Quality Management im OTN:http://www.oracle.com/technetwork/oem/app-quality-mgmt/index.html
• Application Performance Management im OTN:http://www.oracle.com/technetwork/oem/app-performance-mgmt/index.html