Troubleshooter´s Top 5: Real-world performance tuning of IFS Applications

transcript

REAL-WORLD PERFORMANCE Troubleshooters Top 5—Real-world performance tuning of IFS Applications

Evolution

Configuration

Toolbox

Top 5—performance issues

Questions

AGENDA

JONAS GÖRANSSON Principal Systems Engineer Worked for IFS since 1993 IFS Consulting, IFS R&D

STEFAN LÖVGREN Principal Systems Engineer Worked for IFS R&D since 1999

WHO WE ARE

IFS BENCHMARK TEAM Sizing of IFS Applications (IFS Sizing Guides) Performance testing (development & customer-initiated tests) Customer performance issues (support)

WHAT WE DO

EVOLUTION

ERP SYSTEM EVOLUTION

Different architectures, more complex, more functionality and more integrations.

IFS APPLICATIONS EVOLUTION

Easy installation with less configuration

Automatic and self-managed RDBMS

No magic initialization parameters

ORACLE EVOLUTION

16-bit 32-bit 64-bit technology, Memory KB TB

Clock frequency has increased from some MHz to several GHz

Low-end servers cover high-end demands

HARDWARE EVOLUTION

Hardware – Low-end servers cover high-end demands

Software – Increased robustness

Architecture complexity – Distributed systems makes troubleshooting harder

EVOLUTION SUMMARY

CONFIGURATION

HARDWARE

CPU Memory

Disk Network

Computer performance

CONFIGURATION

Web server App server DB server

Database processes Server threads

Integration queues Connection threads

Clients

Work load

TOOLBOX

Get an overall picture from the complete system under normal conditions

MONITORING

OPTIONAL PRINT

Hardware resources as well as application

Keep historical monitoring data as reference

Specific tools for every part of the system

From overview to detail

MONITOR

System resources

Application server

Database

Oracle Enterprise Manager (OEM)

Oracle Workload Repository (AWR)

Free Oracle tools: SQL trace, trcsess, tkprof, Trace Analyzer

3rd party programs: Spotlight, Insider, MyOra

Open Source

In-house admin scripts

Holistic approach

Be open-minded

Don’t be biased—the problem can be the unexpected

Don't change more than one thing at the time

Top-down problem-solving

METHODOLOGY

Problem definition—define not solve

Identify the problem

Trace to source—trail backwards

Is this the root cause of what is generating the problem?

Do the solution have unforeseen consequences?

Don’t assume that problem is solved until verified

TOP-DOWN PROBLEM-SOLVING

TOP-5 PERFORMANCE ISSUES

Misconfiguration

Parameters

TOP-5 PERFORMANCE ISSUES

Non-optimal SQL and PL/SQL code

IN clauses with sub-queries

Excessive commits

TOP-5 PERFORMANCE ISSUES CODE

Queries not using index

Queries using wrong index

Too many indexes on table

TOP-5 PERFORMANCE ISSUES INDEX

Use the Advanced button to show which columns

are indexed.

Green arrow = indexed Red arrow = not indexed

The Match Case checkbox can be unchecked if you

don’t know whether capitals or lower case letters are

used, but…

…the upper() SQL function in the SQL clause prevents use

of indexes.

Count of ”Cancelled historical order

lines”

Hot parts / blocks

Number generation, sequences

Legal demands, non-broken number series

TOP-5 PERFORMANCE ISSUES LOCKS

TOP-5 PERFORMANCE ISSUES LOCKS—HOT PARTS

1, Purchase order scenario

3, User load profile

2, User load details

Database Locks

Increasing user load

Increasing response time

Stagnating and decreasing CPU

TOP-5 PERFORMANCE ISSUES LOCKS—HOT PARTS—COMPARE COLD PARTS

Purchase Orders using 2000 parts total Purchase Orders using 10 parts total

CPU % Response time

Unbalanced configuration Planning/purchasing new infrastructure Adding infrastructure Extreme load profile

TOP-5 PERFORMANCE ISSUES MISCONFIGURATION

System change

IFS well working system

Introducing web server For DMZ or other

purpose

Loadrunner loadtest 1-200 users

Original configuration Changed configuration

CPU % Response time Transactions/sec

purpose

CPU % Response time Transactions/sec

Original configuration Changed configuration

shared_pool_size

db_cache_size

sga_max & sga_target

pga_aggregate_target

processes

optimizer_index_cost_adj

undo_retension

TOP-5 PERFORMANCE ISSUES—PARAMETERS

TOP-5 PERFORMANCE ISSUES PARAMETERS—OPTIMIZER_INDEX_COST_ADJ

optimizer_index_cost_adj=10

optimizer_index_cost_adj=1000

SUMMARY

Balance infrastructure against workload

Monitor all components in the system

Have a prepared toolbox

SUMMARY

THIS DOCUMENT MAY CONTAIN STATEMENTS OF POSSIBLE FUTURE FUNCTIONALITY FOR IFS’S SOFTWARE PRODUCTS AND TECHNOLOGY. SUCH STATEMENTS OF FUTURE FUNCTIONALITY ARE FOR INFORMATION PURPOSES ONLY AND SHOULD NOT BE

INTERPRETED AS ANY COMMITMENT OR REPRESENTATION. IFS AND ALL IFS PRODUCT NAMES ARE TRADEMARKS OF IFS. THE NAMES OF ACTUAL COMPANIES AND PRODUCTS MENTIONED HEREIN MAY BE THE TRADEMARKS OF THEIR RESPECTIVE OWNERS.

www.IFSWORLD.com

Troubleshooter´s Top 5: Real-world performance tuning of IFS Applications

Technology