PostgreSQL - Blue Medora · PDF file2.2 Data the Management Pack Collects ... metrics for...

VMware Vrealize operations ManageMent pack For

PostgreSQL

User Guide

2 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide

NOTE: This document supports the version of each product listed, as well as all subsequent versions, until a new edition replaces it.

You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.

The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].

1. Purpose...................................................................................................................................................................... 32. Introduction to the Management Pack....................................................................................... 3

2.1 How the Management Pack Collects Data............................................................. 32.2 Data the Management Pack Collects........................................................................... 32.3 Inventory Tree (Traversal Spec)........................................................................................... 3

3. Dashboards............................................................................................................................................................ 43.1 PostgreSQL Overview.................................................................................................................. 43.2 PostgreSQL on OS.......................................................................................................................... 53.3 PostgreSQL on VM......................................................................................................................... 63.4 PostgreSQL IOPS............................................................................................................................. 73.5 PostgreSQL Top-N Queries.................................................................................................... 8

4. Views............................................................................................................................................................................. 95. Reports....................................................................................................................................................................106. Alerts..........................................................................................................................................................................117. Troubleshooting the Management Pack................................................................................12

7.1 Troubleshooting an Adapter Instance.......................................................................127.2 Testing Connection Failures................................................................................................127.3 Viewing System Log Files.....................................................................................................13

8. Appendix I: Metrics.....................................................................................................................................149. Appendix II: Alerts........................................................................................................................................20

taBle oF contents


1. purposeThe Blue Medora VMware vRealize Operations (vROps) Management Pack for PostgreSQL User Guide describes the primary features of the Management Pack for PostgreSQL, including dashboards, views, reports, alerts, and metrics that allow users to optimize the monitoring and management of PostgreSQL resources from within vRealize Operations.

2. introduction to the Management packThe Management Pack for PostgreSQL is an embedded adapter for vRealize Operations (vROps) that monitors PostgreSQL database systems remotely by creating a JBDC connection to retrieve performance data regarding PostgreSQL resources.

This section includes the following topics:

• How the Management Pack Collects Data• Data the Management Pack Collects

2.1 How the Management Pack Collects Data

During each data collection cycle, the Management Pack opens a JDBC connection to the specified PostgreSQL database instance and queries it to retrieve resource metrics.

The collection interval for the adapter instance resource determines how often the Management Pack collects data. The default collection interval is five minutes.

2.2 Data the Management Pack Collects

The Management Pack can collect performance data, relationships (associations), and events for the following PostgreSQL resources:

1. PostgreSQL Adapter Instance 2. PostgreSQL Instance 3. PostgreSQL Database 4. PostgreSQL Table • Indexes (if disabled, index and trigger instance metric groups will not be returned)

5. PostgreSQL Function (requires ‘pg_stat_user_functions’ to be enabled)

6. PostgreSQL Query (requires ‘pg_stat_statments’ to be enabled)

2.3 Inventory Tree (Traversal Spec)

The Inventory Tree (Traversal Spec) feature within vROps allows you to easily navigate your PostgreSQL environment. The hierarchical structure implicitly shows relationships among resource kinds and enables quick drill-downs to root-cause issues.

Figure 1: PostgreSQL Architecture

Figure 2: Example Traversal Spec


3. DashboardsDashboards are the primary user interface that allow users to monitor PostgreSQL resources from within vRealize Operations.

The following dashboards are available in the Management Pack:

• PostgreSQL Overview• PostgreSQL on OS• PostgreSQL on VM• PostgreSQL IOPS• PostgreSQL Top-N Queries

3.1 PostgreSQL Overview

The PostgreSQL Overview dashboard displays heat maps depicting the overall health of PostgreSQL databases. Figure 3: PostgreSQL Overview Dashboard


3.2 PostgreSQL on OS

The PostgreSQL on OS dashboard allows you to select a PostgreSQL database and related operating system in order to view key performance metrics (KPIs) for each. Figure 4: PostgreSQL on OS Dashboard


3.3 PostgreSQL on VM

The PostgreSQL on VM dashboard allows the user to select a PostgreSQL database and related virtual machine to view key performance indicators (KPIs) for each.

Figure 5: PostgreSQL on VM Dashboard


3.4 PostgreSQL IOPS

The IOPS dashboard allows the user to select a PostgreSQL database to view IO stats for the related database, virtual machine, and datastore.

Figure 6: PostgreSQL IOPS Dashboard


3.5 PostgreSQL Top-N Queries

The Top-N Queries dashboard allows the user to select a PostgreSQL database to view a ranking of the Top 10 slowest queries. The dashboard also allows you to select individual queries from the heat map to view performance metrics for the selected query.

Figure 7: PostgreSQL Top-N Queries Dashboard


4. ViewsThe vROps Management Pack for PostgreSQL contains custom views, which allow the user to view statistics of metrics for PostgreSQL resources. Views provide a “big picture” look at resources, as opposed to a more in depth view.

Table 1: PostgreSQL Views

VIEw TyPE DESCrIPTION

PostgreSQL Database Overview List Provides a overview of database performance metrics.

PostgreSQL Instance Overview List Provides an overview of instance performance metrics.

PostgreSQL Slowest Queries List Provides a list of slowest queries metrics.

PostgreSQL Throughput List Provides a list of throughput metrics.

To access the Management Pack views, go to Environment > PostgreSQL and click the desired Object (resource kind). Select the Details tab, then Views. Select the desired view from the list to populate the statistics below.

For the full list of views for the Management Pack, go to Home > Content > Views.

Figure 8: Accessing PostgreSQL Views


5. reportsThe vROps Management Pack for PostgreSQL contains the following custom reports. The reports can be exported and easily shared with key stakeholders in either .pdf or .csv formats.

Table 2: PostgreSQL Reports

rEPOrT DESCrIPTION

PostgreSQL Databases Report Corresponds to the view of the same name in section 4, Views.

PostgreSQL Instance Report Corresponds to the view of the same name in section 4, Views.

PostgreSQL Slowest Queries Report Corresponds to the view of the same name in section 4, Views.

PostgreSQL Throughput Report Corresponds to the view of the same name in section 4, Views.

To access the Management Packs reports, go to Environment > PostgreSQL and click the desired Object (resource kind). Select the Reports tab, then Report Templates.

To run the selected report, click the Run Template icon ( ).

Figure 9: Accessing PostgreSQL Reports


6. alertsThe vROps Management Pack for PostgreSQL pulls PostgreSQL database health indicators and displays them in vRealize Operations as alerts. The critical levels of each alert are closely mapped from PostgreSQL to vROps.

Refer to Appendix II for the full list of alerts, symptoms, and recommendations provided by this Management Pack.

Figure 10: Alert Example


7. troubleshooting the Management packKnown troubleshooting information can help you diagnose and correct common problems with the Management Pack for PostgreSQL.

This section includes the following topics:

• Troubleshooting an Adapter Instance• Testing Connection Failures• Viewing System Log Files

7.1 Troubleshooting an Adapter Instance

Perform these general troubleshooting steps to diagnose and correct problems with an adapter instance:

• Edit the adapter instance and click Test Connection to verify the connection to vROps. Refer to section 7.2, Testing Connection Failures.

• View the collection status and collection state for the adapter instance resource on the Environment Overview page in vROps.

• Check the adapter and collector logs for errors. Refer to section 7.3, Viewing System Log Files, for details.

7.2 Testing Connection Failures

When clicking Test Connection in the Manage Solution window when adding an adapter instance, the following connection errors are possible.

7.2.1 wrong Credentials

Error: Unable to establish a valid connection to target system. Connection authorization failure occurred. Reason: User ID or Password invalid.

Action: Ensure the correct PostgreSQL and vRealize Operations User Name and Password was entered when adding your adapter instance.

7.2.2 wrong Host

Error: Unable to establish a valid connection to target system. Required property is unknown host.

Action: Ensure the correct hostname or IP address of the PostgreSQL instance was entered when adding your adapter instance.

7.2.3 wrong Port

Error: Unable to establish a valid connection to target system. Connection authorization failure occurred. Error opening socket server <name> on port with message: Connection refused.

Action: Check your PostgreSQL database system and ensure the connection port number matches the port number entered (if other than default of 5432) when adding your adapter instance.

7.2.4 wrong Database

Error: Connection authorization failure occurred. The application server rejected establishment of the connection. An attempt was made to access a database, <name>, which was either not found or does not support transactions.

Action: Ensure the database name(s) provided match the PostgreSQL system. Multiple databases should be separated by commas in the Manage Solution window.


7.2.5 SSL Not Enabled

Error: SSL connection is not enabled.

Action: Under Advanced Settings, set SSL mode to be enabled (required).

7.2.6 Server Does Not Support SSL

Error: The server does not support SSL connections.

Action: Under Advanced Settings, set SSL mode setting to Disabled.

7.3 Viewing System Log Files

You can view PostgreSQL adapter errors in the adapter and collector log files. You can view the adapter and collector log files in the vROps user interface or in an external log viewer.

The adapter log files are in the $ALIVE_BASE/user/log/adapters/PostgreSQLAdapter/ folder. The collector log files are in the $ALIVE_BASE/user/log/ folder.

The logging level is set to ERROR by default. To troubleshoot issues, set the logging level to INFO. To view detailed messages, including micro steps, queries, and returned results, set the logging level to DEBUG.

You can set the base log level for the collector via Administrator -> Support -> Logs -> Select COLLECTOR folder -> Select Edit Properties icon -> Edit Root logger level.

NOTE: If you set the logging level to DEBUG, log files can become large very quickly. Set the logging level to DEBUG only for short periods of time.

For complete information about viewing log files and modifying log levels, refer to the vROps online help.


8. appendix i: MetricsThe Management Pack for PostgreSQL collects the following metrics by PostgreSQL Resource Kinds.

Table 3: Management Pack Metrics

rESOUrCE KIND rESOUrCE GrOUP rESOUrCE ATTrIBUTE ATTrIBUTE TyPE

PostgreSQL Instance Tablespaces|General Tablespace Size double

PostgreSQL Instance Tablespaces|Configuration Tablespace Name string

PostgreSQL Instance Tablespaces|Configuration Tablespace Location string

PostgreSQL Instance Tablespaces|Configuration Tablespace Location string

PostgreSQL Instance Tablespaces|Configuration Tablespace Owner string

PostgreSQL Instance Tablespaces|Configuration Privileges string

PostgreSQL Instance Tablespaces|Configuration User Name string

PostgreSQL Instance Tablespaces|Configuration IP Address string

PostgreSQL Instance Tablespaces|Configuration Port integer

PostgreSQL Instance Tablespaces|Configuration Instance Name string

PostgreSQL Instance Buffers Buffers Allocated double

PostgreSQL Instance Buffers Times Backend Executed Own fsync

double

PostgreSQL Instance Buffers Times Background Writer Stopped Due to too Many Buffers

double

PostgreSQL Instance Buffers Buffers Written by Backend double

PostgreSQL Instance Buffers Buffers Written by Background Writer

double

PostgreSQL Instance Buffers Buffers Written During Checkpoint double

PostgreSQL Instance Configuration Name string

PostgreSQL Instance Configuration Server IP string

PostgreSQL Instance Configuration Server Port integer

PostgreSQL Instance Configuration Last Time Stats Reset string

PostgreSQL Instance Configuration Version string

PostgreSQL Instance Checkpoints Scheduled Checkpoints Performed double

PostgreSQL Instance Checkpoints Time Synchronizing Checkpoint Files to Disk

double

PostgreSQL Instance Checkpoints Requested Checkpoints Performed double

PostgreSQL Instance Checkpoints Time Writing Checkpoint Files to Disk

double

PostgreSQL Database Sessions Number of Active Connections integer

PostgreSQL Database Sessions Total Sessions integer

PostgreSQL Database Sessions Active Sessions integer

PostgreSQL Database Sessions Idle Sessions integer

PostgreSQL Database Sessions Idle Sessions in Transaction integer

PostgreSQL Database Sessions Idle Sessions in Transaction (Aborted)

integer



PostgreSQL Database Sessions Sessions Executing Fastpath Function Call

integer

PostgreSQL Database Sessions Sessions with Unknown State (Track Activities is Disabled)

integer

PostgreSQL Database General Canceled Queries Due to Conflicts integer

PostgreSQL Database General Deadlock Count integer

PostgreSQL Database General Database Size integer

PostgreSQL Database General Last Timestamp Stats Reset string

PostgreSQL Database Activity Rows Deleted double

PostgreSQL Database Activity Rows Returned double

PostgreSQL Database Activity Rows Updated double

PostgreSQL Database Activity Rows Fetched double

PostgreSQL Database Activity Rows Inserted double

PostgreSQL Database Configuration Tablespace Name string

PostgreSQL Database Configuration Database Name string

PostgreSQL Database Configuration Database ID integer

PostgreSQL Database Configuration IP Address string

PostgreSQL Database Configuration Port integer

PostgreSQL Database Conflicts Queries Canceled Due to Deadlocks

double

PostgreSQL Database Conflicts Queries Canceled Due to Old Snapshot

double

PostgreSQL Database Conflicts Queries Canceled Due to Lock Timeouts

double

PostgreSQL Database Conflicts Queries Canceled Due to Dropped Tablespaces

double

PostgreSQL Database Conflicts Queries Canceled Due to Pinned Buffers

double

PostgreSQL Database Transactions Transaction Rollbacks double

PostgreSQL Database Transactions Transaction Commits double

PostgreSQL Database Disk IO Temporary Bytes Written double

PostgreSQL Database Disk IO Temporary Files Created double

PostgreSQL Database Disk IO Buffer Hit Ratios double

PostgreSQL Database Disk IO Block Reads/Buffer Misses double

PostgreSQL Database Disk IO Time Spent Writing Data double

PostgreSQL Database Disk IO Buffer Hits double

PostgreSQL Database Disk IO Time Spent Reading Data double

PostgreSQL Database Disk IO Blocks Read by Sequences integer

PostgreSQL Database Disk IO Blocks Hit by Sequences integer

PostgreSQL Table Triggers|Configuration Trigger Enabled Status string

PostgreSQL Table Triggers|Configuration Trigger ID double

PostgreSQL Table Triggers|Configuration Trigger Name string



PostgreSQL Table Triggers|Configuration Type of Trigger Fire integer

PostgreSQL Table Triggers|Configuration Arguments Passed to Trigger string

PostgreSQL Table Triggers|Configuration Table ID integer

PostgreSQL Table Triggers|Configuration Table Name string

PostgreSQL Table Triggers|Configuration Function Name string

PostgreSQL Table Triggers|Configuration Function ID integer

PostgreSQL Table Triggers|Configuration IP Address string

PostgreSQL Table Triggers|Configuration Port integer

PostgreSQL Table Indexes|Activity Number of Block Reads integer

PostgreSQL Table Indexes|Activity Number of Table Rows Fetched by Scan

integer

PostgreSQL Table Indexes|Activity Number of Buffer Hits integer

PostgreSQL Table Indexes|Activity Number of Index Entries Returned integer

PostgreSQL Table Indexes|Activity Number of Scans integer

PostgreSQL Table Indexes|Configuration Index ID string

PostgreSQL Table Indexes|Configuration Index Name string

PostgreSQL Table Indexes|Configuration Table Name string

PostgreSQL Table Indexes|Configuration Schema Name string

PostgreSQL Table Indexes|Configuration Table ID integer

PostgreSQL Table Indexes|Configuration IP Address string

PostgreSQL Table Indexes|Configuration Port integer

PostgreSQL Table General Table Size integer

PostgreSQL Table Activity Number of Rows Updated double

PostgreSQL Table Activity Number of Sequential Scans double

PostgreSQL Table Activity Last Time Table Analyzed by Auto Daemon

string

PostgreSQL Table Activity Number of Dead Rows double

PostgreSQL Table Activity Last Time Table Vacuumed by Auto Daemon

string

PostgreSQL Table Activity Number of Rows Deleted double

PostgreSQL Table Activity Last Time Table Manually Analyzed string

PostgreSQL Table Activity Number of Index Scans double

PostgreSQL Table Activity Number of Rows Inserted double

PostgreSQL Table Activity Number of Times Table Manually Vacuumed

double

PostgreSQL Table Activity Number of Times Table Vacuumed By Auto Daemon

double

PostgreSQL Table Activity Last Time Table Manually Vacuumed

string

PostgreSQL Table Activity Number of Rows Fetched by Index Scans

double

PostgreSQL Table Activity Number of Times Table Manually Analyzed

double



PostgreSQL Table Activity Number of Rows Modified Since Last Analyzed

integer

PostgreSQL Table Activity Number of Times Table Analyzed by Auto Daemon

double

PostgreSQL Table Activity Rows fetched by Sequential Scans double

PostgreSQL Table Activity Number of Live Rows double

PostgreSQL Table Activity Number of Rows Hot Updated (No separate index update requried)

double

PostgreSQL Table Configuration Table ID integer

PostgreSQL Table Configuration Tablespace Name string

PostgreSQL Table Configuration Database Name string

PostgreSQL Table Configuration Table Name string

PostgreSQL Table Configuration Table Schema string

PostgreSQL Table Configuration IP Address string

PostgreSQL Table Configuration Port integer

PostgreSQL Table Disk IO Number of Block Reads from Indexes

double

PostgreSQL Table Disk IO Number of Block Reads double

PostgreSQL Table Disk IO Number of Buffer Reads double

PostgreSQL Table Disk IO Number of Block Reads from TOAST Table Indexes

double

PostgreSQL Table Disk IO Number of Buffer Hits from TOAST Table

double

PostgreSQL Table Disk IO Number of Buffer Hits from Indexes double

PostgreSQL Table Disk IO Number of Buffer Hits from TOAST Table Indexes

double

PostgreSQL Table Disk IO Number of Block Reads from TOAST Table

double

PostgreSQL Function Activity Total Time Spent Calling This and All Called Functions

double

PostgreSQL Function Activity Average Total Call Time double

PostgreSQL Function Activity Times Called double

PostgreSQL Function Activity Time Spent on This Function Alone (not referenced functions)

double

PostgreSQL Function Configuration Schema Name string

PostgreSQL Function Configuration Function Name string

PostgreSQL Function Configuration Function ID integer

PostgreSQL Function Configuration IP Address string

PostgreSQL Function Configuration Port integer

PostgreSQL Function Configuration Database Name string

PostgreSQL Function Configuration Rank integer

PostgreSQL Query Activity Query Text string

PostgreSQL Query Activity Total Time double



PostgreSQL Query Activity Average Time Spent Per Call double

PostgreSQL Query Activity Number of Calls double

PostgreSQL Query Activity Rows Returned integer

PostgreSQL Query Configuration User Name string

PostgreSQL Query Configuration Database Name string

PostgreSQL Query Configuration IP Address string

PostgreSQL Query Configuration Port integer

PostgreSQL Query Configuration Rank integer

PostgreSQL Query Disk IO Local Block Cache Hits integer

PostgreSQL Query Disk IO Shared Block Reads integer

PostgreSQL Query Disk IO Shared Blocks Written integer

PostgreSQL Query Disk IO Total Time Spent Writing Blocks integer

PostgreSQL Query Disk IO Shared Blocks Dirty Read integer

PostgreSQL Query Disk IO Local Block Reads integer

PostgreSQL Query Disk IO Shared Block Cache Hits integer

PostgreSQL Query Disk IO Local Blocks Dirty Read integer

PostgreSQL Query Disk IO Total Time Spent Reading Blocks integer

PostgreSQL Query Disk IO Local Blocks Written integer


9. appendix ii: alertsThe vROps Management Pack for PostgreSQL creates alerts based on various symptoms that it detects in the environment. See the table below for details regarding each alert.

Table 4: Management Pack Alerts

NAME DESCrIPTION rECOMMENDATION

Max Written Clean (Per Second) is Higher than Normal

The number of times the background writer has overwritten the maximum number of buffers (when a checkpoint is performed) is much higher than normal.

Consider increasing the value of “bgwriter_lru_maxpages” in postgresql.conf to increase performance.

Tablespace Size is Higher than Normal

The size of your Database is much higher than normal

Consider running a VACUUM to recover disk space.

Database Size is Higher than Normal The size of your Database is much higher than normal


Table Size is Higher than Normal The size of your Table is much higher than normal


Temp Files Created is Higher than Normal

The number of temporary files created is higher than normal. This can cause slower performance and I/O contention.

Consider increasing the “work_mem” in the postgresql.conf file.

Dead Rows is Higher than Normal The dead rows for this table are higher than normal.

To clear the dead rows, consider running “VACUUM FULL” or “CLUSTER” during a maintenance window.

Queries Cancelled are Higher than Normal

The number of queries that are being cancelled is higher than normal.

Consider enabling “hot_standby_feedback” in the postgresql.conf file to avoid cancelled queries. warning: This could create bloat in the primary database.

Copyright © 2015 Blue Medora Inc. All rights reserved. U.S. and international copyright and intellectual property laws protect this product. Blue Medora is a registered trademark or trademark of Blue Medora in the United States and/or other jurisdictions.

The PostgreSQL name and logo are trademarks or registered trademarks of The PostgreSQL Global Development Group in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies.

Blue Medora

3225 N Evergreen Dr. NE Suite 103

Grand Rapids, MI 49525

www.bluemedora.com

You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.

The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].

Date post:	03-Feb-2018
Category:	Documents
Upload:	doankhanh
View:	220 times
Download:	0 times

PostgreSQL - Blue Medora · PDF file2.2 Data the Management Pack Collects ... metrics for...

Documents