VMWARE VREALIZE OPERATIONS MANAGEMENT PACK FOR
Apache Hadoop
User Guide
2 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
NOTE: This document supports the version of each product listed, as well as all subsequent versions, until a new edition replaces it.
You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.
The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].
1. Purpose ..................................................................................................................................................................... 32. Introduction to the Management Pack ...................................................................................... 3
2.1 How the Management Pack Collects Data ............................................................ 32.2 Data the Management Pack Collects .......................................................................... 32.3 Inventory Tree (Traversal Spec) .......................................................................................... 42.4 External Relationships ................................................................................................................ 4
3. Dashboards ........................................................................................................................................................... 53.1 Apache Hadoop Overview ...................................................................................................... 53.2 Apache Hadoop Health Investigation .......................................................................... 63.3 Apache Hadoop HDFS Overview .................................................................................... 73.4 Apache Hadoop YARN Overview .................................................................................... 83.5 Apache Hadoop Node Deep Dive ................................................................................... 93.6 VM to Apache Hadoop Node............................................................................................10
4. Views .........................................................................................................................................................................115. Reports ...................................................................................................................................................................136. Alerts .........................................................................................................................................................................147. Analysis Badges ............................................................................................................................................148. Troubleshooting the Management Pack ...............................................................................15
8.1 Troubleshooting an Adapter Instance ......................................................................158.2 Test Connection Failures .......................................................................................................158.3 Viewing System Log Files.....................................................................................................15
9. Appendix I: Metrics ....................................................................................................................................1610. Appendix II: Alerts ....................................................................................................................................4511. Appendix III: Capacity Definitions ............................................................................................46
TABLE OF CONTENTS
3 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
1. PurposeThe Blue Medora VMware vRealize Operations (vROps) Management Pack for Apache Hadoop User Guide describes the primary features of the Management Pack for Apache Hadoop, including dashboards, views, reports, alerts, and metrics that allow users to optimize the monitoring and management of Apache Hadoop resources from within vRealize Operations.
2. Introduction to the Management PackThe Management Pack for Apache Hadoop is an embedded adapter for vRealize Operations (vROps) that monitors Apache Hadoop systems remotely to retrieve performance data regarding Apache Hadoop resources.
This section includes the following topics:• How the Management Pack Collects Data• Data the Management Pack Collects
2.1 How the Management Pack Collects DataDuring each data collection cycle, the Management Pack opens a HTTP connection to the specified NameNode and ResourceManager JMX hosts to retrieve resource metrics for HDFS & YARN, respectively. After connecting to the NameNode and ResourceManager JMX endpoints, the Management Pack discovers lower-level DataNode and NodeManager resources and connects to them directly to retrieve metrics.
NOTE: The advanced configuration Collection Mode setting allows you to operate in “Light” mode, during which the Management Pack connects to top-level NameNode and ResourceManager resources only, but still provides select alerting for DataNodes and NodeManagers. Refer to the accompanying Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop Installation & Configuration Guide.
The collection interval for the adapter instance resource determines how often the Management Pack collects data. The default collection interval is five minutes.
2.2 Data the Management Pack CollectsThe Management Pack can collect performance data, relationships (associations), and events for the following Apache Hadoop resources:
1. Apache Hadoop Cluster 2. Apache Hadoop NameNode 3. Apache Hadoop ResourceManager 4. Apache Hadoop DataNode 5. Apache Hadoop NodeManager
Figure 1: Apache Hadoop Relationships Diagram
4 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
2.3 Inventory Tree (Traversal Spec)The Inventory Tree (Traversal Spec) feature within vROps allows you to easily navigate your Hadoop environment. The hierarchical structure implicitly shows relationships among resource kinds, enabling quick drill-downs to root-cause issues.
2.4 External RelationshipsThe Management Pack for Apache Hadoop includes external relationships for Blue Medora True Visibility Suite customers who are also using Blue Medora’s vROps Management Packs for Nutanix or KVM as well as external relationships to the VMware virtual layer. The following external relationships can be discovered:
• VMware VM -> NameNode • VMware VM -> DataNode • VMware VM -> ResourceManager • VMware VM -> NodeManager • Nutanix VM -> NameNode • Nutanix VM -> DataNode • Nutanix VM -> ResourceManager • Nutanix VM -> NodeManager • KVM VM -> NameNode • KVM VM -> DataNode • KVM VM -> ResourceManager • KVM VM -> NodeManager
Figure 2: Example Hadoop Traversal Spec
5 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
3. DashboardsDashboards are the primary user interface that allow users to monitor Apache Hadoop resources from within vRealize Operations.
The following dashboards are available in the Management Pack:
•Apache Hadoop Overview•Apache Hadoop Health Investigation•Apache Hadoop HDFS Overview•Apache Hadoop YARN Overview•Apache Hadoop Node Deep Dive•VM to Apache Hadoop Node
3.1 Apache Hadoop OverviewThe Apache Hadoop Overview dashboard displays heat maps depicting the overall health of Apache Hadoop Clusters, ResourceManagers, NameNodes, NodeManagers, and DataNodes. Figure 3: Apache Hadoop Overview Dashboard
6 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
3.2 Apache Hadoop Health InvestigationThe Apache Hadoop Health Investigation dashboard provides an efficent way to navigate and investigate the health and performance of your entire Hadoop Cluster environment. Select an Apache Hadoop resource from the Environment Overview widget to populate its health status, top alerts, and key performance metrics.
Figure 4: Apache Hadoop Health Investigation
7 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
3.3 Apache Hadoop HDFS OverviewThe Apache Hadoop HDFS Overview dashboard enables an overview of your HDFS resources by allowing you to select a Apache Hadoop NameNode and related DataNode to view properties and selected metrics about the parent-child resources, side-by-side.
Figure 5: Apache Hadoop HDFS Overview Dashboard
8 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
3.4 Apache Hadoop YARN OverviewThe Apache Hadoop YARN Overview dashboard enables an overview of your YARN resources by allowing you to select a Apache Hadoop ResourceManager and related NodeManager to view properties and selected metrics about the parent-child resources, side-by-side.
Figure 6: Apache Hadoop YARN Overview Dashboard
9 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
3.5 Apache Hadoop Node Deep DiveThe Apache Hadoop Node Deep Dive dashboard allows you to select an Apache Hadoop node and related virtual machines, datastore, and host for a deep-dive view of common KPIs for Hadoop nodes displayed as sparkline scoreboards for each of the selected resources.
Figure 7: Apache Hadoop Node Deep Dive Dashboard
10 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
3.6 VM to Apache Hadoop NodeThe VM to Apache Hadoop Node dashboard allows you to select any VMware, Nutanix, or KVM virtual machine and a related Apache Hadoop node to view sparkline scoreboards highlighting KPIs for both resources.
Figure 8: VM to Apache Hadoop Node Dashboard
11 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
4. ViewsThe Management Pack for Apache Hadoop contains custom views, which allow the user to view statistics of metrics for Apache Hadoop resources. Views provide a “big picture” look at resources, as opposed to a more in depth view.
The following views are available in the Management Pack:
• Apache Hadoop Cluster KPIs• Apache Hadoop Cluster Utilization and Health• Apache Hadoop OS and Java Configuration• Apache Hadoop HDFS Capacity and Health• Apache Hadoop YARN Capacity and Health• Apache Hadoop NameNode Capacities• Apache Hadoop NameNode Capacity and Health• Apache Hadoop NameNode KPIs• Apache Hadoop NameNode OS and Java Configuration• Apache Hadoop NameNode Properties• Apache Hadoop ResourceManager Capacities• Apache Hadoop ResourceManager Utilization and Health• Apache Hadoop ResourceManager KPIs• Apache Hadoop ResourceManager OS and Java Configuration• Apache Hadoop ResourceManager Properties• Apache Hadoop DataNode Capacities• Apache Hadoop DataNode Capacity and Health• Apache Hadoop DataNode KPIs• Apache Hadoop DataNode OS and Java Configuration• Apache Hadoop DataNode Properties• Apache Hadoop NodeManager Capacities• Apache Hadoop NodeManager Utilization and Health• Apache Hadoop NodeManager KPIs• Apache Hadoop NodeManager OS and Java Configuration• Apache Hadoop NodeManager Properties
12 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
To access the Management Pack views, go to Environment > Apache Hadoop Clusters and click the desired object (resource kind). Select the Details tab, then Views. Select the desired view from the list to populate the statistics below.
For the full list of views for the Management Pack, go to Home > Content > Views.
Figure 9: Accessing Apache Hadoop Views
13 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
5. ReportsThe Management Pack for Apache Hadoop contains the following out-of-the-box reports. The reports can be exported and easily shared with key stakeholders in either .pdf or .csv formats.
• Apache Hadoop Capacities• Apache Hadoop Health and Availability• Apache Hadoop HDFS Capacity and Health• Apache Hadoop YARN Capacity and Health• Apache Hadoop KPIs• Apache Hadoop OS and Java Configuration• Apache Hadoop Properties
To access the Management Packs reports, go to Environment > Apache Hadoop Clusters and click the desired object (resource kind). Select the Reports tab, then Report Templates.
To run the selected report, click the Run Template icon ( ).
Figure 10: Accessing Apache Hadoop Reports
14 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
6. AlertsThe Management Pack for Apache Hadoop pulls Apache Hadoop health indicators and displays them in vRealize Operations as alerts. The critical levels of each alert are closely mapped from Apache Hadoop to vROps. Refer to “10. Appendix II: Alerts” for the full list of alerts, symptoms, and recommendations provided by this Management Pack.
Figure 11: Alert Example
7. Analysis BadgesUsing the predictive analytics capabilities of the vROps Analysis Badges through capacity definitions, theManagement Pack populates capacity and utilization breakdowns for Apache Hadoop resources. Refer to “11. Appendix III: Capacity Definitions” for the list of capacity definitions.
Figure 12: Analysis Badge Example
15 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
8. Troubleshooting the Management PackKnown troubleshooting information can help you diagnose and correct common problems with the Management Pack for Apache Hadoop.
This section includes the following topics:• Troubleshooting an Adapter Instance• Test Connection Failures• Viewing System Log Files
8.1 Troubleshooting an Adapter InstancePerform these general troubleshooting steps to diagnose and correct problems with an adapter instance:
• Edit the adapter instance and click Test Connection to verify the connection to vROps. Refer to section “8.2 Test Connection Failures”.
• View the collection status and collection state for the adapter instance resource on the Environment Overview page in vROps.
• Check the adapter and collector logs for errors. Refer to section “8.3 Viewing System Log Files”, for details.
8.2 Test Connection FailuresWhen clicking Test Connection in the Manage Solution window after configuring an adapter instance, the following connection errors are possible.
8.2.1 Network Unreachable / Connection Timed OutError: The following connectivity error can occur on YARN and/or HDFS: “Network is unreachable or connection timed out. Ensure host and port are correct. URL: http://<host>:<port>/jmx.”Action: In the Manage Solution window, ensure the NameNode and ResourceManager JMX hosts and ports match those of your JMX endpoints. You can verify your configuration by running the following command from your vROps system: curl <http://<host>:<port>/jmx>
8.3 Viewing System Log FilesYou can view Apache Hadoop adapter errors in the adapter and collector log files. You can view the adapter and collector log files in the vROps user interface or in an external log viewer.
• The adapter log files are in the $VCOPS_BASE/user/log/adapters/ApacheHadoopAdapter/ folder. • The collector log files are in the $VCOPS_BASE/user/log/ folder.
The logging level is set to WARNING by default. To troubleshoot issues, set the logging level to INFO. To view detailed messages, including micro steps, queries, and returned results, set the logging level to DEBUG.
You can set the base log level for the collector via Administration -> Support -> Logs -> Select COLLECTOR folder -> Select Edit Properties icon -> Edit Root logger level.
NOTE: If you set the logging level to DEBUG, log files can become large very quickly. Set the logging level to DEBUG only for short periods of time.
For complete information about viewing log files and modifying log levels, refer to the vROps online help.
16 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
9. Appendix I: MetricsThe Management Pack for Apache Hadoop collects the following metrics by Apache Hadoop Resource Kinds.
Table 1: Management Pack Metrics
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop Cluster Details NodeManagers Active float NodeManagers Active
Hadoop Cluster Details NodeManagers Decommissioned
float NodeManagers Decommis-sioned
Hadoop Cluster Details NodeManagers Lost float NodeManagers Lost
Hadoop Cluster Details NodeManagers Rebooted
float NodeManagers Rebooted
Hadoop Cluster Details NodeManagers Unhealthy
float NodeManagers Unhealthy
Hadoop Cluster Details Sum of Containers Completed from NodeManager Descendants
float Sum of Containers Completed from NodeManager Descen-dants
Hadoop Cluster Details Sum of Containers Failed from NodeManager Descendants
float Sum of Containers Failed from NodeManager Descendants
Hadoop Cluster Details Sum of Containers Initializing from NodeManager Descendants
float Sum of Containers Initializing from NodeManager Descen-dants
Hadoop Cluster Details Sum of Containers Killed from NodeManager Descendants
float Sum of Containers Killed from NodeManager Descendants
Hadoop Cluster Details Sum of Containers Launched from NodeManager Descendants
float Sum of Containers Launched from NodeManager Descen-dants
Hadoop Cluster Details Sum of Containers Running from NodeManager Descendants
float Sum of Containers Running from NodeManager Descen-dants
Hadoop Cluster Details Sum of Users Active from ResourceManager Descendants
float Sum of Users Active from Re-sourceManager Descendants
Hadoop Cluster Details Unique Child Hostnames
integer Unique Child Hostnames
Hadoop Cluster Relationships Hadoop Tag Parents string List of parent Hadoop Tag resources
Hadoop Cluster Relationships NameNode Children string List of child NameNode re-sources
Hadoop Cluster Relationships ResourceManager Children
string List of child ResourceManager resources
17 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop Tag Relationships Cluster Children string List of children Cluster resourc-es
Hadoop Related KVM VMs
Relationships KVM Virtual Machine Children
string List of children KVM Virtual Machine resources
Hadoop Related Nutanix VMs
Relationships Nutanix Virtual Machine Children
string List of children Nutanix Virtual Machine resources
Hadoop Related VMs
Relationships VMware Virtual Machine Children
string List of children VMware Virtual Machine resources
Hadoop External Resources
Relationships KVM Virtual Machine Children
string List of children KVM Virtual Machine resources
Hadoop External Resources
Relationships VMware Virtual Machine Children
string List of children VMware Virtual Machine resources
Hadoop External Resources
Relationships Nutanix Virtual Machine Children
string List of children Nutanix Virtual Machine resources
Hadoop DataNode CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop DataNode CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop DataNode CPU Threads In BLOCKED State
integer Attribute ThreadsBlocked from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode CPU Threads In RUNNABLE State
integer Attribute ThreadsRunnable from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode CPU Threads In TERMINATED State
integer Attribute ThreadsTerminated from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode CPU Threads In TIMED_WAITING State
integer Attribute ThreadsTimedWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode CPU Threads In WAITING State
integer Attribute ThreadsWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time
Hadoop DataNode Details Metric Endpoint string Metric Endpoint
Hadoop DataNode Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem
Hadoop DataNode Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem
18 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop DataNode Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Details Total ERROR Log Messages
float Attribute LogError from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop DataNode Details Total FATAL Log Messages
float Attribute LogFatal from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop DataNode Details Total INFO Log Messages
float Attribute LogInfo from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop DataNode Details Total WARN Log Messages
float Attribute LogWarn from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop DataNode Details Version string Attribute Version from Bean Hadoop:service=DataN-ode,name=DataNodeInfo
Hadoop DataNode Disk Blocks Read float Attribute BlocksRead from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*
Hadoop DataNode Disk Blocks Removed float Attribute BlocksRemoved from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*
Hadoop DataNode Disk Blocks Replicated float Attribute BlocksReplicated from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*
Hadoop DataNode Disk Blocks Written float Attribute BlocksWritten from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*
Hadoop DataNode Disk Cache Capacity float Attribute CacheCapacity from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*
Hadoop DataNode Disk Cache Used float Attribute CacheUsed from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*
Hadoop DataNode Disk Cached integer Attribute NumBlocksCached from Bean Hadoop:service=-DataNode,name=FSDataset-State-.*
Hadoop DataNode Disk Capacity Lost Due To Volume Failure
float Attribute EstimatedCapacity-LostTotal from Bean Hadoop:-service=DataNode,name=FS-DatasetState-.*
Hadoop DataNode Disk Capacity Used float Capacity Used
19 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop DataNode Disk Capacity Used Ratio float Capacity Used Ratio
Hadoop DataNode Disk Data Read float Attribute BytesRead from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*
Hadoop DataNode Disk Data Written float Attribute BytesWritten from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*
Hadoop DataNode Disk Disk Capacity float Attribute Capacity from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*
Hadoop DataNode Disk Disk Remaining float Attribute Remaining from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*
Hadoop DataNode Disk Distributed File System Used
float Attribute DfsUsed from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*
Hadoop DataNode Disk Failed To Cache integer Attribute NumBlocksFailedTo-Cache from Bean Hadoop:ser-vice=DataNode,name=FSData-setState-.*
Hadoop DataNode Disk Failed To Uncache integer Attribute NumBlocksFailed-ToUncache from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*
Hadoop DataNode Disk Failed Volumes integer Attribute NumFailedVolumes from Bean Hadoop:service=-DataNode,name=FSDataset-State-.*
Hadoop DataNode Disk Last Volume Failure Date (from Unix epoch)
float Attribute LastVolumeFailure-Date from Bean Hadoop:ser-vice=DataNode,name=FSData-setState-.*
Hadoop DataNode Disk Read Blocks Diff float Read Blocks Diff
Hadoop DataNode Disk Reads Diff float Reads Diff
Hadoop DataNode Disk Removed Diff float Removed Diff
Hadoop DataNode Disk Replicated Diff float Replicated Diff
Hadoop DataNode Disk Storage Info string Attribute StorageInfo from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*
Hadoop DataNode Disk Write Blocks Diff float Write Blocks Diff
Hadoop DataNode Disk Writes Diff float Writes Diff
Hadoop DataNode Memory Current Heap Memory Committed
float Attribute MemHeapCommit-tedM from Bean Hadoop:ser-vice=\w+,name=JvmMetrics
Hadoop DataNode Memory Current Heap Memory Used
float Attribute MemHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
20 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop DataNode Memory Current Non-heap Memory Committed
float Attribute MemNonHeapCom-mittedM from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop DataNode Memory Current Non-heap Memory Used
float Attribute MemNonHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop DataNode Memory Garbage Collection Count
integer Attribute GcCount from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop DataNode Memory Garbage Collection Count Mark Sweep Compact
integer Attribute GcCountMarkSweep-Compact from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop DataNode Memory Garbage Collection Time
integer Attribute GcTimeMillis from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode Memory Garbage Collection Time Mark Sweep Compact
integer Attribute GcTimeMillisMark-SweepCompact from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop DataNode Memory Maximum Heap Memory Size
float Attribute MemHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop DataNode Memory Maximum Non-heap Memory Size
float Attribute MemNonHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop DataNode Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop DataNode Memory Used Physical Memory float Used Physical Memory
Hadoop DataNode Memory Used Physical Memory float Used Physical Memory
Hadoop DataNode Status Node Status string Node Status
Hadoop DataNode Status Power State string Power State
Hadoop DataNode Uncategorized Group Resolution Average Time
float Attribute GetGroupsAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop DataNode Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop DataNode Uncategorized Kerberos Login Failure Average Time
float Attribute LoginFailureAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
21 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop DataNode Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop DataNode Uncategorized Kerberos Login Success Average Time
float Attribute LoginSuccessAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop DataNode Uncategorized Kerberos Login Successes
integer Attribute LoginSuccessNu-mOps from Bean Hadoop:ser-vice=\w+,name=UgiMetrics
Hadoop DataNode Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop DataNode Relationships KVM Virtual Machine Parents
string List of parent KVM Virtual Ma-chine resources
Hadoop DataNode Relationships NameNode Parents string List of parent NameNode resources
Hadoop DataNode Relationships Nutanix Virtual Machine Parents
string List of parent Nutanix Virtual Machine resources
Hadoop DataNode Relationships Virtual Machine Parents string List of parent Virtual Machine resources
22 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop NameNode CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop NameNode CPU Threads In BLOCKED State
integer Attribute ThreadsBlocked from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode CPU Threads In RUNNABLE State
integer Attribute ThreadsRunnable from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode CPU Threads In TERMINATED State
integer Attribute ThreadsTerminated from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode CPU Threads In TIMED_WAITING State
integer Attribute ThreadsTimedWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode CPU Threads In WAITING State
integer Attribute ThreadsWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode Details Active Nodes string Isolated hostnames in LiveNodes entry from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Details Connections integer Attribute TotalLoad from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Details Dead Nodes string Attribute DeadNodes from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Details Decommissioned Nodes
string Attribute DecomNodes from Bean Hadoop:-service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Details Distinct Version Count integer Attribute DistinctVersion-Count from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Details Get Edit Average Time float Attribute GetEditAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Get Edit Operations integer Attribute GetEditNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
23 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Details Get Image Average Time
float Attribute GetImageAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Get Image Operations integer Attribute GetImageNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Get Link Target Operations
integer Attribute GetLinkTarge-tOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Get Listing Operations integer Attribute GetListin-gOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Hadoop Detailed Version
string Attribute Version from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Details Hadoop Version string Attribute SoftwareVer-sion from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time
Hadoop NameNode Details Last Written Transaction ID
integer Attribute LastWritten-TransactionId from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Details List Snapshottable Directory Operations
integer Attribute ListSnapshot-tableDirOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Maximum Objects integer Attribute MaxObjects from Bean Hadoop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Details Metric Endpoint string Metric Endpoint
Hadoop NameNode Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem
Hadoop NameNode Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem
Hadoop NameNode Details Pending DataNode Messages
integer Attribute PendingDataNode-MessageCount from Bean Hadoop:service=NameNo-de,name=FSNamesystem
24 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Details Put Image Average Time
float Attribute PutImageAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Put Image Operations integer Attribute PutImageNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Rename Snapshot Operations
integer Attribute RenameSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Safe Mode string Attribute Safemode from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Details Safe Mode Time integer Attribute SafeMode-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Snapshot Diff Report Operations
integer Attribute SnapshotDif-fReportOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Stale Storages integer Attribute NumStaleStor-ages from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Details Startup Completion float Attribute PercentComplete from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Elapsed Time integer Attribute ElapsedTime from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Loading Edits Completion
float Attribute LoadingEditsPer-centComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress
Hadoop NameNode Details Startup Loading Edits Count
integer Attribute LoadingEditsCount from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Loading Edits Elapsed Time
integer Attribute LoadingEditsElapsed-Time from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Loading Edits Total
integer Attribute LoadingEditsTo-tal from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
25 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Details Startup Safe Mode Completion
float Attribute SafeModePer-centComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress
Hadoop NameNode Details Startup Safe Mode Count
integer Attribute SafeModeCount from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Safe Mode Elapsed Time
integer Attribute SafeModeElapsed-Time from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Safe Mode Total
integer Attribute SafeModeTotal from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Saving Checkpoint Completion
float Attribute SavingCheckpoint-PercentComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress
Hadoop NameNode Details Startup Saving Checkpoint Count
integer Attribute SavingCheckpoint-Count from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Startup Saving Checkpoint Elapsed Time
integer Attribute SavingCheck-pointElapsedTime from Bean Hadoop:service=NameNo-de,name=StartupProgress
Hadoop NameNode Details Startup Saving Checkpoint Total
integer Attribute SavingCheckpoint-Total from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Details Storage Block Report Operations
integer Attribute StorageBlock-ReportOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Syncs Average Time float Attribute SyncsAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Syncs Operations integer Attribute SyncsNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
26 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Details Time Since Last Loaded Edits
integer Attribute MillisSinceLas-tLoadedEdits from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Details Total ERROR Log Messages
float Attribute LogError from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NameNode Details Total FATAL Log Messages
float Attribute LogFatal from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NameNode Details Total INFO Log Messages
float Attribute LogInfo from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NameNode Details Total WARN Log Messages
float Attribute LogWarn from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NameNode Details Transactions Average Time
float Attribute Transaction-sAvgTime from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Transactions Batched In Sync
integer Attribute Transactions-BatchedInSync from Bean Hadoop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Transactions Operations
integer Attribute Transaction-sNumOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Details Transactions Since Last Checkpoint
integer Attribute TransactionsSince-LastCheckpoint from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Details Transactions Since Last Log Roll
integer Attribute TransactionsSin-ceLastLogRoll from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Details Volume Failures Total integer Attribute VolumeFail-uresTotal from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Disk Add Block Operations integer Attribute AddBlock-Ops from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Block Deletion Start Date (from Unix epoch)
float Attribute BlockDeletion-StartTime from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState
27 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Disk Block Operations Batched
integer Attribute BlockOps-Batched from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Block Operations Queued
integer Attribute BlockOps-Queued from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Block Pool Used Percent
float Attribute PercentBlock-PoolUsed from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Block Pool Used Space float Attribute BlockPoolUsed-Space from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Block Received And Deleted Operations
integer Attribute BlockReceive-dAndDeletedOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Block Report Average Time
float Attribute BlockRepor-tAvgTime from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Block Report Operations
integer Attribute BlockReport-NumOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Blocks Missing integer Attribute NumberOfMiss-ingBlocks from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Blocks Missing With Replication Factor One
integer Attribute NumberOfMiss-ingBlocksWithReplica-tionFactorOne from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Cache Capacity float Attribute CacheCa-pacity from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Cache Report Average Time
float Attribute CacheRepor-tAvgTime from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Cache Report Operations
integer Attribute CacheReport-NumOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
28 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Disk Cache Used float Attribute CacheUsed from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Capacity integer Attribute BlockCa-pacity from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Capacity Lost Due To Volume Failure
float Attribute EstimatedCa-pacityLostTotal from Bean Hadoop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Disk Capacity Remaining float Attribute CapacityRe-maining from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Capacity Total float Attribute Capacity-Total from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Capacity Used float Attribute CapacityU-sed from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Capacity Used Non-distributed File System
float Attribute CapacityUsed-NonDFS from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Capacity Used Ratio float Capacity Used Ratio
Hadoop NameNode Disk Corrupt integer Attribute CorruptBlocks from Bean Hadoop:-service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Create File Operations integer Attribute CreateFile-Ops from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Create Snapshot Operations
integer Attribute CreateSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Create Symlink Operations
integer Attribute CreateSym-linkOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk DataNodes Dead integer Attribute NumDeadDat-aNodes from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState
29 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Disk DataNodes Stale integer Attribute StaleDataN-odes from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Delete File Operations integer Attribute DeleteFile-Ops from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Delete Snapshot Operations
integer Attribute DeleteSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Disallow Snapshot Operations
integer Attribute DisallowSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Excess integer Attribute ExcessBlocks from Bean Hadoop:-service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Expired Heartbeats integer Attribute ExpiredHeart-beats from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk File Info Operations integer Attribute FileInfoOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk File System Image Load Time
integer Attribute FsImageLoad-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk File System State string Attribute FSState from Bean Hadoop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Disk Files Appended integer Attribute FilesAppend-ed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Files Created integer Attribute FilesCreat-ed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Files Deleted integer Attribute FilesDelet-ed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Files In Get Listing Operations
integer Attribute FilesInGetLis-tingOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
30 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Disk Files Renamed integer Attribute FilesRenamed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Files Total integer Attribute FilesTotal from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Files Truncated integer Attribute FilesTrun-cated from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Get Additional Datanode Operations
integer Attribute GetAdditional-DatanodeOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Get Block Locations integer Attribute GetBlockLo-cations from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Last Checkpoint Date (from Unix epoch)
float Attribute LastCheck-pointTime from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Missing integer Attribute MissingBlocks from Bean Hadoop:-service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Missing With Replication Factor One
integer Attribute MissingReplOne-Blocks from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Non-distributed File System Used Space
float Attribute NonDfsUsed-Space from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Pending Deletion integer Attribute PendingDele-tionBlocks from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Pending Replication integer Attribute PendingRepli-cationBlocks from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Postponed Mis-replicated
integer Attribute PostponedMis-replicatedBlocks from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Scheduled Replication integer Attribute ScheduledRep-licationBlocks from Bean Hadoop:service=NameNo-de,name=FSNamesystem
31 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Disk Snapshots integer Attribute Snapshots from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Snapshottable Directories
integer Attribute Snapshottable-Directories from Bean Hadoop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Disk Space Free float Attribute Free from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Space Free Percent float Attribute PercentRemain-ing from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Space Total float Attribute Total from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Space Used float Attribute Used from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Space Used Percent float Attribute PercentUsed from Bean Hadoop:-service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Startup Loading File System Image Completion
float Attribute LoadingFsImage-PercentComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress
Hadoop NameNode Disk Startup Loading File System Image Count
integer Attribute LoadingFsImage-Count from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Disk Startup Loading File System Image Elapsed Time
integer Attribute LoadingFsIma-geElapsedTime from Bean Hadoop:service=NameNo-de,name=StartupProgress
Hadoop NameNode Disk Startup Loading File System Image Total
integer Attribute LoadingFsImage-Total from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress
Hadoop NameNode Disk Total integer Attribute TotalBlocks from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Disk Total File Operations integer Attribute TotalFileOps from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity
Hadoop NameNode Disk Total Files integer Attribute TotalFiles from Bean Hadoop:service=NameNo-de,name=NameNodeInfo
32 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Disk Under-replicated integer Attribute UnderReplicat-edBlocks from Bean Ha-doop:service=NameNo-de,name=FSNamesystem
Hadoop NameNode Memory Current Heap Memory Committed
float Attribute MemHeapCommit-tedM from Bean Hadoop:ser-vice=\w+,name=JvmMetrics
Hadoop NameNode Memory Current Heap Memory Used
float Attribute MemHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode Memory Current Non-heap Memory Committed
float Attribute MemNonHeapCom-mittedM from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop NameNode Memory Current Non-heap Memory Used
float Attribute MemNonHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop NameNode Memory Garbage Collection Count
integer Attribute GcCount from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NameNode Memory Garbage Collection Count Mark Sweep Compact
integer Attribute GcCountMarkSweep-Compact from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop NameNode Memory Garbage Collection Time
integer Attribute GcTimeMillis from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode Memory Garbage Collection Time Mark Sweep Compact
integer Attribute GcTimeMillisMark-SweepCompact from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NameNode Memory Maximum Heap Memory Size
float Attribute MemHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NameNode Memory Maximum Non-heap Memory Size
float Attribute MemNonHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NameNode Memory Retry Cache Clears integer Attribute CacheCleared from Bean Hadoop:ser-vice=NameNode,name=Retry-Cache.NameNodeRetryCache
Hadoop NameNode Memory Retry Cache Hits integer Attribute CacheHit from Bean Hadoop:service=NameNo-de,name=RetryCache.NameNodeRetryCache
33 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Memory Retry Cache Updates integer Attribute CacheUpdated from Bean Hadoop:ser-vice=NameNode,name=Retry-Cache.NameNodeRetryCache
Hadoop NameNode Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop NameNode Memory Used Physical Memory float Used Physical Memory
Hadoop NameNode Memory Used Physical Memory float Used Physical Memory
Hadoop NameNode Status DataNodes Decommissioned Dead
integer Attribute NumDecom-DeadDataNodes from Bean Hadoop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Status DataNodes Decommissioned Live
integer Attribute NumDecomLive-DataNodes from Bean Hadoop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Status DataNodes Decommissioning
integer Attribute NumDecommis-sioningDataNodes from Bean Hadoop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Status DataNodes Live integer Attribute NumLiveDat-aNodes from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState
Hadoop NameNode Status High Availability State string Attribute tag.HAState from Bean Hadoop:-service=NameNo-de,name=FSNamesystem
Hadoop NameNode Status High Availibity Failover Occurred
string High Availibity Failover Oc-curred
Hadoop NameNode Status Last High Availability Transition Time
integer Attribute LastHATransi-tionTime from Bean Ha-doop:service=NameNo-de,name=NameNodeStatus
Hadoop NameNode Status Node Status string Node Status
Hadoop NameNode Status Power State string Power State
Hadoop NameNode Status State string Attribute State from Bean Hadoop:service=NameNo-de,name=NameNodeStatus
Hadoop NameNode Status Upgrade Finalized string Attribute UpgradeFi-nalized from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo
Hadoop NameNode Uncategorized Group Resolution Average Time
float Attribute GetGroupsAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
34 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NameNode Uncategorized Kerberos Login Failure Average Time
float Attribute LoginFailureAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NameNode Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NameNode Uncategorized Kerberos Login Success Average Time
float Attribute LoginSuccessAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NameNode Uncategorized Kerberos Login Successes
integer Attribute LoginSuccessNu-mOps from Bean Hadoop:ser-vice=\w+,name=UgiMetrics
Hadoop NameNode Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NameNode Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NameNode Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NameNode Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NameNode Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NameNode Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NameNode Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NameNode Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
35 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NameNode User Configu-ration
Allow Snapshot Operations
string Attribute AllowSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity
Hadoop NameNode User Configu-ration
Security Enabled string Attribute SecurityEnabled from Bean Hadoop:-service=NameNo-de,name=NameNodeStatus
Hadoop NameNode Relationships Cluster Parents string List of parent Cluster resources
Hadoop NameNode Relationships DataNode Children string List of child DataNode resourc-es
Hadoop NameNode Relationships KVM Virtual Machine Parents
string List of parent KVM Virtual Ma-chine resources
Hadoop NameNode Relationships Nutanix Virtual Machine Parents
string List of parent Nutanix Virtual Machine resources
Hadoop NameNode Relationships Virtual Machine Parents string List of parent Virtual Machine resources
Hadoop NodeManager
CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop NodeManager
CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop NodeManager
CPU Threads In BLOCKED State
integer Attribute ThreadsBlocked from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
CPU Threads In RUNNABLE State
integer Attribute ThreadsRunnable from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
CPU Threads In TERMINATED State
integer Attribute ThreadsTerminated from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
CPU Threads In TIMED_WAITING State
integer Attribute ThreadsTimedWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
CPU Threads In WAITING State
integer Attribute ThreadsWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
CPU Virtual Cores Allocated integer Attribute AllocatedVCores from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics
Hadoop NodeManager
CPU Virtual Cores Allocated Ratio
float Virtual Cores Allocated Ratio
36 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NodeManager
CPU Virtual Cores Available integer Attribute AvailableVCores from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics
Hadoop NodeManager
CPU Virtual Cores Total float Virtual Cores Total
Hadoop NodeManager
Details Container Launch Duration Average Time
float Attribute ContainerLaunch-DurationAvgTime from Bean Hadoop:service=NodeMan-ager,name=NodeManagerMet-rics
Hadoop NodeManager
Details Container Launch Duration Operations
integer Attribute ContainerLaunch-DurationNumOps from Bean Hadoop:service=NodeMan-ager,name=NodeManagerMet-rics
Hadoop NodeManager
Details Containers Allocated integer Attribute AllocatedContainers from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics
Hadoop NodeManager
Details Containers Completed integer Attribute ContainersCompleted from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics
Hadoop NodeManager
Details Containers Completed Diff
integer Containers Completed Diff
Hadoop NodeManager
Details Containers Failed integer Attribute ContainersFailed from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics
Hadoop NodeManager
Details Containers Failed Diff integer Containers Failed Diff
Hadoop NodeManager
Details Containers Initializing integer Attribute ContainersIniting from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics
Hadoop NodeManager
Details Containers Killed integer Attribute ContainersKilled from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics
Hadoop NodeManager
Details Containers Killed Diff integer Containers Killed Diff
Hadoop NodeManager
Details Containers Launched integer Attribute ContainersLaunched from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics
Hadoop NodeManager
Details Containers Launched Diff
integer Containers Launched Diff
37 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NodeManager
Details Containers Running integer Attribute ContainersRunning from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics
Hadoop NodeManager
Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time
Hadoop NodeManager
Details Metric Endpoint string Metric Endpoint
Hadoop NodeManager
Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem
Hadoop NodeManager
Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem
Hadoop NodeManager
Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Details Total ERROR Log Messages
float Attribute LogError from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NodeManager
Details Total FATAL Log Messages
float Attribute LogFatal from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NodeManager
Details Total INFO Log Messages
float Attribute LogInfo from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NodeManager
Details Total WARN Log Messages
float Attribute LogWarn from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NodeManager
Memory Current Heap Memory Committed
float Attribute MemHeapCommit-tedM from Bean Hadoop:ser-vice=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Current Heap Memory Used
float Attribute MemHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Current Non-heap Memory Committed
float Attribute MemNonHeapCom-mittedM from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Current Non-heap Memory Used
float Attribute MemNonHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop NodeManager
Memory Garbage Collection Count
integer Attribute GcCount from Bean Hadoop:service=\w+,name=-JvmMetrics
38 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NodeManager
Memory Garbage Collection Count Mark Sweep Compact
integer Attribute GcCountMarkSweep-Compact from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Garbage Collection Time
integer Attribute GcTimeMillis from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Garbage Collection Time Mark Sweep Compact
integer Attribute GcTimeMillisMark-SweepCompact from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NodeManager
Memory Maximum Heap Memory Size
float Attribute MemHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop NodeManager
Memory Maximum Non-heap Memory Size
float Attribute MemNonHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop NodeManager
Memory Memory Allocated float Attribute AllocatedGB from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics
Hadoop NodeManager
Memory Memory Allocated Ratio float Memory Allocated Ratio
Hadoop NodeManager
Memory Memory Available float Attribute AvailableGB from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics
Hadoop NodeManager
Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop NodeManager
Memory Used Physical Memory float Used Physical Memory
Hadoop NodeManager
Memory Used Physical Memory float Used Physical Memory
Hadoop NodeManager
Status Node Status string Node Status
Hadoop NodeManager
Status Power State string Power State
Hadoop NodeManager
Uncategorized Group Resolution Average Time
float Attribute GetGroupsAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NodeManager
Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
39 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NodeManager
Uncategorized Kerberos Login Failure Average Time
float Attribute LoginFailureAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NodeManager
Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NodeManager
Uncategorized Kerberos Login Success Average Time
float Attribute LoginSuccessAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop NodeManager
Uncategorized Kerberos Login Successes
integer Attribute LoginSuccessNu-mOps from Bean Hadoop:ser-vice=\w+,name=UgiMetrics
Hadoop NodeManager
Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop NodeManager
Relationships KVM Virtual Machine Parents
string List of parent KVM Virtual Ma-chine resources
Hadoop NodeManager
Relationships Nutanix Virtual Machine Parents
string List of parent Nutanix Virtual Machine resources
Hadoop NodeManager
Relationships ResourceManager Parents
string List of parent ResourceManager resources
40 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop NodeManager
Relationships Virtual Machine Parents string List of parent Virtual Machine resources
Hadoop ResourceManager
CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop ResourceManager
CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem
Hadoop ResourceManager
CPU Threads In BLOCKED State
integer Attribute ThreadsBlocked from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
CPU Threads In RUNNABLE State
integer Attribute ThreadsRunnable from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
CPU Threads In TERMINATED State
integer Attribute ThreadsTerminated from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
CPU Threads In TIMED_WAITING State
integer Attribute ThreadsTimedWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
CPU Threads In WAITING State
integer Attribute ThreadsWaiting from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
Details Active Nodes string Isolated hostnames in LiveNodeManagers entry from Bean Hadoop:service=Re-sourceManager,name=RMN-MInfo
Hadoop ResourceManager
Details Application Master Launch Delay Average Time
float Attribute AMLaunchDelayAvg-Time from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics
Hadoop ResourceManager
Details Application Master Launch Delay Operations
integer Attribute AMLaunchDelayNu-mOps from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics
Hadoop ResourceManager
Details Application Master Register Delay Average Time
float Attribute AMRegisterDelayAvg-Time from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics
Hadoop ResourceManager
Details Application Master Register Delay Operations
integer Attribute AMRegisterDelayNu-mOps from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics
41 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop ResourceManager
Details Applications Active integer Attribute ActiveApplications from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Details Applications Completed integer Attribute AppsCompleted from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Details Applications Failed integer Attribute AppsFailed from Bean Hadoop:service=ResourceMan-ager,name=QueueMetrics,q0=-root
Hadoop ResourceManager
Details Applications Killed integer Attribute AppsKilled from Bean Hadoop:service=ResourceMan-ager,name=QueueMetrics,q0=-root
Hadoop ResourceManager
Details Applications Pending integer Attribute AppsPending from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Details Applications Running integer Attribute AppsRunning from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Details Applications Submitted integer Attribute AppsSubmitted from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Details Apps Completed Diff integer Apps Completed Diff
Hadoop ResourceManager
Details Apps Failed Diff integer Apps Failed Diff
Hadoop ResourceManager
Details Apps Killed Diff integer Apps Killed Diff
Hadoop ResourceManager
Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time
Hadoop ResourceManager
Details Metric Endpoint string Metric Endpoint
Hadoop ResourceManager
Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem
Hadoop ResourceManager
Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem
Hadoop ResourceManager
Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
42 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop ResourceManager
Details Total ERROR Log Messages
float Attribute LogError from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop ResourceManager
Details Total FATAL Log Messages
float Attribute LogFatal from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop ResourceManager
Details Total INFO Log Messages
float Attribute LogInfo from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop ResourceManager
Details Total WARN Log Messages
float Attribute LogWarn from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop ResourceManager
Details Users Active integer Attribute ActiveUsers from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Memory Current Heap Memory Committed
float Attribute MemHeapCommit-tedM from Bean Hadoop:ser-vice=\w+,name=JvmMetrics
Hadoop ResourceManager
Memory Current Heap Memory Used
float Attribute MemHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
Memory Current Non-heap Memory Committed
float Attribute MemNonHeapCom-mittedM from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop ResourceManager
Memory Current Non-heap Memory Used
float Attribute MemNonHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop ResourceManager
Memory Garbage Collection Count
integer Attribute GcCount from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop ResourceManager
Memory Garbage Collection Count Mark Sweep Compact
integer Attribute GcCountMarkSweep-Compact from Bean Hadoop:-service=\w+,name=JvmMetrics
Hadoop ResourceManager
Memory Garbage Collection Time
integer Attribute GcTimeMillis from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
Memory Garbage Collection Time Mark Sweep Compact
integer Attribute GcTimeMillisMark-SweepCompact from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop ResourceManager
Memory Maximum Heap Memory Size
float Attribute MemHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
43 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop ResourceManager
Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics
Hadoop ResourceManager
Memory Maximum Non-heap Memory Size
float Attribute MemNonHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics
Hadoop ResourceManager
Memory Queue Memory Allocated
float Attribute AllocatedMB from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Memory Queue Memory Available
float Attribute AvailableMB from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root
Hadoop ResourceManager
Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem
Hadoop ResourceManager
Memory Used Physical Memory float Used Physical Memory
Hadoop ResourceManager
Memory Used Physical Memory float Used Physical Memory
Hadoop ResourceManager
Status High Availability Failover Occurred
string High Availability Failover Oc-curred
Hadoop ResourceManager
Status High Availability State string High Availability State
Hadoop ResourceManager
Status Node Status string Node Status
Hadoop ResourceManager
Status NodeManagers Active integer Attribute NumActiveNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics
Hadoop ResourceManager
Status NodeManagers Decommissioned
integer Attribute NumDecommis-sionedNMs from Bean Ha-doop:service=ResourceMan-ager,name=ClusterMetrics
Hadoop ResourceManager
Status NodeManagers Lost integer Attribute NumLostNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics
Hadoop ResourceManager
Status NodeManagers Rebooted
integer Attribute NumRebootedNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics
Hadoop ResourceManager
Status NodeManagers Unhealthy
integer Attribute NumUnhealthyNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics
Hadoop ResourceManager
Status Power State string Power State
44 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop ResourceManager
Uncategorized Group Resolution Average Time
float Attribute GetGroupsAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop ResourceManager
Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop ResourceManager
Uncategorized Kerberos Login Failure Average Time
float Attribute LoginFailureAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop ResourceManager
Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop ResourceManager
Uncategorized Kerberos Login Success Average Time
float Attribute LoginSuccessAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics
Hadoop ResourceManager
Uncategorized Kerberos Login Successes
integer Attribute LoginSuccessNu-mOps from Bean Hadoop:ser-vice=\w+,name=UgiMetrics
Hadoop ResourceManager
Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop ResourceManager
Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop ResourceManager
Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop ResourceManager
Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop ResourceManager
Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop ResourceManager
Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop ResourceManager
Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
Hadoop ResourceManager
Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats
45 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
RESOURCE KIND RESOURCE GROUP
RESOURCE ATTRIBUTE
ATTRIBUTE TYPE
ATTRIBUTE DESCRIPTION
Hadoop ResourceManager
Relationships Cluster Parents string List of parent Cluster resources
Hadoop ResourceManager
Relationships KVM Virtual Machine Parents
string List of parent KVM Virtual Ma-chine resources
Hadoop ResourceManager
Relationships NodeManager Children string List of child NodeManager resources
Hadoop ResourceManager
Relationships Nutanix Virtual Machine Parents
string List of parent Nutanix Virtual Machine resources
Hadoop ResourceManager
Relationships Virtual Machine Parents string List of parent Virtual Machine resources
10. Appendix II: AlertsThe vROps Management Pack for Apache Hadoop creates alerts based on various symptoms that it detects in the environment. See the table below for details regarding each alert.
Table 2: Management Pack Alerts
NAME DESCRIPTION SYMPTOM RECOMMENDATION
Node Managers Unhealthy Immediate
Node Manager(s) have failed YARN health checks.
Node Managers Unhealthy Check that NodeManagers have adequate disk space available.
Node Managers Unhealthy Critical
Node Manager(s) have failed YARN health checks.
Node Managers Unhealthy Check that NodeManagers have adequate disk space available.
NameNode High Availability State Changed
NameNode is now the active NameNode.
NameNode High Availability Failover Occurred
If unplanned, check the status of the previously active NameNode.
NameNode Missing Blocks Blocks missing. NameNode may be unhealthy.
NameNode Missing Blocks Check for NameNode in maintenance.
NameNode Unreachable NameNode is unreachable. NameNode Unreachable Check the NameNode to ensure it is functional.
NameNode Volume Failures
At least one volume has failed.
NameNode Volume Failures
Replace volume or NameNode to prevent data loss.
NameNode Volume Failures
At least one volume has failed.
NameNode Volume Failures
Replace volume or NameNode to prevent data loss.
NameNode Dead DataNodes
At least one DataNode is dead.
NameNode Number of DataNodes Dead
Replace DataNode to prevent data loss.
DataNode Used Capacity Used disk capacity threshold exceeded.
DataNode Used Capacity Add disks to DataNode.
DataNode Unreachable DataNode is unreachable. DataNode Unreachable Check the DataNode to ensure it is functional.
DataNode Dead DataNode is Dead. DataNode Dead Check the DataNode to ensure it is functional.
46 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide
NAME DESCRIPTION SYMPTOM RECOMMENDATION
DataNode Decommissioned
DataNode is Decommissioned.
DataNode Decommissioned
Check the DataNode to ensure it is functional.
ResourceManager Unreachable
ResourceManager is unreachable
ResourceManager Unreachable
Check the ResourceManager to ensure it is functional.
ResourceManager Used Memory
Used disk capacity threshold exceeded.
ResourceManager Used Memory
Add DataNodes or disks to existing DataNodes.
ResourceManager Used Memory
Used disk capacity threshold exceeded.
ResourceManager Used Memory
Add DataNodes or disks to existing DataNodes.
ResourceManager High Availability State Changed
ResourceManager is now the active ResourceManager.
ResourceManager High Availability Failover Occurred
If unplanned, check the status of the previously active ResourceManager.
NodeManager Unreachable
NodeManager is unreachable.
NodeManager Unreachable
Check the NodeManager to ensure it is functional.
11. Appendix III: Capacity DefinitionsThe Management Pack for Apache Hadoop uses the following capacity definitions, which help determine the value of Analysis Badges for Apache Hadoop virtual machines and host systems within vRealize Operations (refer to section “7. Analysis Badges”).
Table 3: Capacity Definitions
CONTAINER USE IN WORKLOAD?
Apache Hadoop Name Node
vRealize Calculated Disk Capacity yes
vRealize Calculated OS Memory Capacity yes
Apache Hadoop Data Node
vRealize Calculated Disk Capacity yes
vRealize Calculated OS Memory Capacity yes
Apache Hadoop Resource Manager
vRealize Calculated OS Memory Capacity yes
Apache Hadoop Node Manager
vRealize Calculated OS Memory Capacity yes
vRealize Calculated VCores Capacity yes
You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.
The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].
Copyright © 2017 Blue Medora Inc. All rights reserved. U.S. and international copyright and intellectual property laws protect this product. Blue Medora is a registered trademark or trademark of Blue Medora in the United States and/or other jurisdictions.
The Hadoop name (including Apache Hadoop) and logo are trademarks or registered trademarks of the Apache Hadoop project in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies.
Blue Medora3225 N Evergreen Dr. NE Suite 103Grand Rapids, MI 49525
www.bluemedora.com