可视化和监控解决方案
可视化和监控解决方案  /  监控 Apache Hadoop
Apache Hadoop logo

使用 Grafana 轻松监控 Apache Hadoop

使用 Grafana Cloud 的开箱即用监控解决方案,轻松监控 Apache Hadoop,这是一个旨在在分布式计算机集群中处理和存储大量数据的开源框架 。Grafana Cloud 永久免费套餐包含 3 个用户和高达 1 万个时间序列指标,以满足您的监控需求。

Apache Hadoop NameNode overview (1/2)
Apache Hadoop NameNode 概览 (1/2)
Apache Hadoop DataNode overview (1/1)
Apache Hadoop DataNode 概览 (1/1)
Apache Hadoop NodeManger overview (1/2)
Apache Hadoop NodeManager 概览 (1/2)
Apache Hadoop ResourceManger overview (1/2)
Apache Hadoop ResourceManager 概览 (1/2)

包含的关键指标

hadoop_datanode_blocksremoved
hadoop_datanode_ramdiskblocksevictedwithoutread
hadoop_datanode_volumefailures
hadoop_namenode_blockstotal
hadoop_namenode_capacityremaining
hadoop_namenode_capacitytotal
hadoop_namenode_capacityused
hadoop_namenode_filestotal
hadoop_namenode_missingblocks
hadoop_namenode_numdeaddatanodes
hadoop_namenode_totalload
hadoop_namenode_transactionssincelastcheckpoint
hadoop_namenode_underreplicatedblocks
hadoop_namenode_volumefailurestotal
hadoop_nodemanager_allocatedcontainers
hadoop_nodemanager_allocatedgb
hadoop_nodemanager_allocatedvcores
hadoop_nodemanager_applicationsrunning
hadoop_nodemanager_availablegb
hadoop_nodemanager_availablevcores
hadoop_nodemanager_containerlaunchdurationavgtime
hadoop_nodemanager_containerscompleted
hadoop_nodemanager_containersfailed
hadoop_nodemanager_containersiniting
hadoop_nodemanager_containerskilled
hadoop_nodemanager_containerslaunched
hadoop_nodemanager_containerspaused
hadoop_nodemanager_containersreiniting
hadoop_nodemanager_containerusedmemgb
hadoop_nodemanager_containerusedvmemgb
hadoop_nodemanager_gccount
hadoop_nodemanager_gctimemillis
hadoop_nodemanager_localizationdurationmillisavgtime
hadoop_nodemanager_memheapcommittedm
hadoop_nodemanager_memheapusedm
hadoop_nodemanager_memnonheapcommittedm
hadoop_nodemanager_memnonheapusedm
hadoop_nodemanager_nodecpuutilization
hadoop_nodemanager_nodegpuutilization
hadoop_resourcemanager_activeapplications
hadoop_resourcemanager_allocatedmb
hadoop_resourcemanager_allocatedvcores
hadoop_resourcemanager_appscompleted
hadoop_resourcemanager_appsfailed
hadoop_resourcemanager_appskilled
hadoop_resourcemanager_appspending
hadoop_resourcemanager_appsrunning
hadoop_resourcemanager_appssubmitted
hadoop_resourcemanager_availablemb
hadoop_resourcemanager_availablevcores
hadoop_resourcemanager_gccount
hadoop_resourcemanager_gctimemillis
hadoop_resourcemanager_memheapcommittedm
hadoop_resourcemanager_memheapusedm
hadoop_resourcemanager_memnonheapcommittedm
hadoop_resourcemanager_memnonheapusedm
hadoop_resourcemanager_numactivenms
hadoop_resourcemanager_numdecommissionednms
hadoop_resourcemanager_numlostnms
hadoop_resourcemanager_numrebootednms
hadoop_resourcemanager_numshutdownnms
hadoop_resourcemanager_numunhealthynms

包含的关键告警规则

ApacheHadoopLowHDFSCapacity
ApacheHadoopHDFSMissingBlocks
ApacheHadoopHDFSHighVolumeFailures
ApacheHadoopHighDeadDataNodes
ApacheHadoopHighNodeManagerCPUUsage
ApacheHadoopHighNodeManagerMemoryUsage
ApacheHadoopHighResourceManagerVirtualCoreCPUUsage
ApacheHadoopHighResourceManagerMemoryUsage