使用 Grafana 轻松监控 Apache Spark
使用 Grafana Cloud 的开箱即用监控解决方案，轻松监控 Apache Spark，一个用于大规模数据处理的统一分析引擎。Grafana Cloud 永久免费计划包含 3 个用户和多达 1 万个指标序列，可满足您的监控需求。
包含的关键指标
metrics_master_workers_Number
metrics_spark_app_driver_BlockManager_disk_diskSpaceUsed_MB_Number
metrics_spark_app_driver_BlockManager_memory_maxMem_MB_Number
metrics_spark_app_driver_BlockManager_memory_maxOffHeapMem_MB_Number
metrics_spark_app_driver_BlockManager_memory_maxOnHeapMem_MB_Number
metrics_spark_app_driver_DAGScheduler_job_activeJobs_Number
metrics_spark_app_driver_DAGScheduler_job_allJobs_Number
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_Max
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_Mean
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_Min
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_StdDev
metrics_spark_app_driver_DAGScheduler_stage_failedStages_Number
metrics_spark_app_driver_DAGScheduler_stage_runningStages_Number
metrics_spark_app_driver_DAGScheduler_stage_waitingStages_Number
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Count
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Max
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Mean
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Min
metrics_worker_coresFree_Number
metrics_worker_coresUsed_Number
metrics_worker_memFree_MB_Number
metrics_worker_memUsed_MB_Number