Supported Metrics

The following tabs represent the Metric Category of Apache Kafka app.

Tabbed Interface with Table
Availability
Performance
Usage
Capacity
Native TypeMetric NameDisplay NameUnitsApplication VersionDescription
Apache Kafka Brokerapache_kafka_broker_jvm_uptimeApache Kafka Broker jvm Uptimems1.0.0Uptime of the server.
apache_kafka_broker_LastAppliedRecordLagMsApache Kafka Broker LastAppliedRecordLagMsms1.0.0The difference between now and the timestamp of the last record from the cluster metadata partition that was applied by the broker.
apache_kafka_broker_MetadataLoadErrorCountApache Kafka Broker MetadataLoadErrorCountcount1.0.0The number of errors encountered by the BrokerMetadataListener while loading the metadata log and generating a new MetadataDelta based on it.
apache_kafka_broker_MetadataApplyErrorCountApache Kafka Broker MetadataApplyErrorCountcount1.0.0The number of errors encountered by the BrokerMetadataPublisher while applying a new MetadataImage based on the latest MetadataDelta.
<
Native TypeMetric NameDisplay NameUnitsApplication VersionDescription
Apache Kafka Brokerapache_kafka_broker_net_bytesoutApache kafka broker NetBytesOutBps1.0.0Average number of bytes sent per second in the last 1/5/15/ minute and average per second
apache_kafka_broker_net_bytesinApache kafka broker NetBytesInBps1.0.0Bytes received per second in the last 1/5/15 minute and average per second
apache_kafka_broker_messagesinApache kafka broker MessagesInCount per sec1.0.0Messages per second in the last 1/5/15 minute (EWMA) and average per second
apache_kafka_broker_request_producefailedApache kafka broker RequestProduceFailedcount1.0.0Failed produce request rate over the last 1/5/15 minute (EWMA) and average per second(Meanrate)
apache_kafka_broker_request_fetchfailedApache Kafka Broker RequestFetchFailedcount1.0.0Rate of failed fetch requests in the last 1/5/15 minute and average per second(Meanrate)
apache_kafka_broker_replication_isrshrinksApache Kafka Broker Replication IsrShrinkscount1.0.0ISR shrink events per second over the last 1/5/15 minute and average per second(Meanrate)
apache_kafka_broker_replication_isrexpandsApache Kafka Broker Replication IsrExpandscount1.0.0ISR expand events per second over the last 1/5/15 minute and average per second(Meanrate)
apache_kafka_broker_metrics_produceremotetimeApache Kafka Broker Metrics Produceremotetimems1.0.0Average processing time (ms)
apache_kafka_broker_metrics_offsetsrespqueuetimeApache Kafka Broker Metrics OffsetsRespQueueTimems1.0.0Average queuing time (ms)
apache_kafka_broker_metrics_offsetsreqqueuetimeApache Kafka Broker Metrics OffsetsReqQueueTimems1.0.0Average queue time (ms)
apache_kafka_broker_metrics_offsetcommitremotetimeApache Kafka Broker Metrics OffsetCommitRemoteTimems1.0.0Average processing time (ms)
apache_kafka_broker_metrics_offsetcommitrespqueuetimeApache Kafka Broker Metrics OffsetCommitRespQueueTimems1.0.0Average processing time (ms)
apache_kafka_broker_request_fetchtimeavgApache Kafka Broker Request FetchTimeAvgms1.0.0Request total time.
apache_kafka_broker_request_fetchtime99percentileApache Kafka Broker Request FetchTime99Percentilems1.0.0Time to produce requests for the 99th percentile.
apache_kafka_broker_fetch_followerlocaltimeApache Kafka Broker Fetch FollowerLocalTimems1.0.0Average time spent in response queue (ms)
apache_kafka_broker_fetch_followerrespqueuetimeApache Kafka Broker Fetch FollowerRespQueueTimems1.0.0Average time spent in request queue (ms)
apache_kafka_broker_fetch_consumerreqqueuetimeApache Kafka Broker Fetch ConsumerReqQueueTimems1.0.0Time the request waiting in the request queue.
apache_kafka_broker_fetch_consumerrespsendtimeApache Kafka Broker Fetch ConsumerRespSendTimems1.0.0Average time taken to send response (ms)
apache_kafka_broker_fetch_consumertotaltimeApache Kafka Broker Fetch ConsumerTotalTimems1.0.0Average total time taken (ms)
apache_kafka_broker_metadata_reqqueuetimeApache Kafka Broker Metadata ReqQueueTimems1.0.0Time the request waiting in the request queue.
apache_kafka_broker_request_metadatatimeavgApache Kafka Broker Request MetadataTimeAvgms1.0.0Request total time.
apache_kafka_broker_request_metadatatime99percentileApache Kafka Broker Request MetadataTime99Percentilems1.0.0Time to metadata requests for the 99th percentile.
apache_kafka_broker_log_flushrateApache Kafka Broker Log FlushRatems1.0.0Log flush rate and time.
apache_kafka_broker_request_producetime99percentileApache Kafka Broker Request ProduceTime99Percentilems1.0.0Time to produce requests for the 99th percentile.
apache_kafka_broker_request_offsetstimeavgApache Kafka Broker Request OffsetsTimeAvgms1.0.0Average time for an offset request.
apache_kafka_broker_request_offsetstime99percentileApache Kafka Broker Request OffsetsTime99Percentilems1.0.0Time for offset requests for the 99th percentile.
apache_kafka_broker_LastAppliedRecordOffsetApache Kafka Broker LastAppliedRecordOffsetcount1.0.0The offset of the last record from the cluster metadata partition that was applied by the broker
Apache Kafka Topicapache_kafka_topic_consumer_lagApache Kafka Topic ConsumerLagcount1.0.0Lag in the consumer data.
apache_kafka_topic_consumer_currentoffsetApache Kafka Topic ConsumerCurrentOffsetcount1.0.0Kafka Consumer current Offset
apache_kafka_topic_consumer_endoffsetApache Kafka Topic ConsumerEndOffsetcount1.0.0Kafka Consumer end Offset
Native TypeMetric NameDisplay NameUnitsApplication VersionDescription
Apache Kafka Brokerapache_kafka_broker_replication_underreplicatedpartitionsApache Kafka Broker Replication Under ReplicatedPartitionscount1.0.0Number of under replicated partitions (|ISR| < |all replicas|).
apache_kafka_broker_replication_partitionsApache Kafka Broker Replication Partitionscount1.0.0Partition counts.
apache_kafka_broker_replication_leadercountApache Kafka Broker Replication Leader Countcount1.0.0Leader replica counts.
Native TypeMetric NameDisplay NameUnitsApplication VersionDescription
Apache Kafka Brokerapache_kafka_broker_jvm_memheapcommittedApache Kafka Broker jvm MemHeapCommittedMB1.0.0Heap memory committed (in MB) for the server.
apache_kafka_broker_jvm_memheapusedApache Kafka Broker jvm MemHeapUsedMB1.0.0Heap memory usage (in MB) of the server.
apache_kafka_broker_jvm_memnonheapcommittedApache Kafka Broker jvm MemNonHeapCommittedMB1.0.0Non-heap memory usage (in MB) of the server.
apache_kafka_broker_jvm_memnonheapusedApache Kafka Broker jvm MemNonHeapUsedMB1.0.0Kafka JVM Mem non_heap_used.
apache_kafka_broker_jvm_threadsApache Kafka Broker jvm Threadscount1.0.0Number of threads.
apache_kafka_broker_jvm_openfdsApache Kafka Broker jvm OpenFdscount1.0.0Number of Open file descriptors of the server.

Default Monitoring Configurations

Apache Kafka provides default monitoring components that include:

  • Global Device Management Policies
  • Global Templates
  • Global Monitors

Upon installation, the system automatically applies these configurations. To tailor them to your environment, clone the global versions, adjust thresholds, and refine alerting behavior.

Customize the configurations before installing the application to prevent unnecessary alerts and reduce noise.

  1. Default Global Device Management Policies

    You can find the Device Management Policy for each Native Type at Setup > Resources > Device Management Policies. Search with suggested names in global scope:

    {appName nativeType - version}

    Example: apache-kafka Apache Kafka Topic - 1 (i.e appName = apache-kafka nativeType = Apache Kafka Topic , version = 1)

  2. Default Global Templates

    You can find the Global Templates for each Native Type at Setup > Monitoring > Templates. Search with suggested names in global scope. Each template adheres to the following naming convention:

    {appName nativeType 'Template' - version}

    Example: apache-kafka Apache Kafka Topic Template - 1 (i.e appName = apache-kafka, nativeType = Apache Kafka Topic, version = 1)

  3. Default Global Monitors

    You can find the Global Monitors for each Native Type at Setup > Monitoring > Monitors. Search with suggested names in global scope. Each Monitors adheres to the following naming convention:

    {monitorKey appName nativeType - version}

    Example: Apache Kafka Topic Monitor apache-kafka Apache Kafka Topic 1 (i.e, monitorKey=Apache Kafka Topic Monitor, appName = apache-kafka nativeType = Apache Kafka Topic,version = 1)