Kafka

Supported Types

MetricsLogsTraces

Configuration Table

ParameterTypeDefaultDescription
protocol_versionenum"2.0.0"The Kafka protocol version to use when communicating with brokers. Valid values are: "2.2.1", "2.2.0", "2.0.0", or "1.0.0".
brokersstringslocalhost:9092A list of the brokers to connect to when sending metrics, traces, and logs.
timeoutint5Timeout (seconds) for every attempt to send data to the backend.
enable_metricsbooltrue
metric_topicstringotlp_metricsThe name of the topic to export metrics to.
enable_logsbooltrue
log_topicstringotlp_logsThe name of the topic to export logs to.
enable_tracesbooltrue
trace_topicstringotlp_spansThe name of the topic to export traces to.
compressionenumgzipThe compression algorithm to use when publishing data to Kafka. Options are gzip, snappy, lz4, and none.
log_encodingenumotlp_protoThe encoding to use when publishing logs to Kafka. Options are otlp_proto, otlp_json, and raw.
metric_encodingenumotlp_protoThe encoding to use when publishing metrics to Kafka. Options are otlp_proto and otlp_json.
trace_encodingenumoltp_protoThe encoding to use when publishing traces to Kafka. Options are otlp_proto, otlp_json, jaeger_proto, jeager_json, zipkin_proto, and zipkin_json.
enable_authboolfalse
auth_typeenumbasicbasic, sasl, or kerberos
basic_usernamestring
basic_passwordstring
sasl_usernamestring
sasl_passwordenum
sasl_mechanismstringSCRAM-SHA-256SCRAM-SHA-256, SCRAM-SHA-512, or PLAIN
kerberos_service_namestring
kerberos_realmstring
kerberos_config_filestring/etc/krb5.conf
kerberos_auth_typeenumkeytabkeytab or basic
kerberos_keytab_filestring/etc/security/kafka.keytab
kerberos_usernamestring
kerberos_passwordstring

Supported Retry and Queuing Settings

This destination supports the following retry and queuing settings:

Sending QueuePersistent QueueRetry on Failure