Skip to main content

Kafka Sink Configuration

The Kafka decision log sink allows publishing decision log entries as messages on a Kafka topic. It is configured by creating a sink with an output.type of kafka.

Example Configuration

decision_logs:
plugin: eopa_dl
plugins:
eopa_dl:
output:
- type: kafka
urls:
- kafka.internal:9092
topic: logs
timeout: "10s"
tls:
cert: path/to/cert.pem
private_key: path/to/key.pem
ca_cert: path/to/ca.pem
skip_cert_verify: false # default false
batching:
at_period: "10s" # flush batch every 10 seconds
at_count: 10 # flush batch every 10 log entries
at_bytes: 10240 # flush batch whenever 10240 bytes are exceeded
array: true # combine log entries into JSON array (default: lines of JSON objects)
compress: true # compress payload with gzip (default: false)
FieldTypeRequiredDefaultDescription
output.urlsArray of stringYesAddress to connect to Kafka.
output.topicstringYesThe Kafka topic where logs are written.
output.timeoutstringNoTimeout (e.g. 10s)
output.tlsObjectNoSee TLS configuration
output.batchingObjectNoSee Batching configuration
output.mask_decisionstringNoSee Mask and Drop decisions configuration
output.drop_decisionstringNoSee Mask and Drop decisions configuration