Apache Kafka integration

Open in

Kafka integrations enable you to automatically forward events that occur in Ably to Kafka topics.

Create a Kafka integration

On the Integrations page of your app:

  1. Click New Integration Rule.
  2. Choose Firehose.
  3. Choose Kafka.
  4. Configure the Kafka settings.
  5. Click Create.

Settings

The following settings are available when creating a Kafka integration:

SettingDescription
SourceSpecifies the event types being sent to Kafka.
Channel filterFilters the source channels based on a regular expression.
EncodingSpecifies the encoding format of messages. Either JSON or MsgPack.
EnvelopedCheckbox to set whether messages should be enveloped or not. Enveloped is the default.
Routing keySpecifies the routing key used to route messages to Kafka topics.
MechanismThe SASL/SCRAM mechanism used for Kafka connection.
UsernameThe username to connect to Kafka with.
PasswordThe password to connect to Kafka with.
BrokersList of Kafka broker endpoints in the format <host>:<port>.

Authentication mechanism

The available authentication mechanisms for Kafka are: