Skip to main content

Connect to Apache Kafka on Azure Event Hubs

info

This is a beta feature available to select customers. Imply must enable the feature for you. Contact your Polaris support representative to find out more.

To ingest data from Apache Kafka on Azure Event Hubs into Imply Polaris, create a Kafka connection and use it as the source of an ingestion job. This topic provides reference information specific to Kafka on Event Hubs.

For details on creating the Kafka connection, see Connect to Apache Kafka.

Prerequisites​

To connect to your Kafka topics on Event Hubs, ensure that your Event Hubs namespace has its Kafka surface set to enabled. This setting is applied by default to the standard pricing tier of Event Hubs. It is not supported by the basic tier.

Connection information​

The details required for a Kafka connection are described in Connect to Apache Kafka.

Authentication​

On Event Hubs, create a shared access policy from the settings of the Event Hubs instance. Authorize Listen rights for Polaris to receive messages.

For the connection in Polaris, select the SASL/PLAIN authentication mechanism.

  • For the username, enter $ConnectionString.
  • The password is the connection string of the Event Hubs namespace. For example, Endpoint=sb://NAMESPACE.servicebus.windows.net/;SharedAccessKeyName=SAS_POLICY_NAME;SharedAccessKey=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx;EntityPath=EVENT_HUB_NAME.