Create a connection

A connection in Imply Polaris defines a source of data to ingest into a table. You can create multiple jobs from a single connection. This allows you to ingest data from the connection into multiple tables. If a table already has an ingestion job sourced from a streaming connection, you cannot create another job to stream data into that table.

Polaris supports the following connection sources:

• Amazon S3
• Azure Blob Storage
• Apache Kafka
• Confluent Cloud
• Amazon MSK
• Kafka on Event Hubs
• Amazon Kinesis
• Push streaming
• Confluent Schema Registry

Connections are not required for ingesting from Polaris tables or from files uploaded to Polaris. For more information on ingestion sources, see Ingestion sources overview.

Connections to certain sources of data require credentials for Polaris to access the data. The connection type determines what credentials are required. Polaris never displays existing credentials.

This topic describes how to create and manage connections in Polaris and how to ingest data into Polaris from the connection.

Prerequisites

The following permissions are required for ingestion jobs involving connections:

• ManageTables to create and edit tables
• ManageConnections to create and edit connections
• ManageIngestionJobs to create ingestion jobs

For more information on permissions, see Permissions reference.

Create a connection

To create a new connection:

1. Click Sources from the left navigation menu. You can also add connections when you create a new table or add data to an existing table.

   The following screenshot shows the sources view:

   

2. Click Create source and select the desired source. Polaris displays a New connection dialog with form fields specific to the connection.

   

3. Provide the following information for the connection:

   • Connection name. The name of the connection in Polaris. The connection name must be unique within your Polaris organization and cannot be changed. A valid connection name is limited to 64 characters. Valid characters include alphanumeric characters, periods, hyphens, and underscores.
   • Description. An optional description of the connection.
   • Other details specific to the connection type. Visit the reference topic for each connection source for more information. For an overview of available ingestion sources, see Ingestion sources overview.

   

4. Verify the connection is successful before creating the connection. Select Test connection from the New connection dialog.

   The following screenshot shows an example of a successful connection:

   

   Polaris displays a warning if it is unable to connect to the data source; however, you can still save your connection information.

5. Click Create connection to create the connection.

Your connections are displayed by source type on the Sources page. Click the ellipsis icon next to any connection to edit, test, or delete the connection.

Manage connections

Only users who have permissions to create connections can update and remove connection credentials and delete connections.

You can modify or delete an inactive connection. If the connection has an active ingestion job, cancel the job before you update or delete the connection.

To delete a connection:

1. Navigate to Sources from the left pane.
2. Click the ellipsis icon next to the connection and select Delete.
3. Confirm the request.

Learn more

See the following topics for more information:

• Ingestion sources overview for sources of data ingestion supported in Polaris.
• Create an ingestion job for instructions on how to ingest data from a connection.
• Connections v1 API for information on creating and managing connections using the API.