2023.03

2023.03

  • Imply
  • Ingest
  • Query
  • Visualize
  • Administer
  • Deploy

›Manager

Overview

  • About Imply administration

Manager

  • Using Imply Manager
  • Managing Imply clusters
  • Imply Manager security
  • Extensions

Users

  • Imply Manager users
  • Druid API access
  • Authentication and Authorization

    • Get started with Imply Hybrid Auth
    • Authentication
    • Local users
    • User roles
    • User groups
    • User sessions
    • Brute force attack detection
    • Identity provider integration
    • Okta OIDC integration
    • Okta SAML integration
    • LDAP integration
    • OAuth client authentication

Clarity

  • Monitoring
  • Set up SaaS Clarity
  • Cloudwatch monitoring
  • Metrics

Druid administration

  • Configuration reference
  • Logging
  • API reference
  • Druid design

    • Design
    • Segments
    • Processes and servers
    • Deep storage
    • Metadata storage
    • ZooKeeper

    Data management

    • Overview
    • Data updates
    • Data deletion
    • Schema changes
    • Compaction
    • Automatic compaction

    Security

    • Security overview
    • User authentication and authorization
    • LDAP auth
    • Dynamic Config Providers
    • Password providers
    • Authentication and Authorization
    • TLS support
    • Row and column level security

    Performance tuning

    • Basic cluster tuning
    • Segment size optimization
    • Mixed workloads
    • HTTP compression
    • Automated metadata cleanup

    View Manager

    • View Manager
    • View Manager API
    • Create a view
    • List views
    • Delete a view
    • Inspect view load status
  • Rolling updates
  • Using rules to drop and retain data
  • Alerts
  • Java runtime
  • Working with different versions of Apache Hadoop
  • Misc

    • dump-segment tool
    • reset-cluster tool
    • pull-deps tool
    • Deep storage migration
    • Export Metadata Tool
    • Metadata Migration

Using Imply Manager

Imply Manager gives administrators a visual interface for deploying and managing Imply clusters. It is available in Imply Hybrid (formerly Imply Cloud) and licensed Imply Enterprise (formerly Imply Private) deployments.

Imply Manager is where you create and configure clusters and servers, apply version updates, and monitor your deployment. With Cloud Auth enabled, you can use Imply Manager to configure authentication and authorization policies and perform various user management tasks, such as adding users, defining groups, and assigning permissions.

The following sections provide more details on using Imply Manager. For advanced Imply Manager operation modes, such as using direct access Pivot and crossover Pivot, see Direct access Pivot and On-prem Cloud crossover respectively.

For information specifically on creating and administering Imply clusters, see Cluster management.

Cloud Manager API

Imply Hybrid users can manage Imply clusters using the Cloud Manager API. The Cloud Manager API is a secure, public-facing API that enables integration of cluster management into infrastructure automation frameworks. Use the Cloud Manager API to automate the following:

  • Create a cluster
  • Scale clusters up and down
  • Terminate a cluster

To learn how to use the Cloud Manager API, see Manager API tutorial.

Access user settings

The User management console is a web interface for setting up, monitoring, and managing user access to Imply Hybrid. It encapsulates access settings across the entire organization. It is also where you configure authentication policies and connect third-party identity providers.

To access the User management console from Imply Manager, click on the profile menu in the top right corner. Select User management from the list of menu options.

Update software versions

Imply Manager makes it easier to update software across a cluster.

If the cluster is running in high availability mode, you can apply a rolling update. With a rolling update, servers are updated one at a time, ensuring that servers remain running to maintain service availability while undergoing the update.

Rolling updates are not supported for clusters with more than one Imply service (master, query, data) on a single node.

If your cluster is not highly available, changing to a different version of the product or service (that is, upgrading or downgrading) will interrupt service for your users for a few minutes. In Imply Hybrid, this service downtime may take 15 to 20 minutes.

To update software, follow these steps:

  1. Open the cluster overview page and click Setup. Notice the current version listed in the Imply version field.
  2. From the Imply version dropdown menu, choose the version you want to update to. Imply Manager gets and displays the version number of the latest releases automatically.
  3. Click Apply changes.
  4. Confirm the settings and apply the update.

The update status appears in the cluster overview page. At any point you can cancel the update, which causes Imply Manager to revert the upgrade, including the servers for which the update is complete.

Add custom user files

You can push custom user files to Imply cluster nodes by specifying them in the Setup / Advanced Config section of Imply Manager. These files can be written to the following locations:

  • User files (/opt/imply/user)
  • Druid's classpath
  • as a Hadoop dependency

Additionally, these files can be processed as follows:

  • None
  • Requires unpacking (extracts using tar -x)
  • Is executable (sets chmod +x)

There are two ways to make these files available to the manager:

  • Make them available via HTTP(S) and provide the URL
  • Make them available to the manager locally and reference them using the manager:/// scheme

To make the files available to the manager locally, they will need to be placed in:

  • the /mnt/var/user directory inside the manager container, for Imply Enterprise on Kubernetes
  • the /var/opt/imply/grove/user directory where the manager is running, for Imply Enterprise on Linux

Once the files are available in that directory, reference them using the manager:/// scheme. As an example:

  • File: /mnt/var/user/hdfs-site.xml -> Manager path: manager:///hdfs-site.xml

Lookups

The Lookups page lets you manage Druid lookups. For more information on lookups, see the Apache Druid documentation.

Preview features

Preview features are used to try out early access or other limited access features. Do not use except in consultation with Imply support.

Last updated on 4/20/2022
← About Imply administrationManaging Imply clusters →
  • Cloud Manager API
  • Access user settings
  • Update software versions
  • Add custom user files
  • Lookups
  • Preview features
2023.03
Key links
Try ImplyApache Druid siteImply GitHub
Get help
Stack OverflowSupportContact us
Learn more
Apache Druid forumsBlog
Copyright © 2023 Imply Data, Inc