
Step 2: Create a Kafka User
Superstream requires a Kafka user with the following configuration to communicate and analyze connected clusters.
By Kafka flavor/vendor:
AWS MSK
Option 1: Create or Update Superstream Role
Be sure you’re signed in to the AWS Console with your default browser, then click here:
Enter required parameters (e.g., NodeGroupRoleArn).
Acknowledge IAM resource creation.
Click Create Stack or Update Stack (choose Update Stack if the Superstream IAM role already exists).
Confirm status: CREATE_COMPLETE or UPDATE_COMPLETE.
Click on "Resources," then select "SuperstreamAgentRole" to retrieve the IAM Role ARN. Use this ARN in the Superstream console.
Option 2: Create or Update Superstream User
Be sure you’re signed in to the AWS Console with your default browser, then click here:
Acknowledge IAM resource creation.
Click Create Stack or Update Stack (choose Update Stack if the Superstream IAM user already exists).
Confirm status: CREATE_COMPLETE or UPDATE_COMPLETE (appears on the left side of the screen).
Click on "Resources" and then click on the created user called "SuperstreamAgentUser".
Click on the "Security Credentials" tab, then select "Create access key." Choose "Third-party service" and generate the key. Use this key in the Superstream Console.
Confluent Cloud
Step 1: Create a new Service Account
In Confluent Console: Top-right menu -> Accounts & access -> Accounts -> Service Accounts -> "Add service account"
Name the service account "
Superstream
" (The Service account name must include the word "Superstream".)Set account type to "None"
Click on the organization -> Add role assignment(top right) and add the following permissions:
BillingAdmin
- on the organization levelResourceKeyAdmin
- on the organization levelMetricsViewer
In case you want Superstream to connect only with clusters in a specific environment, please grant
EnvironmentAdmin
- for each environment you want to connect with SuperstreamOptional: In case you want Superstream to connect only with specific clusters, please grant
CloudClusterAdmin
for each such cluster instead of grantingEnvironmentAdmin
for the entire environment
Step 2: Create a Cloud Resource Management Key
In Confluent Console: Top-right menu -> API Keys -> + Add API key
Select Service account, search for the created service account from the previous step, and choose None for the account type
Select Cloud Resource Management
Use the created key in the Superstream console.
Aiven
Step 1: Create a Token
In Aiven console: Click on user information (top right) -> Tokens -> Generate token
Use the created credentials in the Superstream console.
Step 2: Creating a Kafka User
Make sure the Kafka user you are giving to Superstream has the ACLs appear below.
Other
Create a dedicated Kafka user for Superstream with the following ACLs
// cluster ACLs
{"CLUSTER", "kafka-cluster", "LITERAL", "ALTER_CONFIGS", "ALLOW"}
{"CLUSTER", "kafka-cluster", "LITERAL", "DESCRIBE", "ALLOW"}
{"CLUSTER", "kafka-cluster", "LITERAL", "DESCRIBE_CONFIGS", "ALLOW"}
{"CLUSTER", "kafka-cluster", "LITERAL", "CREATE", "ALLOW"}
// consumers groups ACLs
{"GROUP", "*", "LITERAL", "DELETE", "ALLOW"}
{"GROUP", "*", "LITERAL", "DESCRIBE", "ALLOW"}
{"GROUP", "*", "LITERAL", "READ", "ALLOW"}
// topics ACLs
{"TOPIC", "*", "LITERAL", "ALTER", "ALLOW"}
{"TOPIC", "*", "LITERAL", "ALTER_CONFIGS", "ALLOW"}
{"TOPIC", "*", "LITERAL", "DELETE", "ALLOW"}
{"TOPIC", "*", "LITERAL", "DESCRIBE", "ALLOW"}
{"TOPIC", "*", "LITERAL", "DESCRIBE_CONFIGS", "ALLOW"}
{"TOPIC", "*", "LITERAL", "READ", "ALLOW"}
{"TOPIC", "*", "LITERAL", "WRITE", "ALLOW"}
{"TOPIC", "*", "LITERAL", "CREATE", "ALLOW"}
Last updated
Was this helpful?