To use Kafka topics to store events in IBM Event Streams, create and configure a Kafka topic.
Using the UI
- Log in to the Event Streams UI from a supported web browser (see how to determine the login URL for your Event Streams UI).
- Click Home in the primary navigation.
- Click the Create a topic tile.
Enter a topic name in the Topic name field, for example,
my-topic. This is the name of the topic that an application will be producing to or consuming from.
Enter the number of Partitions, for example,
1. Partitions are used for scaling and distributing topic data across the Apache Kafka brokers. For the purposes of a basic starter application, using only 1 partition is sufficient.
Select a Message retention, for example, A day. This is how long messages are retained before they are deleted.
Select a replication factor in Replicas, for example, Replication factor: 1. This is how many copies of a topic will be made for high availability. For production environments, select Replication factor: 3 as a minimum.
- Click Create topic. The topic is created and can be viewed from the Topics tab located in the primary navigation.
Note: To view all configuration options you can set for topics, set Show all available options to On.
Note: Kafka supports additional topic configuration settings. Enable Show all available options to access more detailed configuration settings if required.
Using the CLI
Log in to your cluster as an administrator by using the IBM Cloud Pak CLI:
cloudctl login -a https://<cluster_address>:<cluster_router_https_port>
Find out how to retrieve the login URL for your Event Streams CLI.
Run the following command to initialize the IBM Event Streams CLI on the cluster:
cloudctl es init
Run the following command to create a topic:
cloudctl es topic-create --name <topic-name> --partitions <number-of-partitions> --replication-factor <replication-factor>
For example, to create a topic called
my-topicthat has 1 partition, a replication factor of 1, and 1 day set for message retention time (provided in milliseconds):
cloudctl es topic-create --name my-topic --partitions 1 --replication-factor 1 --config retention.ms=86400000
Important: Do not set
<replication-factor>to a greater value than the number of available brokers.
Note: To view all configuration options you can set for topics, use the help option as follows:
cloudctl es topic-create --help
Kafka supports additional topic configuration settings. Extend the topic creation command with one or more
--config <property>=<value> properties to apply additional configuration settings. The following additinal properties are currently supported: