Migrating from open-source Apache Kafka to Event Streams

If you are using open-source Apache Kafka as your event-streaming platform, you can move to Event Streams and benefit from its features and enterprise-level support.

Prerequisites

Ensure you have an Event Streams deployment available. See the instructions for installing on your platform.

For many of the tasks, you can use the Kafka console tools. Many of the console tools work with Event Streams, as described in the using console tools topic.

Create the required topics in Event Streams

In Event Streams, create the same set of topics that have been deployed in the open-source Kafka cluster.

To list these topics, run the following Kafka console tool:

./kafka-topics.sh --bootstrap-server <host>:<port> --describe

For each existing topic, create a new topic in Event Streams with the same name. Ensure you use the same partition and replica settings, as well as any other non-default settings that were applied to the existing topic in your open-source Kafka instance.

Change producer configuration

Change the configuration for applications that produce messages to your open-source Kafka cluster to connect to Event Streams instead as described in connecting clients.

If you are using the Kafka console tools, see the instructions for the example console producer in using the console tools to change where the messages are produced to.

Change consumer configuration

Change the configuration for applications that consume messages from your open-source Kafka cluster to connect to Event Streams instead as described in connecting clients.

If you are using the Kafka console tools, see the instructions for the example console consumer in using the console tools to change where messages are consumed from.