Connect catalog

Kafka Connect is a framework for connecting Apache Kafka to external systems. It uses source connectors to move data into Apache Kafka, and sink connectors to move data out of Apache Kafka.

The connect catalog contains a list of connectors, converters, and transformations that are supported either by IBM or the relevant community:

IBM supported: Each IBM supported connector is subject to its own license terms. Support is provided by IBM for customers who have a valid license and active software subscription and support entitlement. For more information, see the licensing reference. Raise any issues through the official IBM support channel. In accordance with IBM's standard support terms, IBM will investigate, identify, and provide a fix when possible.
Community supported: Where not identified as IBM supported, each community supported connector is subject to its own set of license terms and not supported by IBM. Raise issues through the community support links provided for each connector.

Note: Event Streams can deploy and manage any Kafka Connect connector, including those not listed in this catalog.

Find out more about Kafka Connect

Connect catalog

Kafka Connect is a framework for connecting Apache Kafka to external systems. It uses source connectors to move data into Apache Kafka, and sink connectors to move data out of Apache Kafka.

The connect catalog contains a list of connectors, converters, and transformations that are supported either by IBM or the relevant community:

IBM supported: Each IBM supported connector is subject to its own license terms. Support is provided by IBM for customers who have a valid license and active software subscription and support entitlement. For more information, see the licensing reference. Raise any issues through the official IBM support channel. In accordance with IBM's standard support terms, IBM will investigate, identify, and provide a fix when possible.
Community supported: Where not identified as IBM supported, each community supported connector is subject to its own set of license terms and not supported by IBM. Raise issues through the community support links provided for each connector.

Note: Event Streams can deploy and manage any Kafka Connect connector, including those not listed in this catalog.

Find out more about Kafka Connect

Filter is active

Have a connector you want added to our catalog?

Back to catalog

Support is provided by IBM

Deprecated

Source connector: produces data into Kafka or Event Streams

Hadoop Distributed File System (HDFS)

Use the HDFS connector to stream existing and new file contents from HDFS folders to Kafka topics.

To use the HDFS source connector, complete the following high-level steps:

Ensure that you have access to an HDFS instance with the required permissions and Kerberos authentication configured to enable streaming of file contents.
Install the Connectivity Pack as part of your Kafka Connect deployment.
Create a KafkaConnect custom resource to define your Kafka Connect runtime and include the configuration, certificates, and connectors for the installed Connectivity Pack.
Apply the configured KafkaConnect custom resource to start the Kafka Connect runtime and verify that the connector is available for use.
Create a KafkaConnector custom resource to define your connector configuration.
Apply the configured KafkaConnector custom resource to start the connector and verify that the connector is running.

For detailed instructions and configuration options, see the Connectivity Pack connector documentation.

Connect catalog

Find out more about Kafka Connect

Connect catalog

Find out more about Kafka Connect

Amazon S3

Elasticsearch

Google BigQuery

IBM MQ

IBM MQ

JDBC

MongoDB

MongoDB

ServiceNow

FilePulse

GitHub

Google Calendar

Hadoop Distributed File System (HDFS)

Informix (Debezium)

Jira

MQTT

MySQL (Debezium)

Oracle (Debezium)

PostgreSQL (Debezium)

Salesforce

ServiceNow

SQL Server (Debezium)

Ably

Adobe Experience Platform

Apicurio Avro

ArangoDB

Azure Cosmos DB(SQL API)

Azure Cosmos DB (SQL API)

Azure Data Explorer

Batch.sh

Cassandra (Debezium)

Celonis EMS

Couchbase

Couchbase

Datadog Logs

Db2 (Debezium)

Diffusion

Diffusion

Email

FileStream

FileStream

Flume Avro

Geode

Geode

HTTP

HTTP

Humio HEC

IBM Cloud Object Storage

JMS

JMS

Kafka Connect JSON converter

Kafka Connect XML converter

Kinetica

Kinetica

MarkLogic

MarkLogic

Memcached

MQTT

Neo4j

Neo4j

New Relic

Redis

Redis

Rockset

SAP HANA

SAP HANA

SingleStore

Snowflake

Solr

Splunk

Zeebe

Zeebe

Cast

Kafka Connect XML transformation

MongoDB (Debezium)

Spanner (Debezium)