Connector catalog

Kafka Connect is a framework for connecting Apache Kafka to external systems. It uses source connectors to move data into Apache Kafka, and sink connectors to move data out of Apache Kafka.

The connector catalog contains a list of connectors that are supported either by IBM or the relevant community:

IBM supported: Each IBM supported connector is subject to its own license terms. Support is provided by IBM for customers who have a license and active software subscription and support entitlement for IBM Event Automation or IBM Cloud Pak for Integration. Raise any issues through the official IBM support channel. In accordance with IBM's standard support terms, IBM will investigate, identify, and provide a fix when possible.
Community supported: Where not identified as IBM supported, each community supported connector is subject to its own set of license terms and not supported by IBM. Raise issues through the community support links provided for each connector.

Find out more about Kafka Connect

Connector catalog

Kafka Connect is a framework for connecting Apache Kafka to external systems. It uses source connectors to move data into Apache Kafka, and sink connectors to move data out of Apache Kafka.

The connector catalog contains a list of connectors that are supported either by IBM or the relevant community:

IBM supported: Each IBM supported connector is subject to its own license terms. Support is provided by IBM for customers who have a license and active software subscription and support entitlement for IBM Event Automation or IBM Cloud Pak for Integration. Raise any issues through the official IBM support channel. In accordance with IBM's standard support terms, IBM will investigate, identify, and provide a fix when possible.
Community supported: Where not identified as IBM supported, each community supported connector is subject to its own set of license terms and not supported by IBM. Raise issues through the community support links provided for each connector.

Find out more about Kafka Connect

Filter is active

Have a connector you want added to our catalog?

Back to catalog

Support is provided by IBM

Source connector: produces data into Kafka or Event Streams

FilePulse

FilePulse source connector parses, transforms and streams file, in any format, into Kafka topics. You can use this connector to read files from: local-filesystem, Amazon S3, Azure Storage and Google Cloud Storage.

Note: IBM Support is only available for the connector when it is used with the Amazon Simple Storage Service (Amazon S3).

To use the FilePulse source connector, complete the following steps:

Create a KafkaConnect custom resource to define your Kafka Connect runtime and include the FilePulse source connector by following the instructions in setting up and running connectors:

When adding the connector to your Kafka Connect runtime, click Get connector to obtain the pre-built connector JAR file, or click Source code if you want to build the connector JAR file yourself.
Apply the configured KafkaConnect custom resource to start the Kafka Connect runtime and verify that the connector is available for use.
Create a KafkaConnector custom resource to define your connector configuration:

Specify the class name and configuration properties for the connector in the KafkaConnector custom resource as described in the connector documentation.
Apply the configured KafkaConnector custom resource to start the connector and verify that it is running.

Connector catalog

Find out more about Kafka Connect

Connector catalog

Find out more about Kafka Connect

Amazon S3

Elasticsearch

IBM MQ

IBM MQ

JDBC

MongoDB

MongoDB

FilePulse

MySQL (Debezium)

Oracle (Debezium)

PostgreSQL (Debezium)

Ably

Adobe Experience Platform

ArangoDB

Azure Cosmos DB(SQL API)

Azure Cosmos DB (SQL API)

Azure Data Explorer

Batch.sh

Celonis EMS

Couchbase

Couchbase

Datadog Logs

Diffusion

Diffusion

Email

FileStream

FileStream

Flume Avro

Geode

Geode

HTTP

HTTP

Humio HEC

IBM Cloud Object Storage

Kinetica

Kinetica

MarkLogic

MarkLogic

Memcached

Neo4j

Neo4j

New Relic

Redis

Redis

Rockset

SAP HANA

SAP HANA

SingleStore

Snowflake

Solr

Splunk

Zeebe

Zeebe

MongoDB (Debezium)

SQL Server (Debezium)

RSS

Pulsar

RabbitMQ

Source connector: produces data into Kafka or Event Streams

FilePulse