kafkaconnect¶
A Python client for managing connectors using the Kafka Connect API.
Overview¶
Kafkaconnect provides a command line interface (CLI) to interact with the Kafka Connect API and manage connectors.
For dynamic connectors, the configuration is defined in a JSON file and uploaded to the Kafka Connect API. For non dynamic connectors, kafkaconnect can be used as a wrapper to auto-update the connector configuration when topics are created or deleted in Kafka.
To deploy a connector on Kubernetes use the kafka-connect-manager Helm chart. For dynamic connectors, the configuration is stored in a configmap which is templated in Helm.
Supported connectors¶
List of connectors kafkaconnect currently supports:
Confluent Amazon S3 Sink (dynamic)
Confluent JDBC Sink (dynamic)
MirrorMaker 2 (dynamic)
Note: other connectors can also be managed by kafkaconnect using the upload
command, as long as they are installed in the cp-kafka-connect docker image.
Installation¶
Configuration¶
User guide¶
Development guide¶
CLI¶
Project information¶
The GitHub repository for kafka-connect-manager
is https://github.com/lsst-sqre/kafka-connect-manager
See the LICENSE file for licensing information.