2 Min to complete
The ScyllaDB CDC Source Connector is a Kafka Connect connector that reads messages from a ScyllaDB table (with ScyllaDB CDC enabled) and writes them to a Kafka topic. It works seamlessly with standard Kafka converters (JSON, Avro).
The connector can scale horizontally across many Kafka Connect nodes.
ScyllaDB CDC Source Connector has at-least-once semantics.
So now that we have this basic information about
ScyllaDB CDC let’s go into. ScyllaDB CDC Source Connector
So how the CDC source Connector works, this is the Connector which reads messages from ScyllaDB
and it reads it using the CDC mechanism and writes them to a Kafka topic
so it dumps the data that you insert into ScyllaDB that you’re updating in ScyllaDB, that you’re deleting in ScyllaDB
the Connector works seamlessly with all standard Kafka converters
so we can use the JSON format, Avro format or any other format that has a converter
written and the Connector can scale horizontally across many, many nodes, so you can
you can achieve a good performance with both ScyllaDB and Kafka and scale those
together and the source Connector similarly to the Sink Connector has at least one semantics