Hello! Recently in our office there was a meeting on Kafka. Full-time places scattered on him at the speed of light. As one of the speakers said: βKafka is sexy.β
With colleagues from Booking.com, Confluent, and Avito, we sometimes discussed the difficult integration and support of Kafka, the consequences of crossing it with Kubernetes, as well as the well-known and hand-written connectors for PostgreSQL
We edited video reports, collected presentations from speakers and selected beautiful photos from the meeting. If you are interested in watching and listening, go under the cat.
Video Recordings
Connectors: why are you so many - Anatoly Soldatov, Avito
Anatoly told what connectors are, what advantages and disadvantages JDBC and Debezium have, and how we at Avito came up with the idea of ββwriting our own CDC connector.
00:00 β
04:09 β Kafka Connect,
18:10 β Connect
23:47 β : data-bus
28:20 β : CDC
41:28 β
β
, , .
00:00 β
06:22 β
08:58 β
14:15 β
23:53 β ontrol plane,
27:41 β
34:00 β
β
Kafka Kubernetes: ? β , Confluent
, Apache Kafka Kubernetes.
00:00 β
05:19 β stateful- Kubernates
17:52 β Kubernetes pod
22:33 β
28:24 β Custom Kubernetes controllers
48:58 β Rolling upgrade
58:05 β
β
-.
. , , , .
. !