From transactions to analytics Where do we go from here? DataEngBytes 2026 Marta Paes Sr. Product Manager
A presentation at DataEngBytes 2026 in March 2026 in Auckland, New Zealand by Marta Paes
From transactions to analytics Where do we go from here? DataEngBytes 2026 Marta Paes Sr. Product Manager
2 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
6 years later… Why am I still talking about CDC? 3 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
Itʼs personal 🔁 Periodic polling Circa 2014 4 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY OLTP OLAP
Itʼs personal �� 🔁 Periodic polling Circa 2014 5 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY OLTP OLAP
Itʼs personal �� �� 🔁 Periodic polling Circa 2014 6 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY �� OLTP OLAP
Itʼs personal ⚡ Log replication inserts, updates, deletes Circa 2018 OLTP WAL Write-Ahead Log 7 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY OLAP
Itʼs personal ⚡ Log replication inserts, updates, deletes Circa 2021 OLTP WAL Write-Ahead Log 8 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY OLAP
Itʼs personal ⚡ Log replication inserts, updates, deletes Today OLTP WAL Write-Ahead Log 9 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY OLAP
What this talk is about 10 01 How it all started 02 Where we hit a wall 03 What works for the 99% 04 Where do we go from here? ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
01 How it all started
How it all started Like most things, at ✨ internet-scale companies ✨ 2013 Databus LinkedIn), Wormhole Facebook), MoSQL Stripe 12 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
How it all started Like most things, at ✨ internet-scale companies ✨ Maxwell Zendesk), Bottled Water Confluent) 2013 2015 Databus LinkedIn), Wormhole Facebook), MoSQL Stripe 13 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
How it all started Like most things, at ✨ internet-scale companies ✨ Maxwell Zendesk), Bottled Water Confluent) 2016 2013 2015 Databus LinkedIn), Debezium Red Hat), Wormhole Facebook), MySQL Streamer Yelp MoSQL Stripe 14 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
How it all started Like most things, at ✨ internet-scale companies ✨ Maxwell Zendesk), Bottled Water Confluent) 2016 2013 2015 15 Debezium Red Hat), Wormhole Facebook), MySQL Streamer Yelp ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY 2019 2018 Databus LinkedIn), MoSQL Stripe Spinal Tap Airbnb DBLog Netflix)
02 Where we hit a wall
Debezium as the standard Canonical change events, battle-tested at scale, still going strong after 10+ years 2016 17 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY Databases MySQL, Postgres Kafka required? Yes Snapshots Blocking, full table Delivery guarantees At-least-once only Direction Source only Governance Red Hat Deployment Kafka Connect
Debezium as the standard Canonical change events, battle-tested at scale, still going strong after 10+ years 2016 18 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY 2026 Databases MySQL, Postgres 10+ connectors Kafka required? Yes Optional (Engine, Server) Snapshots Blocking, full table Incremental, parallel Delivery guarantees At-least-once only Exactly-once possible Direction Source only Source, Sink Governance Red Hat Commonhaus Foundation Deployment Kafka Connect Kafka Connect, Engine, Server, Operator K8s
“Hey, what if… 19 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
“Hey, what if… 20 ● Abstract some complexity of deploying and operating Debezium from the end user. ● Enable advanced features like schema evolution using existing primitives. ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
“Hey, what if… 2020 Flink CDC 2021 Confluent CDC 2022 2022 Streamkap 21 RisingWave CDC ● Abstract some complexity of deploying and operating Debezium from the end user. ● Enable advanced features like schema evolution using existing primitives. ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
03 What works for the 99%
“We first tried to implement Postgres CDC in-house using Debezium but it was way too complex. I knew a managed product built by engineers, whose goal in life is to transform bits from Postgres into ClickHouse, would be better than anything we could do ourselves. 60TB Aurora database Hundreds of customers moving data with CDC 23 10B updates/month ms query latency
What the 99% needs The average user will trade off speed for convenience 🛠 Easy to deploy & manage 24 🚀 �� Built to scale Full-featured ● ClickOps for fast onboarding ● Parallel snapshotting ● Graceful degradation ● Managed service or binary ● OOTB schema evolution ● Resilient to Day 2 operations ● Infrastructure-as-Code IaC ● Transactional consistency ● Monitoring & notifications ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
CDC as a feature, not a product Can you spot the trend? ● 2024 Create a user experience that is tailored to long-time + SQL users. ● Have more control over performance and semantics. 2021
26
04 Where do we go from here?
Where do we go from here? Things Iʼm excited about for the upcoming 6 years 🦀 Next-gen CDC tools 28 🚀 �� Data lake CDC Unified data stacks ● PeerDB ● Best-of-breed OLTP ● Delta Lake CDC (via CDF) ● Supermetal ● Best-of-breed OLAP ● Iceberg CDC ● Artie ● CDC as a background task ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
Next-gen CDC tools Supermetal as a challenger to first-gen tools “I also have to mention the difference in developer experience: having a single binary and not relying on operators, clusters, and much configuration/glue code felt amazing!ˮ Yaroslav Tkachenko (source) 29 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
Unified data stacks With some additional magic tricks ✨ 30 ● Postgres for transactions ● ClickHouse for analytics ● CDC as a background task ● pg_clickhouse for pushdown ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
Unified data stacks With some additional magic tricks ✨ ● Postgres for transactions ● ClickHouse for analytics ● CDC as a background task ● pg_clickhouse for pushdown Join the Private Preview waitlist! 31 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
Data Lake CDC Transactional workloads, just…different? 32 ©2026 CLICKHOUSE INC., CONFIDENTIAL & PROPRIETARY
See you in 6 years!
If any of this sounds interesting… ✓ Sign up for ClickHouse Cloud ✓ $300 credit ✓ Check out our careers page!
