Shift Left is a rethink of how we circulate, share and manage data in our organizations using DataStreams, Change Data Capture, FlinkSQL and Tableflow. It addresses the challenges with multi-hop and medallion architectures using batch pipelines by shifting the data preparation, cleaning and schemas to the point where data is created and as a result, you can build fresh trustworthy datasets as streams for operational use cases or Apache Iceberg tables for analytical use cases.

For more information and resources on Shift Left, go here: [ Ссылка ]

RELATED RESOURCES
► Read more about building data products as close to the source as possible, which unlocks both near-real-time and batch-based use cases: [ Ссылка ]
► Checkout the playlist "Data Architecture Basics with Adam Bellemare" for more videos like this one: [ Ссылка ]

CHAPTERS
0:00 - Introduction
01:05 - Multi-Hop & Medallion Architectures
04:06 - The Problems with Multi-Hop
08:26 - Shift Left with Streams and Tables
12:37 - Plugging in Data
13:57 - Data Evolution and Consistency
16:05 - Conclusion

–

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#apachekafka #kafka #confluent

свернуть