Data pipeline troubleshooting: Root cause analysis with lineage metadata

Join us for a VIRTUAL meetup on Thursday, November 27th from 6:00 pm CEST.

Zoom [Online]

Speaker:

Mario Fiore Vitale (a maintainer of Debezium)

Title:

Data pipeline troubleshooting: Root cause analysis with lineage metadata

Abstract:

Remember when debugging streaming data pipelines felt like playing detective at a crime scene, where the evidence kept shifting? Well, grab your magnifying glass because we’re about to turn you into Sherlock Holmes of the streaming world. We’ll simulate a disruptive change in an order processing pipeline that captures database changes with Debezium, processes them through Apache Flink, and tracks lineage metadata with OpenLineage and Marquez.

Online Meetup Etiquette

• Please hold your questions until the end of the presentation or use the zoom chat during!
• Please arrive on time as zoom meetings can become locked for many reasons (though if you get locked out a recording will be available, but you may have to wait a little while for it!)
• Important note: If Zoom asks for a password to join please use 'kafka'

If you would like to speak or host our next event please let us know!

Email: community@confluent.io