Skip to content

Handling Schema Drift in Azure Data Factory

On April 4th, 2019, I presented my Pipelines and Packages: Introduction to Azure Data Factory session at 24 Hours of PASS. I was excited to show some cool features and use cases, including how to handle schema drift in the new Mapping Data Flows feature.

Aaaaand… I failed!

Handling Schema Drift in Azure Data Factory using Mapping Data Flows

Or, more specifically, my demo failed…

I hate it when my demos fail. Especially when I’m excited about the demos, like this one. It is a pretty cool demo. When it works. So! I’m turning my demo failure into this blog post instead :)

Handling Schema Drift in Azure Data Factory

In the video below, I go through two examples of how to handle schema drift in Azure Data Factory. Please note that I’m using Mapping Data Flows, which is in preview at the time I’m writing this. Things can (and most likely will) change.

But I hope it can give you a few ideas :)

Pipelines and Packages: Introduction to Azure Data Factory

Once my full session from 24 Hours of PASS has been published, I will embed it here.

You can also view my slide deck on SlideShare:

From “oh no!” to “yay!

I’m bummed that my demo failed in the live session. But I love how my slide deck had that “oh no!” picture. It’s very appropriate :D Anyway! These things happen when you do something live. Especially when you do something live with a preview feature. Good news is, I now have a recorded video. Yay! Let me know if you’ve solved some other cool use cases in Azure Data Factory :)

About the Author

Cathrine Wilhelmsen is a Microsoft Data Platform MVP, BimlHero Certified Expert, Microsoft Certified Solutions Expert, international speaker, author, blogger, and chronic volunteer who loves teaching and sharing knowledge. She works as a Senior Business Intelligence Consultant at Inmeta, focusing on Azure Data and the Microsoft Data Platform. She loves sci-fi, chocolate, coffee, craft beers, ciders, cat gifs and smilies :)

Comments

Hi! This is Cathrine. Thank you so much for visiting my blog. I'd love to hear your thoughts, but please keep in mind that I'm not technical support for any products mentioned in this post :) Off-topic questions, comments and discussions may be moderated. Be kind to each other. Thanks!

Hi I can hardly hear anything even with the max volume on your you tube channel. I liked the presentation though

Hi! This is Cathrine (again). Just a reminder. I'd love to hear your thoughts, but please keep in mind that I'm not technical support for any products mentioned in this post :) Off-topic questions, comments and discussions may be moderated. Be kind to each other. Thanks!

Share Your Thoughts?