Skip to content

Tag: Azure Data Factory

Azure Data Factory Training Day at SQLBits 2020

On March 31st, I will be presenting my A Day Full of Azure Data Factory training day at SQLBits 2020. Yay! 🤓

Cathrine Wilhelmsen presenting her A Day Full of Azure Data Factory Training Day at SQLBits 2020

SQLBits is one of my absolute favorite events. I was literally jumping up and down when I got the news that I was selected as a speaker! 🥳 In addition to presenting a training day session, I will present a general session, and volunteer again on the other days. Woohoo!

If you are considering registering for SQLBits 2020, I highly recommend that you make a decision and register as soon as possible. Why? Because the prices go up on January 11th! Early bird pricing is only £999 for two full-day training days and three conference days. That’s a bargain! From January 11th, the price goes up to £1199. From February 15th, the price goes up to £1499.

You can also register for individual days. Check out the SQLBits pricing page for all the details, then go register!

Continue reading →

Azure Data Factory Resources

This post is part 25 of 25 in the series Beginner's Guide to Azure Data Factory

For the past 25 days, I have written one blog post per day about Azure Data Factory. My goal was to start completely from scratch and cover the fundamentals in casual, bite-sized blog posts. This became the Beginner’s Guide to Azure Data Factory. Today, I will share a bunch of resources to help you continue your own learning journey.

I’ve already seen from your questions and comments that you are ready to jump way ahead and dive into way more advanced topics than I ever intended this series to cover 😉 And as much as I love Azure Data Factory, I can’t cover everything. So a little further down, I will share where and how and from who you can continue learning about Azure Data Factory.

But first…

That’s a wrap! Woohoo 🥳

Continue reading →

Understanding Pricing in Azure Data Factory

This post is part 24 of 25 in the series Beginner's Guide to Azure Data Factory

Congratulations! You’ve made it through my entire Beginner’s Guide to Azure Data Factory 🤓 We’ve gone through the fundamentals in the first 23 posts, and now we just have one more thing to talk about: Pricing.

And today, I’m actually going to talk! You see, in November 2019, I presented a 20-minute session at Microsoft Ignite about understanding Azure Data Factory pricing. And since it was recorded and the recording is available for free for everyone… Well, let’s just say that after 23 posts, I think we could both appreciate a short break from reading and writing 😅

(And as a side note, I’m originally publishing this post on December 24th. Here in Norway, we celebrate Christmas all day today! This is the biggest family day of the year for me, full of food and traditions. So instead of spending a lot of time writing today, I’m going to link to my video and spend the rest of the day with my family. Yay! 🎅🏻🎄🎁)

Continue reading →

Lookups in Azure Data Factory

This post is part 23 of 25 in the series Beginner's Guide to Azure Data Factory

In the previous post, we looked at foreach loops and how to control them using arrays. But you can also control them using more complex objects! In this post, we will look at lookups. How do they work? What can you use them for? And how do you use the output in later activities, like controlling foreach loops?

Lookups

Lookups are similar to copy data activities, except that you only get data from lookups. They have a source dataset, but they do not have a sink dataset. (So, like… half a copy data activity? :D) Instead of copying data into a destination, you use lookups to get configuration values that you use in later activities.

And how you use the configuration values in later activities depends on whether you choose to get the first row only or all rows.

But before we dig into that, let’s create the configuration datasets!

Continue reading →

ForEach Loops in Azure Data Factory

This post is part 22 of 25 in the series Beginner's Guide to Azure Data Factory

In the previous post, we looked at how to use variables in pipelines. We took a sneak peek at working with an array, but we didn’t actually do anything with it. But now, we will! In this post, we will look at how to use arrays to control foreach loops.

ForEach Loops

You can use foreach loops to execute the same set of activities or pipelines multiple times, with different values each time. A foreach loop iterates over a collection. That collection can be either an array or a more complex object. Inside the loop, you can reference the current value using @item().

Let’s take a look at how this works in Azure Data Factory!

Continue reading →
Secured By miniOrange