On October 4-5, I will be at Data Saturday Holland 2019! With 42 sessions and 600+ attendees, this is the event for Microsoft Data Platform professionals in Holland. Grab your ticket today and join us!
On Friday, I will be delivering a full-day Azure Data Factory precon. Then, on Saturday morning, I’m presenting a session called Building Dynamic Data Pipelines in Azure Data Factory. It will be a busy couple of days for me since I’m coming straight from Techorama NL 2019! But I’m very much looking forward to it :) Hope to see you there!
Data Saturday Holland 2019 Schedule
Data Saturday Holland 2019 has 5 precons and 42 sessions for you to choose from! Now, I obviously hope that you would like to attend my precon and/or session ;) But if Azure Data Factory is not really your thing, or you have already attended these (yay you!), I’m sure you can find something else of interest at this event.
Precon: A Day Full of Azure Data Factory
With the ever-increasing volume, variety, and velocity of data, it can feel like a daunting task to create and maintain modern data integration solutions. This full-day workshop will arm you with the skills you need to build and orchestrate hybrid, complex and scalable data pipelines using Azure Data Factory (ADF).
We will start with a conceptual overview and cover the fundamentals of Azure Data Factory, including source control, security, and pricing. Then, we will build a metadata-driven solution to move data between on-premises and cloud sources. As we evaluate different design patterns and architectures for big data pipelines and modern data warehouses, we will continue to improve on our solution to make it more robust, dynamic and reusable. We will dive deep into the newly released Mapping and Wrangling Data Flows capabilities, and look at how to leverage SSIS lift and shift to gradually modernize existing solutions while retaining investments already made. Finally, we will configure monitoring, logging, and alerting, as well as review options for CI/CD using Azure DevOps.
…not for you? How about one of the other precons? :)
- Brent Ozar: Performance Tuning in 21 Demos
- Adam Saxton & Patrick LeBlanc: Enterprise Business Intelligence with Power BI
- Hamish Watson & John Martin: Automation, Builds & Containers for DevOps
- Simon Whiteley & Terry McCann: Azure Databricks Deep Dive
Session: Building Dynamic Data Pipelines in Azure Data Factory
You already know how to build, orchestrate, and monitor data pipelines in Azure Data Factory. But how do you go from basic, hardcoded data pipelines to making your solution dynamic and reusable?
In this session, we will dive straight into some of the more advanced features of Azure Data Factory. How do you parameterize your linked services, datasets, and pipelines? What is the difference between parameters and variables, and when should you use them? And how does the expression language and built-in functions really work?
We will answer these questions by going through an existing solution step-by-step and gradually making it dynamic and reusable. Along the way, we will cover best practices and lessons learned.
…not for you? How about one of the other sessions? :)
See you there?
Get your ticket before they sell out! And if you’re attending, please let me know so I can come and say hi to you :) In the meantime, follow @DataSaturdayNL and join the conversation by using the #DataSaturdayNL hashtag. See you there!