In 2015, I was invited to record a SQL Data Partners podcast about Biml. This year, I got to do it all again, yay! :) I joined Jason Horner and our host Carlos L Chacon to discuss several data integration topics. Is SSIS still relevant? What is the difference between ETL and ELT? How is Azure Data Factory and Azure Databricks different from SSIS? How do patterns and frameworks fit into all of this? And much, much more :)
SQL Data Partners Podcast – Part 1
Moving data with SSIS is a forgone conclusion for most of us — it is part of SQL Server, it has a interface we are somewhat familiar with, and connects to lots of common data sources like csv, excel, and of course SQL Server. Are our needs changing as our environments become more hybrid — as we introduce cloud services? Are you still building packages the same way you were 10 years ago? Just as our data sources have grown, the capabilities needed to move data around have increased. This episode, with Jason Horner and Cathrine Wilhelmsen, challenges some of the thoughts around data movement and gives some things to think about as new tools are available to move data around.
In this episode we finish up our conversation with Jason and Cathrine and talk about how they keep up with all the changes in data conversions. The advent of Azure services is great, but can be tricky to navigate. We also get to hear Jason’s answers to the SQL Family questions.
I am so happy and honored to have been invited to speak at Microsoft Ignite 2018! This year, I’m presenting two sessions focused on Azure Data Factory (ADF). The first is a 45-minute breakout session that I’m presenting with Jason Horner. The second is a 20-minute theater session that I’m presenting by myself :)
One of the sessions I was most looking forward to at Microsoft Ignite 2017 was New capabilities for data integration in the cloud with Mike Flasko. In that session, he talks about Azure Data Factory (ADF) v2 and its new first-class SSIS support.
After the session, I convinced Mike Flasko and Sanjay Krishnamurthi to have a chat with me :) We talked about what’s new in Azure Data Factory v2, including the updated pipeline application model with a new visual design canvas, new Software Development Kits (SDKs) for working with Azure Data Factory, the new Integration Runtime, and the ability to run SSIS packages inside Azure Data Factory v2.
Azure Data Factory v2 with Mike Flasko
Follow Mike Flasko on Twitter @mflasko, and keep an eye out for more news about ADF and SSIS! I may or may not have convinced him to do another interview with me in a couple of months :)