In January 2019, I was honored to be asked to contribute to the PASS Insights BI Edition Newsletter. I said yes, of course! :) I chose to create an Azure Data Factory Data Flows introduction video. This is a sneak preview of the upcoming Data Flows feature, with a quick walkthrough of how easy it can be to create scalable data transformations in the cloud – without writing any code!
Please note: As of January 2019, when I recorded this video and published this blog post, Azure Data Factory Data Flows is still in preview. Features will be added and things will get changed, just like all the other Azure products. But! Hopefully this shows what you can look forward to.
At the end of this blog post, I have tried to answer some frequently asked questions about Azure Data Factory Data Flows.
Last year at Microsoft Ignite, I was fortunate enough to interview Mike Flasko and Sanjay Krishnamurthi. This year, I got to have a follow-up chat with Mike Flasko and Sharon Lo! We talked about the recent and upcoming Azure Data Factory updates :)
In this interview, Mike and Sharon share the highlights from their session at Microsoft Ignite 2018. What are visual Data Flows? How are Azure Data Factory Data Flows different from the recently announced Power BI Dataflows? What’s on the Azure Data Factory roadmap? And finally, how can you provide feedback and get involved in private previews?
Azure Data Factory Updates with Mike Flasko and Sharon Lo
(I apologize for the unsteady video :( Unfortunately, I didn’t see how shaky it was until post-production. If it gets too distracting to watch, please just listen. Mike and Sharon share a lot of interesting things :) )
Thank you so much to Mike and Sharon for chatting with me on a busy day!
In 2015, I was invited to record a SQL Data Partners podcast about Biml. This year, I got to do it all again, yay! :) I joined Jason Horner and our host Carlos L Chacon to discuss several data integration topics. Is SSIS still relevant? What is the difference between ETL and ELT? How is Azure Data Factory and Azure Databricks different from SSIS? How do patterns and frameworks fit into all of this? And much, much more :)
SQL Data Partners Podcast – Part 1
Moving data with SSIS is a forgone conclusion for most of us — it is part of SQL Server, it has a interface we are somewhat familiar with, and connects to lots of common data sources like csv, excel, and of course SQL Server. Are our needs changing as our environments become more hybrid — as we introduce cloud services? Are you still building packages the same way you were 10 years ago? Just as our data sources have grown, the capabilities needed to move data around have increased. This episode, with Jason Horner and Cathrine Wilhelmsen, challenges some of the thoughts around data movement and gives some things to think about as new tools are available to move data around.
In this episode we finish up our conversation with Jason and Cathrine and talk about how they keep up with all the changes in data conversions. The advent of Azure services is great, but can be tricky to navigate. We also get to hear Jason’s answers to the SQL Family questions.
I am so happy and honored to have been invited to speak at Microsoft Ignite 2018! This year, I’m presenting two sessions focused on Azure Data Factory (ADF). The first is a 45-minute breakout session that I’m presenting with Jason Horner. The second is a 20-minute theater session that I’m presenting by myself :)
One of the sessions I was most looking forward to at Microsoft Ignite 2017 was New capabilities for data integration in the cloud with Mike Flasko. In that session, he talks about Azure Data Factory (ADF) v2 and its new first-class SSIS support.
After the session, I convinced Mike Flasko and Sanjay Krishnamurthi to have a chat with me :) We talked about what’s new in Azure Data Factory v2, including the updated pipeline application model with a new visual design canvas, new Software Development Kits (SDKs) for working with Azure Data Factory, the new Integration Runtime, and the ability to run SSIS packages inside Azure Data Factory v2.
Azure Data Factory v2 with Mike Flasko
Follow Mike Flasko on Twitter @mflasko, and keep an eye out for more news about ADF and SSIS! I may or may not have convinced him to do another interview with me in a couple of months :)