In this series we look at building a Streaming ETL with Azure Data Factory and CDC – Provisioning Azure Data Factory . This is Part 1, The rest of the series is below.
- Enabling CDC
- Setting up Audit Tables
- Provisioning Azure Data Factory
- Provisioning Azure Blog Storage
- Create Data Source Connection in ADF
- Create Incremental Pipeline in ADF
- Create a Parameter Driven Pipeline
- Create a Rolling Trigger
This series uses the Adventureworks database. For more information on how to get that set up see my Youtube video for Downloading and Restoring the database.
Provisioning Azure Data Factory
- For this section, we are assuming you have already signed up for a Microsoft Azure Account. If you have not, navigate to a https://azure.microsoft.com/ to get your free account.
- Open the Azure Portal and provision a new Data Factory
- Set up a Resource Group, and you will need to pick a name that has not been used before. Select Review and Create to complete set up of Azure Data Factory.
Streaming ETL with Azure Data Factory and CDC – Provisioning Azure Data Factory