Provisioning an Azure Event Hub to capture real time streaming data is fairy easy once you have an Azure account. Event Hubs can be used to capture data from many different sources including databases or IoT devices. As we look at building a CDC streaming ETL, let’s take a look at the basics of Event Hubs
- Create a new Event Hubs in Azure, by finding it in the search bar.
- Create a new namespace.
- Name it something unique and use the basic pricing tier to limit cost since our needs are fairly limited and do not need the full horse power of Azure Event Hubs.
- Select your basic subscription and create a resource group if you do not already have one.
- Select “Create” to begin deployment process to create.
- Once the deployment process is created, navigate to your new Namespace and select “Add Event Hub”
- Give it a name and leave all settings as it to keep it small.
- Once you hit create, the deployment process will start.
- After completion you should now have an active event hub in your namespace.
Granting Access to the Event Hub
- On the right of the name space window, select “Shared Access Policies”
- Add a new policy and give it “manage” access rights to it may send and listen to messages coming from and leaving the event hub. Different policies can be used to different applications as a best practice. Once created, this will create a key for access to be used to send and receive messages.
Part 2 – Build a client app in NodeJS to send data to Event Hubs