{"id":372,"date":"2019-04-09T03:18:03","date_gmt":"2019-04-09T03:18:03","guid":{"rendered":"http:\/\/jackofalltradesmasterofsome.com\/blog\/?p=372"},"modified":"2019-04-09T03:26:10","modified_gmt":"2019-04-09T03:26:10","slug":"provisioning-an-azure-event-hub-to-capture-real-time-streaming-data","status":"publish","type":"post","link":"http:\/\/jackofalltradesmasterofsome.com\/blog\/2019\/04\/09\/provisioning-an-azure-event-hub-to-capture-real-time-streaming-data\/","title":{"rendered":"Provisioning an Azure Event Hub to capture real time streaming data"},"content":{"rendered":"\n<p>Provisioning an Azure Event Hub to capture real time streaming data is fairy easy once you have an Azure account. Event Hubs can be used to capture data from many different sources including databases or IoT devices. As we look at building a <a href=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/2019\/03\/21\/modern-data-architecture-streaming-etl-using-cdc-and-azure-event-hub\/\">CDC streaming ETL<\/a>, let&#8217;s take a look at the basics of Event Hubs<\/p>\n\n\n\n<!--more-->\n\n\n\n<ol class=\"wp-block-list\"><li>Create a new Event Hubs in Azure, by finding it in the search bar.<\/li><\/ol>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"477\" height=\"241\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image.png\" alt=\"\" class=\"wp-image-373\" srcset=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image.png 477w, http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-300x152.png 300w\" sizes=\"auto, (max-width: 477px) 100vw, 477px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\"><li>Create a new namespace.<ul><li>Name it something unique and use the basic pricing tier to limit cost since our needs are fairly limited and do not need the full horse power of Azure Event Hubs.<\/li><li>Select your basic subscription and create a resource group if you do not already have one.<\/li><li>Select \u201cCreate\u201d to begin deployment process to create.<\/li><\/ul><\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"222\" height=\"162\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-2.png\" alt=\"\" class=\"wp-image-375\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"222\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-3.png\" alt=\"\" class=\"wp-image-376\"\/><\/figure>\n\n\n\n<ul class=\"wp-block-list\"><li>Once the deployment process is created, navigate to your new Namespace and select \u201cAdd Event Hub\u201d<ul><li>Give it a name and leave all settings as it to keep it small.<\/li><li>Once you hit create, the deployment process will start. <\/li><\/ul><\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"449\" height=\"162\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-4.png\" alt=\"\" class=\"wp-image-378\" srcset=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-4.png 449w, http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-4-300x108.png 300w\" sizes=\"auto, (max-width: 449px) 100vw, 449px\" \/><figcaption><br><br><\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"373\" height=\"229\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-5.png\" alt=\"\" class=\"wp-image-379\" srcset=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-5.png 373w, http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-5-300x184.png 300w\" sizes=\"auto, (max-width: 373px) 100vw, 373px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\"><li><\/li><li>After completion you should now have an active event hub in your namespace.<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"322\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-7.png\" alt=\"\" class=\"wp-image-381\" srcset=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-7.png 624w, http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-7-300x155.png 300w\" sizes=\"auto, (max-width: 624px) 100vw, 624px\" \/><\/figure>\n\n\n\n<p>Granting Access to the Event Hub<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>On the right of the name space window, select \u201cShared Access Policies\u201d<\/li><\/ol>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"275\" height=\"95\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-8.png\" alt=\"\" class=\"wp-image-382\"\/><\/figure>\n\n\n\n<ul class=\"wp-block-list\"><li>Add a new policy and give it \u201cmanage\u201d access rights to it may send and listen to messages coming from and leaving the event hub. Different policies can be used to different applications as a best practice. Once created, this will create a key for access to be used to send and receive messages.<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"132\" src=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-9.png\" alt=\"\" class=\"wp-image-383\" srcset=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-9.png 624w, http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2019\/04\/image-9-300x63.png 300w\" sizes=\"auto, (max-width: 624px) 100vw, 624px\" \/><\/figure>\n\n\n\n<p><a href=\"http:\/\/jackofalltradesmasterofsome.com\/blog\/2019\/04\/09\/create-a-nodejs-client-application-to-submit-data-to-event-hubs\/\">Part 2 &#8211; Build a client app in NodeJS to send  data to Event Hubs<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Provisioning an Azure Event Hub to capture real time streaming data is fairy easy once you have an Azure account. Event Hubs can be used to capture data from many different sources including databases or IoT devices. As we look at building a CDC streaming ETL, let&#8217;s take a look at the basics of Event [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":135,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28,27,11,86,85,1],"tags":[15,13,83,87],"class_list":["post-372","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-azure","category-big-data","category-data-warehouse","category-event-hub","category-sql-server","category-uncategorized","tag-big-data","tag-etl","tag-event-hub","tag-iot"],"_links":{"self":[{"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/372","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/comments?post=372"}],"version-history":[{"count":5,"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/372\/revisions"}],"predecessor-version":[{"id":404,"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/372\/revisions\/404"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/media\/135"}],"wp:attachment":[{"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/media?parent=372"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/categories?post=372"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/tags?post=372"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}