If you long for the days for pixel perfect reports of SSRS or Cognos but find yourself lost in the world of Power BI’s and Tableaus, this post is for you. Some times these new tools just cannot do the job of exactly formatted canned report runtime queries that the older tools used to be … Read more
Modern Data Architecture – Part 9 – Loading Data into Synapse Data Warehouse Now that we have provisioned a Synapses Data Analytics environment, we are now ready to begin loading data into this environment. In lab 7, we loaded a single table “sales.customer” to our data lake. To complete this lab, you will either need … Read more
Modern Data Architecture – Part 8 – Provisioning a Synapsis SQL Data Warehouse Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale. Azure Synapse brings these two worlds … Read more
Modern Data Architecture – Part 7 – Staging Data into Data Lake In Lab 5, we demonstrated loaded data from our sample SQL server into our data lake. Although this tool is very handy, it creates a new service and set of tools that need to be provisioned and monitored. It is best to use … Read more
Modern Data Architecture – Part 6 – Configuring and setting up Data Bricks Azure Databricks is an Apache Spark-based analytics platform optimized for the Microsoft Azure cloud services platform. Databricks is an industry-leading, cloud-based data engineering tool used for processing and transforming massive quantities of data and exploring the data through machine learning models Azure … Read more
Modern Data Architecture – Part 5 – Loading Data Lake with Data Factory The Azure Data Factory (ADF) is a service designed to allow developers to integrate disparate data sources. It is a platform somewhat like SSIS in the cloud to manage the data you have both on-prem and in the cloud. It provides access … Read more
Modern Data Architecture – Part 4 – Setting up a SQL Server Before we move on to loading data into our Azure Data Lake, we will need a data source to simulate pulling data from as to mirror a production system. For this exercise, we will walk through creating your own SQL server database and … Read more
Modern Data Architecture – Part 3 – Creating Data Lake Storage A data lake is a system or repository of data stored in its natural/raw format, usually object blobs or files. A data lake is usually a single store of all enterprise data including raw copies of source system data and transformed data used for … Read more
Modern Data Architecture – Part 2 – Resource Groups and Subscriptions Resource Groups in Azure are a mechanism of grouping a collection of services and assets in Azure together. Resource groups can assist in automatic provisioning, deprovisioning, monitoring, and access control as well as provide logical groupings for business processes, units or even environment. A … Read more
Modern Data Architecture – Part 1 – Navigating the Azure Portal Logging into Azure and the Portal Open up a web browser and navigate to https://azure.microsoft.com/en-us/ and click on “Portal” to log in. You will be navigated to authentication portal to log in. You can either sign up for a new account which comes with … Read more