What is Microsoft Fabric & what can we DO with it?

recently Microsoft announced fabric a unified data platform so today let's understand what is Fabric and how it helps you as a data person in most organizations we will have separate teams dealing with data engineering side of things data warehouse and data lake side of things as well as data analysis and data science side of things and normally they will all be maintaining their own separate data platforms and Data Solutions this is where Microsoft fabric comes in it tries to unify everything into one platform so that any duplication is reduced and the costs are minimized so what is inside Microsoft fabric Microsoft fabric offers separate solutions for each of these three main areas so you have your data Factory which can help you with any data pipelines and data flows that you are setting up as part of the data engineering side of things and then you have your data Lake data warehouse and any other data storage stuff that you want to do and finally you also have your power bi and then your data science stuff and real-time analytics stuff underneath all of these Solutions Microsoft gives you a single storage layer called Microsoft One Lake obviously not this kind of Lake one Lake helps you store everything your data Lake stuff your files your databases your tables everything can be stored here in a unified format think of one like like a big hard disk on your computer or the OneDrive folder where you store literally everything another aspect of having separate teams doing their own thing is sometimes governance and security privacy are overlooked so Microsoft fabric fixes this with a separate layer underneath called purview this helps you set Global policies for your governance and security related stuff one thing that I want to highlight is fabric is not entirely new software many of its existing features such as synapse data warehousing or data engineering or the data Factory or even power bi are existing stuff but features like one Lake and one security or Microsoft purview are entirely new what fabric does is it kind of brings everything together into one umbrella so that when you are managing an entire organization's data infrastructure you can use one tool or one platform rather than multiple different things as a data person I primarily tend to work in this side of the picture so I'm curious to know what does fabric mean to me the biggest change in my eye seems to be now I can access the data in the one Lake directory this means I get to remove some of the duplication in my work for example occasionally I end up building my own data flows and my own data engineering stuff because I can't really get what these people are doing but now that everything is integrated through one Lake my data engineering team can put their stuff into the one Lake and I can directly consume it through here without duplicating some of that work likewise fabric also gives me access to build any data science models machine learning models or do real-time analytics or SQL directly on top of my one Lake data sets this means I don't need to build a separate environment figure out the connections and all of that I just need to access what is already available to me in one Lake to do that stuff let's understand how we can use Microsoft fabric to create a simple data analysis project at awesome chocolates as we received chocolate orders on our website we can create a data flow to capture that order and store that into our one Lake in a separate table we can set up the pipeline in such a way that a new orders are appended into the table so the website data goes into the warehouse or one Lake into my order table and from that order table we can create a power bi report that helps us understand the trend of the orders likewise we can use the same order table to do some data sciencey stuff and maybe build a machine learning model that helps us predict what the future for chocolates is looking like we could also take the same data and do some real-time analytics and present such information to our manufacturing people so that they can be prepared and all of this can be streamlined into one system through Microsoft fabric I hope you enjoyed this explanation of Microsoft fabric with bricks get it if you enjoyed this give it a like if you like these style of explanations check out the other videos that show up on the screen to understand the data engineering Concepts or business intelligence Concepts I'll catch you in one of these places bye

Channel: Chandoo

Views: 51,685

Keywords: chandoo, chandoo.org, what is microsoft fabric?, how fabric is related to power bi, fabric vs. power bi, data factory, azure data factory, microsoft onelake, business intelligence, microsoft fabric easy explanation, microsoft fabric

Id: --cK4A2djoA

Length: 5min 16sec (316 seconds)

Published: Tue Jun 06 2023