Master Data Management for the Microsoft Intelligent Data Platform

good morning good afternoon everybody uh Welcome to our webcast on uh Microsoft intelligent data platform uh prophecy MDM and how the two things fit together um on our call today we have um Eric Melcher Chief technology officer prophecy who's going to show us what some of this stuff looks like live and uh hopefully in a moment or two we'll have uh sir Kenneth venkat uh who's uh from Microsoft in the uh development the purview development team who uh we'll talk a little bit about uh Mike's Microsoft intelligent data platform uh and what Microsoft is doing with that where purview fits into that and that will set the context for where uh Master data management also fits so let me uh share my screen and we can get started one second thank you okay should be there all right so um uh we're going to be talking about as I said mastered in management for the intelligent data platform um with uh myself uh Eric and uh sir kanf and uh we will go through uh I'll go through a very high level uh initial discussion of of uh uh who is prophecy and why is MDM important then we'll kind of backtrack and put it all in the context of uh the intelligent data platform and uh then we'll walk through a reference architecture of how these things uh are integrated together how prophecy Master data management fits into uh the uh Microsoft's vision for the intelligent data platform and how it helps flesh It Out by providing uh certified trustworthy data that can be used by anyone um as they are uh um uh building up uh Enterprise analytics uh the the operational foundation for digital transformation etc etc uh you can feel free to ask questions as we uh go through this uh you can uh enter uh stuff in the chat which is visible to everybody or uh in Q a and we'll do our best to answer any questions as we go through um we should have time for Q a at the end so that we should be able to sweep up any uh um anything that is uh uh anything that comes up that we can't get uh um that we don't answer as we as we go through and if we miss those questions uh during our our lifetime today we will follow up this is being recorded and you will be able to access it afterwards uh of the um of our website okay so let me uh get started I have one slide only on proxy only just so that you know who we are if you're you're not familiar with us I think it's important you know who you're listening to uh but this is a joint presentation of Microsoft and prophecy just less need to introduce Microsoft uh as a vendor so prophecy is a leading Master data management vendor Master Ninja Master data management is our Focus we'll be talking more about as we get into it or one of the fastest growing MDM vendors in the market and we have a best-in-class multi-domain MDM platform one of the things that I think is very important as you're thinking about how to implement uh particularly something as Broad and encompassing as the Microsoft intelligent data platform is that you shouldn't be limiting yourself to only one or two domains you should be able to handle as many domains as as you have in your business um we'll talk a little bit in a bit about what domains are but they're really the kind of the the pillars of your business you know your customers your products your assets your locations things like that things that don't change very much are entered in lots of different systems but often when you bring the data from those different systems together it doesn't match up so being able to handle all of the domains that you require to deliver on a value proposition or use case is tremendously important not just sticking with one like customer or product or whatever handling them all together is what delivers the real return on investment um we are generally liked by our customers which is a good thing it's something that we spend a lot of effort on trying to make uh true uh if you go to the Gartner peer Insight site you'll find of the MDM the major MDM vendors we have the highest uh customer recommendation rate which is uh great and we're for the purpose of this conversation I think it's really important to know that we are a Microsoft gold partner we have a long-standing relationship with Microsoft we have now delivered our software as a packaged kubernetes service I wrote Eric will talk a bit more about this uh later on but you can Implement platform as a service in you implement in your own tenant a lot of our customers choose that to be Azure although it's not limited to that or software as a service where we run it for you in our tenant we can have you up and running in a few minutes and uh take some of the uh the background burden off of you in terms of system maintenance and such um we're a Microsoft intelligent data platform launch partner which will talk a little bit about when we get to that that's spot but it's important to know it's part of our Microsoft relationship that we are we're deeply invested in uh being part of that that ecosystem and we have native integration with a lot of different parts of the Microsoft environment particularly uh Azure components like purview Azure data Factory power bi synapse Etc and again you're going to see that with uh the architecture work through in just a second Gartner uh points out in their most recent uh Magic quadrant for MDM prophecy strategies to make MDM easier to understand and deploy it's close alignment with Microsoft Azure data services makes proxy platform a compelling option for uh Azure clients so I think you're going to see a lot of that kind of Illustrated today you'll see some software and you'll see how it is relatively easy to understand MDM and how through the integration we have into the Microsoft intelligent data platform and other Azure components uh that it makes it a compelling option and uh as I said we've had a lot of history with Microsoft we continue to have a lot of history with Microsoft this gentleman Mike flaska is being a sponsor uh for a long time he's um uh owns the purview product set um and uh is increasingly um that's that's being built out as a universal data governance platform and he amongst many other people I recognize the MDM is an important aspect of unified approach to data governance and having deeply Integrated Solutions uh such as prophecy is a tremendous benefit for Azure customers which I think you will see so that's all we're going to talk about with regards to prophecy per se the rest is all going to be just around the value prop and what it is we do and why that's uh important so let's just start off really quickly ymdm in the first place Gardner points out again in their most recent magic quadrant the MDM initiatives have continued to progress as a foundational component of digital transformation programs so most organizations have lots of data and they want to be able to leverage their agents to drive their business but like everything else in in it and the data world it is still unfortunately a garbage in garbage out proposition so as many tools as you may have to visualize and to use Ai and all of these kind of tremendously smart things if you have poor quality untrustworthy data as an input you're not going to get very far so we're here to solve some of those problems and allow people to move forward so at a high level if you're trying to drive digital transformation whether you're thinking of it in terms of improved business insights or operational efficiencies you want and expect high quality trusted data that's complete and consistent and accurate and ready to use which seems like kind of a no-brainer why would you not want that it's it's it's obvious right what is less obvious is that that's not where most organizations start they generally have data from many siled sources whether they're multiple Erp systems or CRM systems or Legacy systems or external data feeds the data is coming from lots of different places and it needs to be joined together to be used but when it comes from all these different disjointed sources it's duplicated and ungoverned I may have same customer information in multiple different systems but it's slightly different in each one so when I bring it all together it looks like three customers instead of one customer and that's just the source of tremendous frustration and accuracy and potentially misleading conclusions so all of that is pretty um obvious and to be expected if you create this data without the benefit of unified uh Universal data governance that's just what you're going to get and uh and we should all expect that so paradoxically the data that you're trying to use uh is preventing you from creating the data that you need to use uh to drive your business so if you think about it that with the data it kind of becomes a brick wall uh that we need to overcome somehow and that's what we do with uh um with these products that we're going to show today uh we're going to show how purview and uh prophecy Master their management work together at the core of the intelligent data platform to Microsoft intelligent data platform to overcome these data silos and deliver something that is usable data that you can use to drive your business at the very high level purview scans and classifies data and creates a data catalog and that's a tremendous first start it can then start to help Define some of the data standards allocate the data the governance stewards the governance you know the owners of the data the access policies as well as some of the governance and data quality policies those can then be made but by itself it's not going to be changing the data it's not going to be merging multiple customer records into one trusted golden customer record that kind of thing that is the job of an MDM such as prophecy we're there to enforce the data standards that might be set by uh by purview will match and merge uh information Master data information from at least multiple sources and then validate that it's meeting all of our requirements in terms of quality and governance standards and where it doesn't will remediate it or we have a a workspace where data stewards can come in and remediate that data and make sure that it is worthy and then when we uh we we can notify it back into purview that this information is now certified so that someone seeking to find high quality data to use to drive whatever it is in their business has certified data to um to use okay so that's kind of the the the high level of how this uh comes together let me hand over now to srikanth and srikanth you might want to just introduce yourself for 30 seconds and then uh take us through the intelligent data platform overview uh you're on mute I think socaf Thanks Martin hopefully folks can hear me now um my name is shrikan venkat I'm part of the uh Microsoft's preview product team and uh within the purview product team my team looks at a number of things like customer engagements as well as ISP and partner ecosystem strategic roadmap Etc so you're super excited here to partner with prophecy we have been partners for uh probably the longest when it comes to preview like over two years now and um as some of you might be aware we made an announcement back in build in May around the Microsoft intelligent data platform uh think of this as a way to unify all of your data management capabilities and then to provide this Comprehensive Pain of governance as well as other aspects of data management within one platform so we take our existing Services uh in terms of Microsoft's for example SQL Server Azure SQL Cosmos DB Etc uh along with the data governance fabric that we're building with Fairview and then announced that all of these will provide you the ability to do this holistic data management unifying the analytics databases and data governance uh sort of pillars that we have and this is what we announced back in build in in May and then back uh and in the uh last ignite in October if you can move to the next slide we announced the midp the Microsoft intelligent data platform ecosystem which has a number of partners that we've identified here so and in particular what we see primitive featured here is in the MDM space proxy has been our uh you know longest uh you know that we've been working with and probably has the most one of the most mature of the Integrations that we have with the governance stack within within the midp platform um so the idea here is that we want to have this ecosystem of complementary partner solutions that have been curated and which complement a lot of the midp service capabilities and they uh unblock or accelerate the growth for our customers in terms of their management of the United States and then we've handpicked these Partners based on the proven customer adoption and Joint use cases that we have and also in terms of Mind share and as as you already mentioned we picked those Partners where you have these durable Partnerships so they're willing to invest with us in GTM and maturity models and then have that end-to-end integration across the mitp stack in terms of the customer experience whether it's like you know all the way from the discovery of the services to acquisition to use and commerce and all those so that's uh roughly what we've looked at in in terms of this picture and then perhaps is one of our launch partners of this isv ecosystem so moving forward um you know what what just to kind of give you a little bit of a background on preview for those who might not be familiar um across Industries and organizations we see that our customers are you know leveraging and recognizing this transformative power of data and its ability to you know Propel new business outcomes but the data needs to be discoverable easily and then understandable and needs to have high quality govern protected Etc with the uh property you know corporate or other standards regulatory standards that it's subjective so we're seeing this whole Confluence of you know more data which is a more complex you know landscape you know growing in variety volume Etc more systems and more silos across these in terms of operations and then there are more environments so the data data states are now getting like you know spanning all the way from Edge to multi multi-cloud on-prem SAS all of these environments and there's quite a few regulations that are coming that are you know you know throwing this uh you know under the lens of uh you know proper scrutiny and management um and then there's also more democratization of the data happening around this so how do we sort of you know provide these right guard rails around uh all of this data and it's used in the Enterprise while providing the uh right business case and that's that's where our data governance pillar within midp focused on Microsoft purview comes in this is where we want to build this Cloud native hyperscale hybrid Cloud aware experience uh through an extensible platform where you catalog things once for example and then uh you're able to provide all of these capabilities that I've mentioned below here around self-service data Discovery as well as insights and and various workflows for the other person as such as your Chief data officer Chief privacy officer and security and compliance outside of the house so we can go to the next slide thank you so this is uh sort of an eye chart but I want to kind of very quickly talk through what uh the purview platform is so uh think of uh purview as a platform and a set of applications sitting on top of it that Leverage The the information in the platform uh the platform component is what we call the data map think of that as a giant collected Knowledge Graph where your assets in the Enterprise are the nodes on the graph and then the relationships uh these could be structural or functional relationships this could be things like lineage with things like classifications or additional business contacts that's used to decorate that edge uh they give that vertex those form the the connected graph or Knowledge Graph that we use to power the platform all of our API surface here is governed by Apache Atlas we are 100 compatible with that and then anything that you would be able to do in terms of type extensions or other ability to you know program dramatically add lineage or other aspects of these relationships is all exposed completely that is our API surface in terms of preview and then the uh all of this hydrates what we call the data map and then the data map think of that as a foundational component that powers per view uh as you can imagine there's like a lot of different sources that customers might have there's a lot of complexity with this data state so we have built automated scanning and classification capabilities to power the data map to be able to populate this data map or hydrate this data map once across the Enterprise so that all of the uh you know applications sitting on top whether they are uh you know Microsoft's own first party applications or third-party or partner applications such as prophecy can leverage the same data map once uh to do uh you know to offer different workflows for different personas within the Enterprise so the bottom you see here like we cover uh you know hybrid and multi-cloud sources you know whether it's your traditional database an operational or analytical environments on-prem or in the cloud files object stores and data Lakes various business apps as well as multi-cloud so we do cover several services in AWS and gcp in addition to a lot of our first party services in Azure then we also cover third parties such as snowflake and a lot of the on-prem systems including everything from db2 to article teradata SQL Server Etc so these scanners go and take all of the metadata information that you have populate that into the data map and make it available for all of the applications that sit on top so the platform alone is is not enough for use of that data so you need to have workflows and experiences that kind of speak to that and that's where these apps come in so there are various apps focused on different personas so moving from left to right you have a data catalog which makes sense to have on top of this data map kind of platform where people can find assets understand their contacts and be able to use things and then for example to be able to classify assets do we understand the lineage and trustworthiness of the data all of those are within the data catalog app the data map the scanning capabilities and the data catalog have already been GA for almost a year now a little more than a year we have various other apps that we uh that are in various stages of preview uh moving from left to right is data sharing where you could have snapshot or uh in place sharing and in in this particular case in purview we already have a public preview of the input sharing across ADLs as an example uh in private preview we have a data quality application which is focused on assessments and then down the line we will add other capabilities around data cleansing intermediation we also have a data in estate insights app which went uh GA I think back in July this is around how do you get a bird's eye view and drill down into different parts of your data States we have a data policy app that's based on a policy engine that came from a blue Talent acquisition that's capable of handling all kinds of data access governance policies everything from your data access controls uh you know both attribute based access control as well as resource-based access control and other policies such as life cycle are all possible to be powered through that policy engine that has been in public preview in terms of the data Access Control capabilities and uh about a couple of weeks ago we announced the general availability of one portion of it for the SQL devops policies that were announced as part of SQL Server 2022. uh we also have a data privacy uh privacy Ops kind of application that we're building that would do everything from privacy assessments uh to other operations and management uh in this different areas so everything from your data subject access requests Etc uh you know we are planning to build some capabilities around that you know expose these as apps sitting on top of the same data map platform so the idea behind this is that the data map Powers all of the other apps on top including not only our apps but also third-party apps and one area where uh you know purview has uh completely delegated to the partner ecosystem is Master data management area and you know prophecy as we mentioned before is one of our uh you know oldest and probably more mature Partners in in this regard which are you know offers the mdmrdm and record management sort of capabilities you can go to the next slide just wanted to kind of you know talk through a little bit before Eric Dives in all of our isv and partner Integrations focus on the ability of third-party apps to run on top of the same platform so it's very becomes very important to understand this data platform and what it means and uh we want to kind of give a little bit more context on this uh so the data map think of that as the knowledge graph and then it connects those data assets and then you can add various types of metadata whether it's techno Business Health semantic compliance Etc and because of our Origins with the Apache Atlas sort of infrastructure and apis it's an open platform so you can actually add your own models recently we introduced a concept of what we call Meta models which will help you model your domains and systems and processes for example and then you can customize that to your existing environments at your existing business processes and then the fact that we have these scanners working to enrich that platform means that that we always can do the discovery and stewardship near real time and keep that up to date and various types of assets and you know relationships we already have represented so this could be like your files tables columns Etc uh we have some elements of location that we're working on uh that will be added in terms of the metadata semantic and business metadata already is available through things like business terms data domains business policies Etc through this metamodel construct that is just entered public preview a couple of weeks ago we are working on health entitlement and other types of metadata that you can add on top or interest with the data map and then above all we have the third party apps that integrate with this layer so that they can also seamlessly use all of the data that we can hydrate once across all of this data and I think Eric will go through in this demo how we kind of take all of this uh you know whether these are on-prem or cloud or hybrid sort of you know scenarios and whether it's operational analytic or you know the data Lake kind of environments how do we capture all of those uh you know data map uh items and then as you go through your pipelining and MDM and mastering processes how does purview interact with uh you know the purview platform interact with the third-party apps such as uh prophecy sitting on top to leverage that value so I'll hand it over to you to Eric thank you all right Eric just just as Eric is uh grabbing control of the the screen sharing his uh slides I'll point out to you that um in the docs tab on your the webcast software there are some things you can click on to uh get a further demo or understand more about how we work with the intelligent data platform I don't want you to do that why lyrics talking but I want to make you aware that those things are there for you and I see that uh there's some stuff uh um in the Q a tab um I'll start working in that while Eric is talking and we'll do our best to answer your question so feel free to drop in more questions and with that Eric over to you yeah I think you may need to stop sharing Martin for me in order for me to take over um there you go sorry about that screen there we go all right can you confirm you're seeing my screen mark yes okay great so what we're going to walk through uh I sure can't share it a little bit about the Microsoft intelligent data platform the ecosystem and processes involvement so we're going to do is actually walk through a reference architecture that shows you know how all these pieces can fit together and how how uh the Integrations that we've developed with Microsoft help enable this broader architecture so this actually will help answer one of the questions I saw in the chat which is kind of where do you start first is it it's kind of metadata or data governance first versus MDM first at the end of the day one thing purview uh can really help you with is understanding what data you have and where it exists and that's obviously a key input uh to MDM so with purview it makes it easy for you to scan your broader data State identify scan and classify all of your existing data assets and then and then load all that into Purvis data map then access that through uh the purview data catalog um and then you know we're prophecy and MDM plugs in it's in the ability to once you've discovered all the data you have you then start putting uh different domains of data under management so typically Master data Management Solutions are focused on Master data domains so customers products locations reference data I saw someone mention of the Q a provider data if you're in a healthcare space if you're manufacturing it might be you know materials that's typically the data that organizations are putting under management and most of the time if you're within DM what you're really trying to do is solve an underlying business problem right we want to improve our ability to cross-sell upsell in order to do that you need to understand who your customers are and what products you can sell into those customers so as a result of that most of our customers quickly Implement prophecy and actually have multiple domains under management so as you as you model your master data in Prophecy um and start to put it under management um you know this is where our first integration within the intelligent data platform ecosystem comes into play which is process integration with purview so in order to enable this all you need to do is is register with proxy the purview account you wish to use and at that point everything is fully automated so the first step of that is that the uh the assets that are created within prophecy are automatically published into the purge data map that allows all of your prophecy assets to natively participate in governance inside of purview alongside the rest of your data State and then as governance occurs within purview um you can then uh that that information is then consumed back and displayed within prophecy back to your data Steward so for example if you classify some data or associate some glass glossary terms with a master data entity within prophecy that information is natively available back to data stewards as they Steward data within prophecy so to show you a little bit about how that actually looks like from a product perspective you know starting here within purview let's say I'm a user within my organization I'm looking for some customer data and going into purview we can we can use the catalog to quickly search the data map and here we can see a number of different proxy assets that were automatically published to purview from prophecy if we click on this customer asset we can see the description that's been captured we can see um you know the various technical bits of metadata that were published here by prophecy and we can see the underlying schema of what a customer looks like in Prophecy and all the various classifications associated with that we can see contacts that have been defined as experts and owners of this particular asset then we can also see a lineage and in this case what this lineage is showing is actually the the matching and golden record management process within prophecy the mechanisms through which processes ml-based cluster string engine is creating golden records and then ultimately how those golden records are populated with with Source data through a promotion process in this scenario we're looking for uh you know some golden records and so maybe we in this case we can click on this golden record data set called customer Masters we can see here yes this is in fact you know perhaps the data set that I'm looking to use within my Enterprise I can actually click the link here from purview and navigate to that asset within prophecy so this is this is the the integration we've delivered between purview and prophecy and then from there we can get into the the mainline data management capabilities of the processing platform so you know the ability to identify and capture and correct data quality issues the ability for us to identify um like records group them together and create golden records the ability to manage uh you know hierarchies and relationships within our data and all through a broad data stewardship user experience so just to to show some of those capabilities that are inherent to MDM and how MDM actually helps you begin to improve your data we can go in here into the proxy platform in this case I'm going to open up my fast app that's been designed for managing customer data and in this case I can go ahead and I know there's a particular uh account that I'm looking for which is full of sports Supply and here we can go ahead and open up this particular match group so we can see that Posse through our ml based matching engine has identified four existing Source records that really all look like fundamentally the same business this is where prophecies then created a golden record if you want to understand the mechanics of how these Source records have been matched together can open up a match group visualizer and here we can see that that you know the various Records who match to whom and we can drill into the details of some of these scores I don't have my model stood up and then from there we can make a decision about yes this looks like a good match I'm going to go ahead and approve it so this is all about making sure that we have the right group formed and then from there we we can go into the ability to then populate the golden record with the best available information from our source records so here we can see which records we we grab various values from and we can also have the ability to manually override some of these if we decide that you know one of these other values is in fact a better assignment or promotion up to the golden record so that's one of the the core capabilities of the MDM platform um but proxy also has the ability to manage multiple different domains so let me go ahead and switch to a different application here focused on product data and here we can see some of the other capabilities that are available from an MDM perspective so I'm going to go ahead and filter down to um a few different records so from a data quality perspective we can see here that we have three Touring bike records that have some sort of data quality issue I can click on that and I can see here that my uh the rule that has been violated here is that my MSRP must be 50 greater than my standard cost and in this case I can see that the MSRP for these three records looks to be you know kind of uh miskey compared to some of the other records nearby and this is something where not only can we identify data quality issues but we can actually correct those issues within prophecy and ultimately push that corrected value back into Upstream operational application so in this case go in here and re-key the correct value click save and proxy will automatically reevaluate those records for data quality in this case marketing them as as corrected and that's something that could then be pushed either back into operational applications or certainly consumed Downstream in your analytics environment we can click around here we can also manage different facets of relationships so process a mechanism to allow you to visualize and manage relationships in your data we also have the ability to manage hierarchies within your data so if we go into our our uh our our hierarchy here we're navigating through a product hierarchy in this case I'm down looking at Mountain frames I see two records here that that don't look like they're um they're in the correct spot and go ahead and move these I could find the the correct uh product category for these to be uh moved under and go ahead and complete that move and now I can go find those two products out inside of the correct so if I was in power bi and I saw as I was drilling down my hierarchy I saw data quality issues something that was not in the right spot or we re-categorize these products proxy makes it very easy for you to correct those issues and then obviously It ultimately improve the quality of the data in your analytics environment so that's just a very quick walk through some of the core capabilities of MDM and how it can help make your data better of course the next question is how do we actually get this data from our operational applications into MDM this is where another effort that we've we've been working on jointly with Microsoft around Azure data factory makes that easy so this began with uh prophecy originally working with the Azure data Factory team this is going back now a couple years ago the ADF team was working on their new connectors around uh respite restful services and so working with the Azure data Factory team we made sure that proxy Zone rest based apis were were compatible with how Azure data Factory needed a rest API to work in order to easily stream data in and out of Prophecy via rest and then the Azure data Factory actually made some changes and enhancements to their arrest capabilities in order to make the user experience for doing so um simple and easy and and that's manifested itself and to prostate creating some ADF templates and those templates have just been recently published into the global template galleries if you go into Azure data Factory and you want to create a new pipeline from temp from a template you can go in here and actually see that proxy is one of the template providers and here you get the ability to easily select a template click continue um configure your source and destination Link services and at that point you're easily able to pick data up from various places in your Enterprise and write it into prophecy or vice versa so now that we've we've uh governed our data we've we've put some data under management made it better obviously uh performed some levels of integration now what do we do with it so in addition to pushing that that data that better data back to our operational applications we also uh oftentimes virtually all of our customers want to push it Downstream into their analytics environment so um in many cases that means taking the transactional data out of your operational applications and bring it into a data warehousing platform such as Azure synapse analytics and then connecting back together with the improved Master data that's been generated from within prophecy and then making that available to your broader business Community um to use to drive better decision making in addition to that there's also a number of scenarios where customers will be in tools such as power bi looking to perform more uh ad hoc type analysis and this is where another integration that we've we've worked on with Microsoft which is a power bi connector for prophecy and so uh the scenario here is you know I'm a power bi user and I'm putting I've got some data that I've received I'm looking to do an ad hoc analysis I've got some sales data that's got maybe some customer product kind of skus or customer IDs in it but what I need is a richer set of product or customer data to actually complete my analysis and uh and in order to make that easy our power bi connector allows users to easily open up power bi natively connect to prophecy I'm using that power bi connector you can see that connector is here so this connector has been certified by Microsoft and is auto is now uh published out to any PowerUp bi user globally and so selecting that proxy power bi connector all you need is the URL of your prophecy instance and you connect select the the data that you actually want to import into your power bi model now that point you can then connect it up with the other information you're building out in your analysis now you can start to leverage that to improve your Insight so for example we were looking at full support Supply in Prophecy previously and we saw that there are four different versions of full support Supply Now by it by importing our our source and our golden customer record data from proxy into Power bi and now able to understand not just you know how much revenue I generated from these various different permutations of full support Supply but what is my actual total relationship with that real business entity out there in the world across my different applications and across those those different duplicate records okay so now if you think about you know from an end user's perspective what is the experience here um what this what this allows you to do is is for your typical data analysts they can almost ignore all the sort of internal mechanics of how data is being integrated across the organization all the underlying capabilities in ways that MDM is actually making the data better what this allows those users to do is to go to leverage purview to find the data that they need and in some cases purview might help them find that better data inside of synapse at which point they can go into tools like power bi and then use it and consume it or in some cases they need may find the data that they needed within prophecy such as maybe some sort of reference data set and again they're able to go into the the tools that they wish to use and then leverage that data within those tools to improve their decision making so this really is a way for to democratize the Discovery access and ultimately the usage of information across the Enterprise so um we'll go ahead and we're going to try to leave about uh 10 minutes or so here at the end um the last thing we want to cover off was just kind of the the various deployment options and ways that customers um have uh for running prophecies so as Mark mentioned previously um about two and a half years ago prophecy um released a version of our product that ran natively in containers what that means is that any of our customers could basically take the platform and those container images and then run prophecy and their chosen cloud provider which in the majority of the cases our customers are running uh the proxy platform in Azure um we we then began a the process of taking those same container images and making processes available as a true software as a service offering for our customers um and what and this slide kind of uh logically illustrates what that looks like so we've created a number of different uh uh prophecy uh Cloud regions across the world and then those regions is to put a multi-tenant infrastructure which we then stripe uh customer tenants across that infrastructure so um this is a modern Cloud software as a service architecture um allows us to deliver this in a very a reasonable cost point for our customers our our operations team is is fully managing and modern monitoring this for you but it's still the exact same software under the coverage right so whether you run our container yourself or running it for you it's the exact same software it's the exact same container image which allows you to get all the same capabilities and eliminates the sort of catch-22s you often face you know with you know certain features being only available in one one scenario or the other this allows us to from a security perspective which is something we've invested in heavily with this allows us to isolate our our customer tenants from each other so it's your database it's your kubernetes pod running here which means that it really eliminates the the risk of of some sort of wires getting crossed and your data being exposed to anybody else so this has been defined to be secure and everything's deployed programmatically using a technology called terraform which is an infrastructure's code technology so and that's the the high levels of how we've delivered this uh another key capability is we actually uh make the proxy uh Cloud available with a with an out of the box cross region uh kind of high availability and Disaster Recovery architecture um So within our active uh region um in this case East us2 um we have you know uh kubernetes running across multiple availability zones we're running our our storage accounts and our SQL servers and a large elastic pool um all designed to be inherently highly available outside out of the box and in the event of some sort of major outage at ecos II we're always replicating our customer solutions to an alternate Azure region and in the event of an outage we're easily able to fail over our customers into that alternate Azure region providing a built-in Disaster Recovery capability which is which is something that you know to our knowledge no other MDM vendor is providing any of this sort of cloud native offerings so this has really been architected not just be secure but also highly available as we have a growing number of customers using prophecy and very Mission critical applications um as a part of that I mentioned that security has been a major concern of ours so not only did we architect our SAS solution to be highly highly secure we've also invested in in a security program and all the various uh kind of security audits that you expect in order for our customers to feel comfortable um trusting Prophecy with their sensitive data so we now have our sock 2 and HIPAA high-tech certifications we're also in the process of going through our um our first ISO 27001 audit which we'll begin here in the coming month we're continuing to invest in in additional enhancements to the underlying SAS infrastructure for security which you know covers things like having a private SAS offering which we are on the cusp of making available to our customers now that some capabilities within Azure have it made available so um the solution is secure it's highly available if you want to see the details of security and how we we guarantee that our our customers data is treated with the with the the concerns you would expect we have a page on our website that goes through all the various details of our security program um and SAS so that's uh that's all the kind of product related and and uh the details around the intelligent data platform I'll go ahead and hand it over to uh Martin to wrap things up and then we will um we will go ahead and open it up for Q a spectacular Eric that was uh that was a bit of a fire hose there was an awful lot in that in a good way at farho's in a good way you covered a huge amount of ground in a small amount of time so um if anyone uh wants to get the um the replay at some point and go back through it line by line you're also welcome obviously welcome to do that and uh please drop any more questions in chat I think a lot of them have been handled as we've gone through here but uh we have a bit of time to to cover more so I'll let uh I'll let Eric and uh srikans kind of check those out while I cover this kind of this slide here because as a wrap up so um if you are uh thinking about the Microsoft intelligent data uh platform and how to implement that and make more high quality certified data available to the analysts who need to to use it to either just gain Insight on the business or uh to drive forward the business based on you know to to innovate and digitally transform the business uh then I think uh it should be clear it's certainly clear to us that you need to have a good platform of certified uh quality data to to to do that which means you probably need MDM we think you do need MDM and if if you buy the argument that you need MDM as part of that as part of the underpinnings of having good data then this slide here is is intended to to talk about why we think we are the best but prophecy is the best choice of MDM to fill that need if you're a Microsoft Centric organization and because you're here on this uh webcast I would guess that you are a lot of our customers are uh then it would be important to you I think to know that we have the best integration with azure um and lots of different components of azure we talked quite a lot here about purview and the fact that circanth is here from the purview team uh and he tell he he mentioned earlier that we have the most mature and longest uh running integration with purview um I I think uh speaks volumes uh we're also integrated with Azure data Factory Eric showed some of that where some of our pipeline templates are now shipped with Azure data Factory um and the same thing with power bi we um have a native connector which we built but is now shipped with uh Power bi so that you can access data from Power bi uh directly um you can access Master data directly from Power bi which Eric also showed and we can seamlessly publish information into synapse again that was all covered in the architecture uh walkthrough but we use ADF and anything else that you'd want to use to to join together the transactional and master data in synapse which is really should be the foundation for all of your uh reporting from a intelligent data platform From perspective we are generally I think viewed in the market as very easy to implement and use our customers certainly uh tell us a lot of times that that's why they chose us some things that make that true are the fact that we have uh kubernetes packaged uh service our rather our solution is packaged as a kubernetes service and you can Implement platform as a service or software as a service Eric talked about that uh and the software as a service you can have up and running in a few minutes to get you going very very quickly then all you need to do is is upload your own artifacts into it and start using it it's the same software again as Eric mentioned whether you're doing platform as a service or software as a service so you can actually you know migrate from one to the other relatively simply if that's you what you'd like to do we are one of the the quickest uh implementations in the industry Gartner points out that we have a 19 more uh customers implementing in under 90 days than any other vendor in one of their mqs the you mentioned that and I would only point out that some other vendors take an awful lot longer than that setting up the software for us can be a few minutes and then the rest is just how you configure it so um that is fast with us and it's an inherently multi-domain solution some other vendors and approaches kind of required you start with one uh um kind of pre-packaged domain and then it's kind of a big lift to move to the second or third or fourth with us uh each domain that you would Implement would get faster and faster and there's no pricing or technical limitations in the software that would prevent you from creating as many domains as you need to support your use case um and uh we're as I mentioned right at the very beginning generally fairly well uh liked by our customers uh we're very proud of that and we work very hard at it um so we have the highest recommendations on Gardener career sites and uh with regards to our uh integration into Microsoft we have the most MDM deployments on Azure of any vendor and the most joint sales with purview of any vendor so um hopefully that would be enough for for you to believe that we are uh the best uh way of implementing MDM within uh intelligent data platform and uh alongside part of you so that was all I really wanted to uh to cover um Eric could you just flip to the next slide and we'll we'll leave it hanging on there while we have the uh q a there you go so um some of this is uh the same things that were published in the uh the docs tab of of the website uh the webcast software we do weekly demos uh where we cover a lot of the same ground here but we might see it presented in a slightly different way so you can register for a weekly demo uh we alternate weeks where we're just talking about prophecy and uh weeks where we're talking about the prophecy purview integration so feel free to go sign up for those um you can go to prophecy.com midp there's quite a a few artifacts in there some walkthroughs of the architectures that we just talked about in various other uh ways that this has been presented in the past so there's some questions about that and some people asking for the reference architecture so you can get that there and then uh if you go to the docs.microsoft.com and search on Prophecy uh right now there's uh three there's another one of these just in the process of being published documents one a couple actually talking about how we are integrated with purview one that talking about how we integrate with Azure data Factory and the one that's just about to be published is um how we can convert uh MDS uh Microsoft Master data services um customers to uh full-featured MDM so I'll let you think about that Eric any questions that you want to handle um uh verbally I think you've probably been busy uh typing but is there anything that you want to to cover yeah there's a couple here I think um so a couple people have asked for permissions for some of these slides of support internal discussions you know I think happy to share reach out to either Martin or I or our email address is our first dot last at prophecy.com so eric.com if you don't already have that um there's a question around elaborating on the process integration with synapse so today's synapse has kind of the ability as you know a part of synapses is ADF pipelines um so our ADF integration um is already sort of baked into synapse via ADF um however we are you know we mentioned that Azure data or the the Microsoft intelligent data platform ecosystem um everything that we showed today is really just you know where we are today on our sort of you know steps on a long-term path through that partnership so um we are we will be working with the synapse as well as the broader data platform teams database teams with Microsoft on additional Integrations uh same same is true for purview there's a number of different uh purview enhancements between our you know joint integration that are planned for the future I saw someone asking around data quality rules that is absolutely on a roadmap um same is true for Azure data Factory so um so that is uh so so what you're seeing right now is a point in time um and there's far more to come um looking through there's one question I wanted to ask you about uh iski both both and Eric about uh workday uh I wasn't clear if the question was about workday is a source for uh purview uh being cataloged um or whether it was as an input to prophecy but if you guys can just cover that off quickly I'll I'll cover workday from the prophecy perspective we'll hand it sure can't for the the per view because I'm not I'm not 100 sure um so for work day um you know I'll we definitely have customers using prophecy in conjunction with workday um you know our integration strategy broadly you kind of see with Azure data Factory um is to make it easy for our customers to use their integration tools um alongside prophecy by providing open interfaces for doing doing so whether those be rest based interfaces or or something where the SQL Server database level so um and then or something through more message message based architecture with like a A mulesoft or Azure event Hub Etc so we definitely have customers using proxy with workday and typically they're they're integrating prophecy using kind of their existing standard integration tool that they're already using it to move data and out of workday and then uh sure can't I don't know if you uh have offhand whether or not purview has a work workday connectivity at or not yeah so um well our goal is to go where the customer's data estate is so whether it's in databases or you know file shares or even in the office side you know whether it's in SharePoint or other areas um and definitely one of the big systems that we want to look at is uh these business apps and you know without going to their backends so we already have a Salesforce connector for example uh similarly we'll have one for work here that's being planned it's um it just show up um you know eventually on our roadmap but our goal is to not only uh look at you know just your traditional sources but all of these other business apps where you may have other layers uh to harvest richer metadata to populate the data map which can then be used by you know not only you know the existing services but other new Integrations that will come uh you know lit up on top of the data map um I think that it's a similar uh you know answer to what uh Eric mentioned uh is that today for example uh you know prophecy is primary point of integration is with the data map so they're able to hydrate all of the stuff that uh is part of their pipeline but uh you know in the future what we're looking at is to consume information from the data map in the third-party apps so that you can do things like policy enforcement so one of the things we are working on with property is to be able to take the access control and other kinds of policies you can express with the policy engine and then have that be pushed down to their privacy environments so you can get for example the same you know Access Control picture that's consistent with the raw sources so your master data and your golden records can have the same you know they have there's some sensitivity with respect to certain fields in there as an example uh you know you can enforce the policies consistently across both the master data as well so those are the kinds of things that you're looking at yeah and yeah so Utopia would be you go into purview and say this movie can no longer see pii data and they did log into prophecy and there's no that all the pi data that we maybe have you know under management is no longer visible to that user would be an example of kind of a kind of that you know governance driving data management exactly um we're almost out of time here uh sir Kent was there anything out of the Q a that you wanted to just cover verbally for everyone's uh benefits or any other final words that you'd like to to add in here it was just one item here there was some confusion about column level lineage we do have column level linear supported in a variety of sources and then there was also a question on entitlements so the entitlements will come through as as you saw in the data map it's on our roadmap and we're looking more broadly so for example uh we are working very closely with the M365 compliance themes as an example and other parts of the security compliance sort of picture from Microsoft side so you'll see like a unified view of entitlements being brought in uh you know both from you know first Party Services as well as third-party data resources holistically so that's that's how we are approaching this as a platform for and a unified fabric for companies excellent um there's a couple of questions just showed up in uh chat Eric right at the the bottom yeah quickly cover them before we uh we're about to run out of time and I think the webcast will stop yeah so uh arcgis we do have Integrations with some mapping providers uh Google and Bing Melissa locate being the three um arcgis I don't I'm not aware of us well we don't have a productized integration there I would not be surprised if we have there there are interfaces where that could be done pretty easily um I'd have to check and see if we have any customers that have already done that um that's for Anna um and then Michael your question is probably easier Michael Hawk your last question is around uh Integrations probably longer than we have time for but happy to follow up with you offline um just give it to you real quick if there's any others that pop out I think we've mostly covered the mother in those last couple of things there that just showed up so uh we will um we'll we'll go through these in detail make sure that we didn't completely skip anything by mistake apologies if we did um but since we're at the top of the hour and uh uh everyone's probably in back to back calls we will uh call a halt here and thank you for your time um if you are interested in any of this you can go you can contact us Eric I already told you you can contact here right directly or contact us through uh the prophecy homepage and we would look forward to speaking to you thank you very much thanks Eric and thanks for Kent for supporting the presentation thank you everyone thanks

Channel: Profisee

Views: 610

Keywords:

Id: 4biLXNWQN7g

Length: 56min 52sec (3412 seconds)

Published: Tue Dec 13 2022