Microsoft Power Automate Tutorials || Module 21 : Invoice process With AI Builder ( Form Processing)

hello and welcome to power automate tutorials today we will learn how to build an ai model to automate the invoice process by using ai builder by using ai builder we can create custom ai models that suits our business needs now i will explain you how to create an invoice in detail companies often receive invoices in large quantities and from a variety of sources such as mail fax email or in person processing these documents and manually entering them into the database will takes time by using ai builder we can extract the text key value page and tables from the documents and we can create workflows to automatically pipe the information into our database in this invoice process we will do in five simple steps first step we will create an ai model based on our business need to process these documents second train and publish the model third one create a flow for the sources to receive the invoice documents fourth one use the ai model in our flows and finally we will store the data which we got it as part of the ai model will store them in the respective data source in such a way excel or the database now as a first step we will create an ai model for processing these invoice documents how can we go ahead and do that if you see on my screen i have logged in into flow.microsoft.com over there you will find ai builder first we need to create an ai model for the invoice process right so that if you expand the ai builders there you will find the option build click on that there you will find already predefined or pre-built ai models based on your business needs right you can see category classification entity extraction form processing object detection and prediction over here what we have to do we have to process our invoices for the pdf documents let me show you an input over here before working with form processing if you see on my screen i'm having an invoice with the details of bill from bill 2 and the invoice number invoice date and you can see over here i'm having the amount total amount for my items that you can see the total amount of the items so from this document i need to create an a model that i can process all the documents and then i can enter the data into my an excel over here i want to extract the invoice and the name to whom i have to build to and after that the total amount that i am going to capture from the emails and then i will store them in the excel this is how we are going to create a flow based on our a model now to process our invoice document we are going to select form processing select that if you want select that we will see over here three tabs that we have one is get started examples and the best practices once you will select the get started it will ask the name of the ai model so i'm going to give the name as ai invoice processing and after that you will see over here what you need to build this ai model or to create a an ai model you need at least five documents with the same layout in the sense whatever the invoice you have all the document should be in the proper in the same layout format all right and you see the examples over here the example of the invoice that we have we have the date and after that we have the billing tool and after that we have the items right the same way you are hanging all these these are all the sample examples that what you have and you can see the best practices the group of documents with the same layout you required and don't use the different layout documents while you are going to be collecting while you're going to work with this form processing use the documents with primary text and don't use the documents with a lot of images or the checkbox so don't do this kind of the documents while you're going to work with from processing and you can see use simple documents and after each document should be separated file and these are all the best practices what you have all right now what we are going to do we are going to create an ai model with the name of ai invoice processing click on create button no view if you see over here i'm having steps over here so each step i have to follow each and everything respectively now first thing is that through the information to extract what kind of information you need to extract from the particular files now i will say first one is invoice number this is the field which we are going to give it click on plus icon to add the field now i will give it the name name over here is to whom i am going to billing to and then i am going to click on add symbol again and after that i will give the amount what is the total amount that i got it or build to the particular customer which we have given the name all right let me click on plus again over here if you see right now i'm having fields and after the tables also the tables is in preview state right now i'm not going to discuss this one right away now we have added all the fields right now what are the fields that we are going to extract from the particular invoice now i'm going to click on next to add the collection of the documents now if you see over here second step is that add collection of the document for the ai model create a collection for each layout now if you see i'm going to select a new collection over here when i click on the new collection it is it will also add the documents i'm going to add the documents at least we required five sample documents for each the collection now what i'm going to do i'm going to use the simple documents over here in the collection now when you click on the collection it will also add the documents you can add the document from the different sources one is from your local computer or from the sharepoint or from the azure blob storage so for the time being what i will do i will use upload from the local storage and i am going to upload all the file documents over here you can have different same layout documents or different documents that you can use it let me click on open over here what is collection collection is a group of the documents that share the same type of layout okay now if you see over here i have uploaded all the fuzzer documents right now click on upload five documents over here now what it will do it will uploads all these documents to train our model all right now all the documents have been uploaded successfully click on close now if you see over here we'll get all the collection of file documents when you click on the collection these are all the five documents which i have been uploaded now what i have to do i have to analyze these documents how can i go ahead and analyze these documents so i'm going to click on analyze over here the ai model will takes a few minutes to unlock these documents so that it will improve the performance of our model so what it will do it will increase the it will train our model what kind of documents that we want to process all right now we have analyzed all the documents now i need to tag the documents right now see we have given the fields over here as invoice number and after that we have given name and after that the amount right these are all the three fields which we have right invoice name and amount i need to tag each and every free load here from the particular document and now if you see over here i want to collect the invoice number let me select that and then just i'm going to click on that and then i'm going to select invoice number and the second field is the name right so from where i'm going to get it bill to and i'm going to tag to the name and third one the amount i'm going to select the total amount and i'm going to tag to the amount this is the first document right in the same way if you go to the next document you can see over here it will try to analyze what are the fields that we have and it will tax automatically you can see over here for the second document i got it name and amount now it has not recognized for the invoice number so that i will tag externally and then i'm going to click on invoice in the same way third document you can see over here i'm having invoice number i will map or i will tag all the documents over here one by one now i have tagged the documents i have all what are the fields that i have i have tagged each and every document by using tag documents now let me click on next now finally what we will get it will get the model summary we have created a model with the name of ai processing and then you can see over here what is the data source from where we have uploaded the images from my device that you can see the fields over here these are the fields invoice number name and amount now once all the data has been gathered like information to extract adding the collection documents tagging the documents and finally we are going to train our model how can we go ahead and we can train it by clicking on train now our model is training so that it will takes a little bit time to train our model now if you see over here our model is ready now go to the models click on that now whatever the model ai model you have created that model will comes under the models tab you can see over here my models over here i'm having ai invoice processing right this is our model now if you see the status over here it is getting trained over here it is getting training so based on our documents it is going to be training what kind of fields we need to extract and what is the data it has to extract from the particular documents it will take a little bit time to get this is our second step we are going to train our model and then once it has been completed we need to publish this ai model now our a model with the name of a invoice processing has been successfully trained you can see the status over here train now as a second step i need to publish this model how can i publish this model you can click on ai invoice processing the name of the invoice first if you see over here the training document what are the training document that you have you can get it over here so and also you can see on the right hand side we're having the selected fields the invoice number name and amount right when you click on that you can see the training document you can find all the details over here okay let me click on close now this model will be used in two locations one in power automate as well as we can use this in power apps also okay now that our model is working fine or not how can we go ahead and we will note that now let me go ahead and let me click on quick test over here now by clicking on that you have to upload a document or drag and drop an image over here now what i'm going to do i'm going to upload from my device and i'm going to select one more invoice which i'm having let me select the invoice process and there if you see over here for the quick test it is going to be gathering the information or not you can see it is going to be analyzing by ai model that is ai invoice processing and you can see over here it has captured all the things that is one is invoice number second one is the name and the third one is the amount you can see all the fields with the 100 confidence score we got the data now let me start over and then let me close it now our model is ready to publish it as a second step we have to publish it right click on publish button now our model is ready to use it over here you can see over here use model when you click on that you can use it in your new app or new flow i don't want to create from here i will show you from the create button i will show you how to create a flow from there now our a model is ready with the name of ai invoice processing and also we have published the model now at the third step we'll create a flow from the different sources to receive the document such as email so how can we create a flow i'm going to select create over here and then i'm going to select instant cloudflow and from there i'm going to give the name as invoice process over here what is the triggering point for us so at the source that we are going to use as a email right so i'm going to select gmail over here as my connectors for the triggering point now when a new mail arrives if it is having any kind of pdf documents with invoices i am going to process them by using our ai model and then we will store inside our excel that is my agenda over here now what i am going to do when a new mail arrives i'm going to select the triggering action and then you can see the label over here in my inbox if i'm having any inbox from there if it is having that mail having any attachment i'm going to select s and including attachments also yes in that case now what i have to do i have to process my ai model right that is the next step which i'm going to select now over there our model is our action is that ai builder now to process our documents we are having forms right form processing now you can see over here process and save information from forms these are the thing which you are going to select as an action select that and you can see the inputs over here ai model select the published form processing model now what is the name we have created as part of the ai invoice processing that is the name ai invoice processing select that and what is the form type inside that we are having different types like pdf document images with the jpeg png and even you can have custom values also right now we are going to use pdf documents and you can see the form over here what is the form what is the input for this now if you see from the attachment content what is this if we got any emails with the attachments that we need to take it as a form and then we will proceed for the ai model all right i'm going to select attachments content now this is my input for the aim model right so now it will go through the loop because of if we can have multiple documents or even we can have single document we have to loop the number of times inside our emails right now once the mail has been received and then it is having invoices what is the action that i need to do now you can see i'm having an excel with the invoice data over there in my excel i'm having invoice number name and amount i want to enter the data inside that when a new mail has been occurred right that is the action that i need to do that that i'm going to select excel online over here and i am going to select over here as add new row that is add a row into the table i am going to select the location and the document library as onedrive and there if you see the file over here what is the file name that i have i'm having invoice data that is my file name and if you see over here that i'm having the table with the table one i'm going to select it now once you have selected it it will pop up with three different fields one is invoice number name and amount i need to map what are the output that we got it from the ai model that is process and save information from the forms i need to fill the data inside the invoice process now what i'm going to do i'm going to map them you can see over here from the invoice number i got the invoice number value i am going to map it in the same way from the name that is name value and the amount you can see over here the symbols a model symbols that is amount is amount value you will get it all right now let me save my flow by clicking on save now my flow is ready to test it click on test and i'm going to select manually and then i'm going to choose test option over here you can see over here to see it work now send an email to your inbox what i'm going to do from my mobile i'm going to send invoice to the particular email which you have used all right now let me send it once the flow has received the email so it will start analyzing the documents and then you can see over here your flow is running over here now you can see a new mail has been arrived and it will apply each and every step over here you can see or a over here i'm having five documents in that in these five documents it will takes any number of seconds over here for the first time it will take a little bit more time to analyze and to process the data by using process and save information from form it will extract the data from the particular invoices and then it will insert the new row into the particular table by using excel actions now the flow has been executed successfully and it has inserted the data into the excel let me show you that the output let me go to the excel on the invoice data now you can see i have uploaded five documents in a particular mail that you can see the invoice number and the name of the customer and the amount you can see all the data has been processed successfully by using ai model in such a way if you are if you are going to receive any number of invoice or large quantity of invoices you can process them within span of time i hope you understand how to create a new ui model and how to train and publish that ui model and also we have seen how to create a flow by using this ai models and after that we have seen how to use them under how to store their respective data into them excel as part of this tutorial thank you for watching power up my tutorials if you have any queries related to this concept please post them in the comment section i will see you in the next session till then bye bye have a wonderful day

Channel: Learning RPA Technologies

Views: 16,645

Keywords: invoice process by ai builder, microsoft flow, microsoft, microsoft power automate tutorials, power automate for beginners, Microsoft flow, Power Automate, UI Flows by using power automate., microsoft power automate tutorial, microsoft power automate rpa, power automate flow tutorial, microsoft power automate for beginners, microsoft power automate flow, power automate, ms flow, introducing ai builder, ai builder in power automate, microsoft power automate, form processing

Id: K0Fj7WZdRng

Length: 20min 13sec (1213 seconds)

Published: Wed Feb 17 2021