How to Install PrivateGPT - AI Chat with your own Files! (Quick Setup and How to Use - EASY!)

foreign welcome to the channel today I want to show you a project called private GPT private GPT is a GPT large language model that is installed locally on your PC it allows you to ingest your own documents you can then ask questions and interrogate these documents private GPT can ingest the following file types this includes docs we use daily like emails Word documents csvs and PDFs it's totally offline you can use different large language models on it it works solely on a CPU so you don't need an expensive graphics card and it requires no API keys in this example I've ingested the children's book Pinocchio and I'm asking the system does Pinocchio's nose grow longer when it tells lies and you can see it clearly answers the question yes it does and it will further substantiate that with references out of the text in the next example I've stepped it up a bit from a children's book I've ingested the King 4 report on corporate governance and I'm asking the system corporate governance is defined as let's submit that and see what it returns and yeah you can see um it answers the definition of corporate governance and it points me to corporate governance is defined as the governing body trying to achieve a ethical culture good performance effective controls and legitimacy if you want to start chatting to your own documents I'll quickly show you how to get private GPT working on your own Windows PC first let's download all the required software to build private GPT we'll need get let's get over to the get for Windows website and download the windows installer next go to python download the latest version then we'll need Anaconda to run this in a private environment head over to the Anaconda website and download the installer and then lastly let's download the visual studio Community Edition you can install get accept all the defaults then install Python and when the installer launches make sure to select this checkbox to add python to your path then install anaconda and you can accept all the defaults lastly install visual stated Community Edition and when the installer launches make sure that you select these two check boxes the one is for the universal windows platform development and the other one is for the desktop development on C plus plus now that we installed all the required software it might not be a bad idea to cycle power and reboot Windows so everything starts fresh and clean now let's Clan and configure private GPT first thing you want to do is open up Anaconda prompt in admin mode Now navigate somewhere on your drive and create a project folder where we can clone private GPT into in my case I'm creating a folder called pgbt enter the folder that you just created execute python space dash dash version and confirm the version of python that you're running on your PC we'll use condo to create a separate environment where we can run private gbt in execute the phone following command conda space create space dash n space private GPT space your python version that you're running to activate this environment execute conda space activate spice private GPT and if your environment successfully activated you should see it at the bottom left hand corner now it's time to clone the private GPT repo head over to the GitHub page and click on this green code button and copy the link specified make sure you're on the folder you create it for your private GPT project and execute git spice clone and paste the URL we copied earlier and take notice when you Clan the repo it will create a subfolder called private GPT enter that folder we are now ready to install private GPT execute the following command but three space install spice Dash or spice requirements.txt check the screen make sure that you get no errors you'll now need to decide what model you want to use with private GPT it ships with GPT for all which is nice and small and I've had very good results with it if you want to use that go ahead and download that off the guitar page private GPT also works fine on large language models like the vaguna model which is a 13 billion parameter model if you want to use that model go ahead and download it from the hugging phase website after you downloaded the selected model you want to use open your Windows Explorer go into your private GPT folder and create a folder called models enter your models folder and paste the model you downloaded in this folder navigate back to your private GPT folder and you want to look for a file called example.env we want to rename that to just dot EnV right click the dot EnV file and open it up in your favorite editor and here we can see the configuration that private GPT is going to start up with I'm using the default model so you can see it's using the model type GPT for all and it's correctly displaying my model path and model name if you were using something like the vicunia 13 billion parameter model you will just change the model type to llama CBB and accordingly fill in the correct model name before you fire our private GPT a revenue or working directory and into the source documents directory let's feed it some data that we can play with you'll see that it ships with a sample file I'm going to go ahead and add the King 4 report and Pinocchio to this folder open your anaconda prompt and execute the following command to engage the data we just added to the source documents execute python space in js.py now that all our documents are ingested we can launch private GPT execute python space private gpt.py and private GPT started up successfully I can now enter my first prompt and I'm going to ask it for the definition of good corporate governance as defined by King 4 and private GPT has now interrogated the King 4 report and its return the definition of good corporate governance and it's saying that it's leadership trying to install an ethical culture good performance effective control and legitimacy and yeah we can verify that in the original King 4 report let's pivot back to Pinocchio and I'm going to ask it does Pinocchio's nose grow longer when he tells lies and you can see yes Pinocchio's nose does grow longer when he tells lies should now be able to import your own documents and play with private GPT I hope you've enjoyed the video if you found any value please consider liking and subscribing and follow our Channel

Channel: StuffAboutStuff

Views: 7,094

Keywords: PrivateGPT, install privategpt, chat with your own documents, PrivateGPT windows install, how to install privategpt, how to use privategpt, privategpt github, install models for privategpt, private gpt, using privategpt, configure private gpt, ai for your documents, GPT for files on PC, AI your documents, chat with your documents, what is privategpt, privategpt video, private gpt explained, example privategpt use, opensource ai, ingest docs with privategpt, chat your files

Id: wiQxzHU45HE

Length: 7min 40sec (460 seconds)

Published: Wed Sep 06 2023