PrivateGPT 4.0 Windows Install Guide (Chat to Docs) Ollama & Mistral LLM Support!

hi everyone welcome to the channel today I want to show you how to install the updated private GPT version 0.40 and how to integrate this with o Lama for first time users of private GPT private GPT is an AI tool that allows us to ingest documents stored on our local computer the program will ingest your documents and using Ai and large language models private GPT will allow you to query and interact with these ingested documents the new versions of private GPT also ships with a web user interface plus the ability to run a chat GPT chatbot locally using open-source large language models of your choosing private GPT has gone through three major updates since its original release have a look on our Channel at the first two iterations of private G PT the original version of private GPT was a Nimble and fast tool that you could use to chat with your documents its limitation was it could only be used from the command line it's now known as the primordial version you can watch this video and follow the steps using the G page for the primordial version if you still want to build this version the project then received a massive update including a web GUI and the the chatboard capabilities added but this version was very complicated to build and GPU offloading for amdn envidia cards was difficult to get set up and working the latest version of private GPT now allows you to offload all those complexities of managing the large language models and the gpus to a third party of your choice like o Lama I think this is a great move in the right direction it simplifies the install removes complexities and allows for a general better install and operating experience now let's set up private GPT with oama on Windows if you have not worked with AMA yet I would suggest looking at this video this video will show you how to install aama on Windows and here I unpack the commands available in ama to get oama up and running for private GPT visit ama.com and download the windows installer install AMA and when the installer finalizes make sure that you can see the Alama service up and running in your taskbar let's first confirm that ama is working open a command prompt and execute the command AMA and the AMA command should return a list of all the available commands in olama you can now go ahead and download a model to use for private GPT we'll download the myal model execute the following command AMA P myl now that we successfully downloaded the myl model let's install the embeddings execute the following command AMA space Bull space nomic Das embed Das text and now that you have the mestral model and the embeddings you can just make sure a llama is running by executing a llama space serve with our llama up and running we can now move on to installing private GPT and its required software first download git for Windows next download a version of python 3.11 it's important to use the correct version of python here grab a copy of anaconda we're going to use this to run private GPT in its own environment and lastly download a copy of visual stereo Community Edition and now that we have all the software downloaded first install git and you can accept all the defaults and now that we've got git successfully installed let's install Python 3.11 and when the installer launches make sure you select this checkbox to add python to your path then go ahead install python now with python successfully installed let's move on to Anaconda I'm going to go with the default options detected by Anaconda as you can see on the following screens now go ahead install Anaconda now you are ready to install visual stereo Community Edition run the installer and when presented with this options dashboard ensure you select desktop developer M with C++ and the universal windows platform development click on install when the installation completes it will launch Visual Studio you can skip registration choose your theme let Visual Studio launch and afterwards close it as well as the installer when everything is complete visit the mic for Windows website and click here to download the setup program for Windows you can install make and you can accept all the defaults you need to find where you installed mic and find the mic executable the default location is program files x86 g132 bin copy this location we want to add this as a environment variable with mic successfully installed we need to add its path as a system system variable click on your search bar and look for system click on that then open the advanced system settings click and open the windows environment variables click on the path system variable and click on edit click on new and add the path that we just copied where mic is installed save your changes and close all the open Windows let's start conf figuring the environment for private GPT open a command prompt in admin mode now you want to run the following commands in a command prompt the first thing we want to do is upgrade pup go ahead and execute the following command python space- M spice pup spice install spice Das Das upgrade space pup go ahead execute this command and upgrade pip install pup X we need this to install poetry execute pup space install space pep X and now we can utilize pep X to install poetry execute the following command pep X space install space poetry you have to execute the following command to add the install to your PA execute pep X space Ure path and we can now close this command prompt window now open the Anaconda prompt and make sure you're running it in admin mode now let's create a cond environment for private GPT execute the following command cond space create space dasn space private GPT space your python version 3.11 activate your new environment execute cond space activate space private GPT and if your environment activated successfully it should show Private GPT in Brackets now we need to create a project folder for private GPT I'm going to change directory into the root of my drive now I'll use the make directory command to create a project folder in my case I'm going to call it pgbt now let's change directory into the project folder we just created we now ready to clim the project now now before you clone the repo again make sure the environment is activated that you're in the project folder you just created then go ahead and execute the following get clone command when cloning the repo get will create a new folder called private GPT enter that folder otherwise the following commands will fail visit the private GPT install documentation and go to the AMA section we want to copy this Alama install command and this will install and configure private GPT for full local Al llama support past this command in your anaconda prompt and that will pull away and install private GPT with the required Al llama support you have to complete the following steps in a new Anaconda Powershell prompt open and Anaconda Powershell prompt activate your private GPT environment again make sure you navigate back to your private GPT project folder execute the following command in your anaconda Powell terminal this will set the environment variable to AMA and once the environment variable is set go ahead and execute make run this will build private GPT and start it up with a Lama support and if everything went according to plan you should see private GPT launching and a web server running on your local machine now with private GPT started up open your browser navigate to 127.0.0.1 on Port 80001 and confirm that you can see this private GPT web page up and running now with private GPT up and running in the browser you can either click here to upload an ingest files on your local computer from there there you can use the query option to chat with your documents or you can use the search to search them before we start ingesting documents let's first make sure private GPT is working I'm going to click on the llm chatbot and I'm going to ask you to tell me why cyber security is important for a business in no more than 20 words and there you have it a short and concise answer on why cyber security is important straight out of the myal llm you should now have a working private GPT and fully integrated with a llama you can now ingest and chat with your documents or use the chatbot to your Arts content thank you so much for watching the video up to this point if you found any value in this video please remember to support the Channel with a like comment or subscribe and keep an eye on the channel for future AI videos

Channel: StuffAboutStuff

Views: 8,382

Keywords: PrivateGPT, Private GPT, PrivateGPT Ollama Support, Install PrivateGPT on Windows, how to configure privategpt windows, llm models privategpt, chat to your documents, latest privategpt 0.4.0, using privategpt, installing privategpt and ollama, ollama privategpt, ollama private gpt setup, privategpt tutorial, using ollama privategpt on windows, llm on windows privategpt, privategpt windows instructions, ai chat with documents

Id: Ww2oelybDz8

Length: 11min 24sec (684 seconds)

Published: Tue Apr 02 2024