How To Install Any LLM Locally! Open WebUI (Ollama) - SUPER EASY!

[Music] many of us don't really know how to install large language models or AI models locally you've seen LM Studios text generation web UI but today I'd like to Showcase a newly updated UI called open web UI or previously known as web UI o llama open web UI is an extendable userfriendly self-hosted web UI and it's designed to operate entirely offline and 100% secure it supports various large Nish model Runners including olama and open AI compatible apis now throughout today's video we're going to be showcasing how you can install it locally and showcase what you can actually do with it so with that thought guys stay tuned and let's get straight into the video so let's just get started so you can actually install this using Docker which is an easy way to install it but there's also another easy way which is US utilizing Pinocchio this is a tool that lets you install almost any AI model easily and locally on your computer you just need to install their Pinocchio application which lets you install all these other apps throughout its app you can install AI Town L chat and so many other models you can even install web UI stable diffusion models and such forth so with that thought guys just go over to the Pinocchio website which I'll leave a link to in the description below click on this download button it'll take you to the docs you can choose whatever operating system you want to utilize so if you have a Windows make sure you install Pinocchio for Windows if you have a Mac you make sure you install from Mac and just follow through with installation now just to Showcase how you install from Windows just click on the download button over here it will then download a zip file you just need to unzip it then you need to just click on the install file and it will then prompt up a Windows protected PC but they state that this message shows up because the app was downloaded from the web and this shows up for Windows apps or Windows does this for apps downloaded from the web so you just need to click on more information run anyway and once that is done you can then open up Pinocchio it is easy as that guys and once that is done you're basically halfway there you will then be prompted up to this screen over here you just need to Simply click on visit discover page once that is done we need to head over to open web UI you can just simply search it up but you can even paste the get URL to easily install it in this case we're just going to open up open web UI we're going to click on download we're going to click you can name it as whatever you want or save it as whatever you want but in this case we're just going to save it as the base default name and it's going to start installing it all by itself automatically and autonomously we don't need to intervene we just need to let the application install it by itself so once it finishes installing I'll be right back and there we go we have it over here on our dashboard where we can see open web UI fully installed it's currently showing not running because we don't have it open up but see if we want to we can just simply click on it and we can then install it and once this is done we can then have it so that it can install these various components such as get zip you have cond I registry as well as Cuda so you can just simply click on install it's going to take a bit longer to do this so once it's finished I'll be right back and there we go we have it installed it'll pop up this window which says install complete you can then click okay and then proceed to start it up so I actually had to install a couple other packages afterwards so once that was actually completed I had to just go back to the homepage go click on the open web UI app that we just installed and then you can see that you can start up by clicking this button over here now once this is done it'll start on focusing on starting it up but looks like we're going to need to launch AMA before proceeding so we need to install AMA once that is done we can then have it running so I'm going to install it for my windows OS so I'm going to quickly install this and get right back to you sorry for being repetitive but this month we had insane Partnerships with big companies giving out subscriptions to AI tools completely for free these are tools that will streamline your business's growth and improve your efficiency just being a patreon this past month you were given access to six paid subscriptions completely for free not only do you access these subscriptions but you gain the ability for Consulting networking collaborating with the community as well as with myself you get access to daily AI news resources giveaways and so much more if you're interested check out the patreon link in the description below to gain access to these benefits so once you have installed the install file for AMA you just need to open it up there will be an install button you just simply click on it and we can see it's going to start extracting the files from it and install the AMA model onto our computer so once this is done we can then head over back to Pinocchio and this is where we can just simply click on next and start this up quite easily so now that we have Ama installed you can just simply click on next and it's going to start up open web UI it should take a couple of seconds since it's is our first time starting it up but then we're going to be able to have it fully hosted on our Local Host so it's going to prompt when it's ready to be opened up on your local host and there we go it gave us the URL for our open web UI which is our local host over here and we can then start chatting with it so you're going to need to actually sign in with open web UI but if you do not have an account you can just simply click on sign up and there we go we can start playing around with the web UI and you can head over to the modif files where you can upload your own model files you can add different prompt templates or even documents so that you can even chat with it now if you click on this bottom left profile tab you can see that there's a settings tab you can have your chats archived you can play around with different chat Bots and you can head over to the admin panel where you can even have it connected to a Cloud Server so other people can integrate or interact with your server or basically your server files that you have uploaded so this way whatever chats or whatever documents you have locally installed are uploaded to a private server so other people can actually access it and chat privately this could be used for companies or people who want to actually interact with whatever files you're working with but let's head back over to the new chat and we're going to be playing around by adding another model so you can see on the right hand side there's a setting tabs and you can head over to the models tab it's going to take a couple seconds to load this up but we're going to be able to see that you can import different models from olama and to do this you just need to head over to the AMA website which I'll leave a link to in the description below head over to the library or you can click on models Tab and you can see that there's various models that you can integrate into this so you can input code Gemma you can have llama models lava models quen models dolphin models as well as many other models that are uploaded and compatible with AMA so in this case if you would want to install something like five which is the latest uh Microsoft model but the under the five family I think this is f 2 at the moment but you can actually copy the link from this you can head over back to web UI and you can import that model and you can see that you can even delete a model that you don't want to work with you can manage LM light LM models and you can even experiment with other models such as uploading your own ggf model so this gives you a lot of flexibility and it allows you to do various different things now the amazing thing with open web UI is that they have Associated their application with so many amaz amazing features you have access to ggf models you have local rag integration where you're going to be able to utilize the rag framework or sorry algorithm which is going to support within the chat experience that you have and you're going to be able to integrate various other files that you can use rag to interact with document you have code syntax highlights where it's going to be able to focus on enhanced code re readability you have full markdown support you also have voice input support as well as fine-tune control and Advanced parameters there's so many different things to this and there's various things that I truly recommend that you read through within their GitHub refill cuz it showcases different sorts of avenues as to what you can do with it and that basically concludes today's video on open web youi this is a great way for you to host various large language models locally on your computer 100% secure and private so if you enjoyed this video make sure you like it make sure you turn on notification Bell and if you haven't already make sure you check out the patreon page cuz this is a great way for you to access different subscriptions completely for free make sure you take a look at the Twitter page this is a great way for you to stay up to date with the latest AI news and lastly make sure you guys subscribe turn on notification Bell like this video and check out our previous videos so you can stay up to date with latest AI news but with that thought guys thank you guys so much for watching have an amazing day spread positivity and I'll see you guys fairly shortly peace out fellas

Channel: WorldofAI

Views: 18,534

Keywords: local llm, artificial intelligence, chat gpt, ollama, how to install any llm locally, how to install llms, open webui, how to install ollama, web, ui, ollama web ui, web ui, ollama web, llm, local, llm local, large, ai, open-source, installation guide, model selection, openai, private computing, offline ai, ai models, software setup, ai integration, model comparison, chat export, chat import, api integration, user interface, local hosting, ollama webui, ollama webui docker

Id: VbfHAHCAYT4

Length: 8min 52sec (532 seconds)

Published: Sat May 04 2024