OBSIDIAN LOCAL AI TEXT GENERATOR OFFLINE AND PRIVATE

I was thinking about gatekeeping this but I found a way to generate text in your obsidian with AI now this doesn't require you to connect to chat GPT or anything you can easily implement this onto your computer and it'll cost you less than lunch let me show you how so the first step you want to do is go to LM studio. and in there there's going to be three downloads you're going to make sure that you download for your computer you're operating software so if you have Windows download Windows if you have mac download Mac if you have Linux then download for Linux simple as that this is the first thing that pops up so if you have a really small computer you can run tiny llama 1 billion if you have a moderately small computer you can run five 2 billion now if you have a decent computer you can run mistol 7 billion or open chat 7 billion now if you have a really decent computer you can run the 13 billion model even though those take up around like 8 GB of vram my two models have downloaded now to run a server you want to go ahead and click on this little tab here called local server you want to go to the very top select the local model um I'm going to go with F2 just for now so over here on the left side we have the port number here 123 4 we're just going to leave it alone and just start the server now you may get a popup like this it's fine allow access uh nothing's going to happen trust me you get the local base URL to This Server here so we want to go ahead and copy this so I already did that and we go over here to obsidian and go ahead and open up the text generator and back into here there we go so we have obsidian here hit contrl J and it should work and there you go that's how it works so an obsidian after you've entered your API endpoint um you want to go ahead and write down how to take over the world and the generation will literally help you so yeah there you go

Channel: Xavier

Views: 89

Keywords: text generation, LM Studio, open ai key, local code completion, local auto completion, local llm, llm code completion, ai code completion, obsidian plugin, open ai obsidian plugin, obsidian, open source, best obsidian plugin, obsidian community plugins, obsidian community plugin, obsidian offline and private plugin

Id: A1xV-hcrMb8

Length: 2min 16sec (136 seconds)

Published: Mon Jan 15 2024