AUTO-GPT Plugins (Email Plugin Setup & Demo)

hello and welcome back in this video I would like to have a look at plugins for otgpt so while preparing for another video on otgpt I stumbled across this folder here in the repo called plugins and I noticed that this plugins folder isn't available in the stable release of autogpt yet and also if we scroll down in the documentation we can also see there's a section called plugins as well and at the time of recording this plugins feature is not available in the stable release of Auto GPT yet but we can use it with the main branch and I'll show you how to do that so we can find out more about plugins by clicking on the plugin link and that will take us to this documentation for otgpt and Adidas plugins section we can find the link to the plugins repo so let's click on that and index plugins repo we can see a lot more information on what plugins are and how we can install them in our otgpt project so let's quickly talk about plugins and what they are otgpt out of the box provides quite a lot of advanced functionality like the ability to generate images access the web create agents Etc what plugins do is they allow for additional functionality to be made available to Auto GPT and it also allows developers to create custom plugins for otgpt so if we scroll down in the documentation we can see all the plugins that come standard with autogpt as an example there's a Twitter plugin that allows otgpt to access Tweets via the Twitter API there's also a plugin for email which allows otgpt to read write and respond to emails there's also a cmx plugin that allows otgpt to analyze images and create descriptions based on the image there's also a Bing search API there's also some third-party apis and I assume this is a growing list of plugins it's also possible to create custom plugins and you can have a look at this link to see the instruction on how to do that and basically it's a matter of copying this repo as a template and making your changes and then adding those changes to an archive so in this video we'll have a look at the existing plugins specifically we'll see how we can install plugins in our Auto GPT project and we'll also have a look at one of the existing plugins as an example and what we'll do is we'll have a look at the email plugin as an example and we'll try to get otgpt to do some research for us and we'll ask it to email the result to us instead of writing it to the console or to a local file as for the prerequisites you need otgpt installed on your system I've already created a video that goes in depth in how to install otgpt so please follow that video first and then come back to this one but as a quick recap the first thing we'll do is we'll copy otgpt to our local machine but there is one major difference in the setup process in the setup video I showed you how to install the stable release of Auto GPT but at the time of this recording plugins are not yet available in the stable release so we'll actually use the master Branch note that you will get some warnings when executing Auto GPT on the master Branch but I assume that plugins will be introduced into the stable version very soon after this video comes out right so what we'll do is we'll clone this repository by copying this link we will then create a folder on our PC in the address bar type in CMD this will open up the command prompt we will then type in git clone followed by the URL that we copied this will now create this folder on our machine we can then CD into this folder we can now install all the dependencies by typing pip install slash R requirements.txt we then need to rename our environment variable file so that's referring to this fall over here we just have to rename this to dot EnV then we need to open this file in a text editor you are more than welcome come to use notepad but for the reminder of this video I'll be using visual studio code just to make things a little bit more visible in the dot EnV file we can ignore most of these values but we do need to provide an open AI API key so we'll replace this with our API key we can get our API Key by going to platform.openai.com we could then click on personal add API Keys we can then generate a new key by clicking on create new secret key we can give our key a name and we then need to copy our secret key please ensure to use your own key as I will be deleting this key after I've recorded this video now back in our DOT EnV file we just have to replace the string with our key let's go ahead and test our Auto GPT instance by opening up the terminal I'll use the integrated terminal in vs code but if you prefer you can just use the command prompt as well in order to run auto GPT we need to type in Python Dash M followed by Auto GPD e and we can then press enter so after running otgpt you should see something similar to this and in the stable version of otgpt you are usually asked to provide a name for your Bot followed by the role and Then followed by the goals with the new version in the master Branch otgpt will try to generate a role the name and the goals on your behalf but just asking you this simple question I want otgpt too what you could do is if you manually want to capture that information you can just type in Double Dash and manual and now it will ask you for your ai's name I will call mine weather GPT and I I bought that provides information on the weather for goal one we'll ask you to look up the weather in New York and for goal 2 we'll just started to terminate once done Auto GPT will also ask us for our budget which is quite cool so we'll just leave that blank so it's saying it wants to Google the weather we'll just say yes now saying it wants to get the info information from AccuWeather we'll just say yes now it's saying it's got the weather and it wants to write it to a file we'll just say yes so it's saying the fall was written successfully so we should be able to see that fall by going to the auto GPD folder you can see a folder called Auto GPT workspace and within this folder we can see a file called New York weather and we get the text the current weather in New York is 9 degrees Celsius with Fair air quality and rain expected for at least 60 Minutes in the terminal we can also see that otgpt said it's completed its task and it wants to terminate we'll just say is and that's it so our instance of Auto GPT is working so let's go ahead and look at plugins so the plugin I want to have a look at in this specific example is the email plugin and what I'd like to do is have a look at how we can install the plugins for otgpt we'll also see how we can set up this email plugin and what I'd like to do is to get Auto GPT send an email from my Gmail account to another email address or maybe just to keep things simple I'll send an email from this Gmail address to the same address so let's see how we can do that first let's install otgpt plugins if we go back to the auto GPT folder we can see the plugins folder but it is empty and we just get this file saying put plugin Zips here so the first thing we need to do is to download and install the plugins into this folder if we look at the documentation we should be able to follow these instructions step one is to install autogpt which is something we just did then depending on your operating system we need to follow these installation instructions for Linux or Mac OS we need to execute this command because I'm using Windows I'll use this command instead so I'll copy this command then back in our project I'll paste in that command and press enter so after executing that command I can now see this ZIP file in the plugin folder let's go back to the setup instructions so for step 3 if you are using Linux or Mac OS you need to run this command so for Windows I'll copy this command I'll go back to the terminal and execute it after running this command I got this message saying all packages were installed and auto GPT was then executed automatically however this time it's asking us a few questions it's saying that the otgpt Bing search plugin was found but it's not in the allow list continue I'll just say no then it's saying that the GPT email plugin was found but it's not in the allow list do we want to load this or to say yes it's then saying it's picked up the scene X plugin we'll just say no the Twitter plugin I'll just say no as well so after doing that I'm getting a message saying that the email plugin was loaded but I'll actually not continue with this prompt and I'll press Ctrl C to exit out of otgpt I'll just say yes determine light so now that we've installed the files for the plugins we need to make a change to the dot EnV file if we go back to the setup instructions we can see the list of available plugins over here and next to each of these plugins there's a location link this provides additional setup information so firstly on this page we're getting a nice description of the email plugin and the screenshot of what it looks like we can also see some key features like the ability to read emails you can Auto compose and send emails you can create emails and automatically save them to the draft folder we can create emails with attachments we can even customize the email signature we can ask otgpt to monitor for emails and auto respond and we can integrate this email functionality into otgpt when dealing with more complex prompts so for the installation we've already created our DOT EnV file we've renamed the file and now what it's starting us is we need to add this section to the dot EnV file so I'll just go ahead and copy all of this and then I'll scroll down to the bottom of the dot EnV file and I'll just paste in that section we then need to provide the email address and password I will be doing this off screen but what you need to do is type in your email as an example test.test.com you need to provide an email password as well and the rest of these settings should be applicable to Gmail of course you can use any other SMTP email edges just make sure that you provide the correct information in these fields for the optional settings we can Mark emails as seen when otgpt reads them this is where we set the custom signature and we can also specify this attribute here which will save the emails in a draft folder and not same theme if we want the emails to be synced we simply need to comment out this line here by adding this hash value at the start for now I'll just leave this in and I'll populate these fields with my actual email address and password and just a little side note if you are using Gmail you typically need to authenticate the user via the oauth pop-up which is something that otgpt cannot do so in order to generate a password for auto GPT you can follow this instruction right here so it's signed up for Gmail we need to use an app password so all you have to do is open up this link so after clicking on that link you will receive a pop-up asking you to log into your account you then need to select the app in our case I'll just select other I'll give it a name like o3gpd and after clicking on generate you will receive a password in this yellow box you can just copy this password and then use that in your dot EnV file also if the dot EnV file so after saving the email details we also have to set this value for allow listed plugins if we go back to the setup instructions we see this example here but allow listed plugins is an array of plugins that we will allow Auto GPT to use in our project I will simply copy their example and then paste that into our DOT EnV file and let's go ahead and save this file everything should be working correctly so let's go ahead and run auto GPT by typing python or py for short Dash M Auto GPD and I'll run it in continuous mode this way we don't have to keep approving the prompts so it's asking us if we want to load the Bing search Plugin or just say no I'll do the same for scene X and I'll say no to the Twitter plugin as well it's asking us if we want to run the weather GPT app again but I'll just say no I want to Define my AI manually so I'll just type in dash dash manual the name of our AI will be Communicator GPT Communicator GPT is a communicator for the goals I'll say for goal one send an email to this email address and by the way I do not monitor this email address for any emails so please don't send emails to this address to reach out to me so let's continue with this whilst I send an email to this address and introduce yourself and then we'll say terminate once done let's press enter and let's see what it does so we can see this command here that says send email with arguments and it's hitting the two address with the subject line of introduction with the body of dear Leon my name is Communicator GPT and I am an llm Etc so apparently it's done sending the email and because of that it's terminated the session right so let's go back to Gmail we can see in the Gmail folder that we've got two emails sitting in the draft folder so there's two emails sitting here but the one is from atheist I did yesterday and we can see another email here this is the the email that was just created now and this is matching up with what we saw in the console so great otgpt is now able to send emails but at the moment the emails are simply going to the draws folder and not being sent for real so to fix that let's go back to the dot EnV file and at the bottom of the Fall we have this value here email droved might with folder so I'm actually going to comment out this line and save the file it's execute Auto GPT Again by running python M or to GPT dash dash continuous and while this is loading I'm actually going to delete these two files so back in the terminal we do not want to load these additional plugins I'll just say no for each of them so now it's asking us if we want to execute the same problems again I'll just say yes and let's see what happens all the GPT should send an email to this address from itself so it's running this command send email to this leonfonsell Dave Gmail address and it says that it's completed the task and therefore it's terminating the session if we go back to Gmail we can see this email in the inbox now and this email was sent from otgpt and we can see that email in the same folder as well okay let's try out a slightly more complex use guys so let's run auto GPT again for the plugins I'll just say no to each of these and let's create our new bot so I want to say I want gpt2 I'm actually just came to Define my bot manually for the name I'll call it research bot and AI that does research and emails the result for the goal I'll say go online and find two training topics on AI email the two topic ideas to Leon van sale Dev gmail.com and let's run this and after a few seconds we got this email back so let's see what otgpt sent us dear Leon hope this email finds you well I wanted to share with you two training topics on AI that I found through Google search the topics are one the five biggest artificial intelligence trains in 2023 and two the seven biggest artificial AI trains in 20 in 2022 well I suppose technically Auto GPT did exactly what I asked it to do and since it's completed its task it actually closed down the session as well if you have a look at the documentation on the email plugin it does show you how how to get otgpt to read your emails and reply back to them as well as how to send emails with attachments it's definitely worth having a look at the rest of the plugins as well but maybe we can do that in a future video I hope you found this video on otgpt plugins interesting and I think it's a very cool addition to the auto GPT ecosystem if you like this video please consider subscribing please like this video and I'll see you in the next one bye bye

Channel: Leon van Zyl

Views: 11,892

Keywords: auto gpt, auto gpt setup, auto gpt installation, auto gpt tutorial, auto gpt explained, openai api, chatgpt, autonomous ai, gpt 4, artificial intelligence, ai, gpt 3, gpt 4 demo, chat gpt explained, auto gpt howto, agi, auto gtp agi, open ai, open ai chat gpt, pinecone, auto gpt github, pinecode setup, gpt4, gpt-4, auto gpt4, auto gpt plugins, auto gpt plugins tutorial, auto gpt plugins setup

Id: urbI6K3kkT0

Length: 16min 53sec (1013 seconds)

Published: Sat Apr 29 2023