I automated my internet research tasks with a network of three agents

today I will show you all my small application which runs a network of Agents which are using large language models to perform some research in the internet so here we have my graphic card and here we will see all those opensource large language models I have hosted on my PC so everything is running on Prem so I'm able to select those models here to perform my tasks for rewriting some text so first of all I have to write down what my three agents have to do for me so that's the um task they have to perform and yeah so I'm interested in the um last um Flight of the um Starship so let us write the task down here so what I'm interested in some information about that and flight from M spasic all right that looks good so here are the general tasks so they are describing what the task is so I have a task for the researcher agent I have a task for the aor writer agent and I have a task for the business Angel so all those tasks are described in a way that they are about startups who are active in generative Ai and for the finance industry so as well the Alor is interested in such um Technologies and startups and as well the business Angel wants to invest in startups active in the finance sector using generative AI so I have to rewrite that that three tasks so yeah here are the um agents so that's research with its rule goal and backstory so here he's a senior research analyst we have the business Angel and here you see the same setup rule goal and backstory of that um agent and we have the auor who is writing the um text or the blog Post article at the end so as you see here as well I have that drop- down menu where I'm able to select those open source models so mistal is working very good open hamis is good for the Duck Duck Go search so let start I would guess so yeah we use that open hamus model here we see the usage of the GPU and now press start generation so first of all the task will be Rewritten for the Alor for the researcher and for the business Angel so that looks not so good for the researcher so they had failed to rewrite um the tasks but for the aor and for the business Angel it's all about space X and the Flight of the Starship so on the right side in the terminal window we see the usage of the GPU and here on the left side we see the agent Network working so it's performing and the research tasks via the Duck Duck Go search and yeah that takes a little bit time so we have to wait for that but at the end it's quite fast faster um than when I would have done it by my own and here we go so that's the um short text introduction background key moments of that flight so looks looks really really cool and as well a conclusion so yeah I like it so that will save me a lot of time so let's try again again because that um description of the research was not so good was all about AI startups in the finance sector so just press generation once again and hopefully now the task will be ritten no ah here we go so there is something regarding Starship and Space X so yeah maybe my conversational application in the background need some tweaking at that point but overall it it looks looks really really um good what results are produced so hopefully now you will get as well a nice story about the um third flight I guess third Flight of the um Starship so here we see it's running and here we go yeah well the date the date was not correct but over all it's a nice text so it's not perfect not perfect maybe the ground truth is not so good here so I have maybe think about my my prompt rewriting that it does not create um things um which are not not true so yeah that's that's something I have to to look into it so let's check how gron are reshaping the aviation industry and in case of of human Transportation so hopefully now the three tasks will be Rewritten in a proper way that we could could use them for for that um analysis so check that for human trans yeah that looks good for the research for the a as well M mation for the business Angel it looks all that is going in the good direction but not really in investing money so you will see here we see the um Network working so it's performing those um search queries and V Dr go search and collecting the the information and and working working with that and the g the graphic card is running around about 90% here we had a short switch um I think between between those large language models so maybe the the auto was crafting the um final final text how grown Lo are reshaping the aviation industry and yeah I think I think if you're a student at school high school or whatever could could save you a little bit little bit time when you have to to um prepare a speech or what to do an analysis and here we have a short conclusion on the topic as well yeah so let us try something else not sure what we could could search for maybe something about the weather weather yeah weather forecast for this year for that summer North America Detroit so that would be would be nice if you could get some information on that not sure how good how good the um search will will perform on that Detroit region with the big lakes that sounds interesting so here we go first of all we have to rewrite our task descriptions so weather forecast summer this year North America drro region that that looks good and what there a business angel doing nothing regarding Investments so that's that's not perfect but well well that's how it's going so some code updates and treaking is necessary here so but but overall I'm I'm really happy with um cre as a framework which I'm using here with AMA as the M hosting um um service server for my open source large language model so I really really like that that setup it's working working quite quite well and it's easy to to maintain and to update so yeah looking forward um to use those techniques for um new and and updated um applications in the field of conversational AI thank you very much for watching my video see you

Channel: Ingmar Stapel

Views: 2,253

Keywords:

Id: Xdr4rNzUwGM

Length: 10min 9sec (609 seconds)

Published: Sun Mar 17 2024