Finally. Privacy Focused AI Use is Here!

this will begin a new series on AI we will focus not on the fear of AI but harnessing it offensively so we can use it on our terms with privacy and security so there will be a lot of teaching here and this will eventually be lots of Hands-On Tech on AI use but we will learn AI differently and safely we will also use AI to prove privacy and security Concepts so we can learn to defend ourselves there are actually two threats we need to be aware of with AI and these threats can be mitigated if we use Windows Mac OS iOS or Android we have the risk of having hidden AI work on our devices this is the big to-do with Windows recall for example that you've all heard so much about AI silently working in the background and dangerously sending our data to be processed in some big Tech server where this data can be surveilled and captured fortunately we can fix this by using Linux the second threat with AI is that when we communicate with a cloud AI controlled by someone else we are sending our private data to an external party and our data can be used to steal or surveil our ideas or even have our data used for future machine learning but something that many of you will not know about is that you can now run AI locally on your computer without internet so it is actually possible to run AI safely under your control I will demonstrate this later in this video using Linux and a local AI many of you are now alerted to the presence of new hardware on new computers which are perceived to be dangerous and these are the npus that are now on every computer but I will teach you today that the npu is something we can use as a start of a series this will be an introduction I have to explain some new Concepts so that the following videos will make sense and at the end I will do a very basic demo so you can get started with the learning understand our end goal though I will teach you in the next videos how to use this AI in our way some of this need not require high level Tech skills but I'll give you a mix if you're interested stay right [Music] there first let's start with a conceptual explanation of AI an AI is not something built from an accumulation of logic rules Tesla actually started with that it based some portion of itself driving on a rule-based model with black and white interpretations if you see this do this if you see that do this instead and so on then Tesla went full Ai and dropped the rules programming the result was a suddenly more effective self-driving software that can actually adapt to situations that it has never seen before AI is a new paradigm instead of programming an infinite set of rules to a computer an AI learns by itself using a technique called machine learning when an AI uses its learning to come up with a novel idea it is called generative and this is the first indication of real intelligence computers by nature don't understand words it sees binary numbers and can do extremely fast math but this capability can be used for AI because computers using math can discover patterns and do it on its own in the case of computer vision the colors in an image are captured as unique numerical values and in language understanding each word is assigned some numerical value based on a dictionary and its position in a sentence in the image example the AI computer is given millions of images of specific objects with a tag of what the object is and the computer will automatically develop a recognition of patterns that can be used to identify objects the interesting thing about how the AI understands is that the computer actually builds a neural array or Matrix of patterns and assigns weights to each input and there are layers and layers of these weights that are used to identify patterns in what the computer sees in the input exactly what those patterns are may actually be unknown to us just to give you an idea a small AI model could have three billion parameters with each of those parameters representing some pattern detected gp40 the well-known AI is thought to have 220 billion parameters and those parameters are what makes up the Matrix that is known as the neural network again it is really nothing but a matrix of Weights applied to learn patterns and this is what makes up an AI model the weights are not really human readable we would necessarily know how the AI looks at a problem and how it passes it through these billions of parameters to determine which weights then generates a final answer we can only teach the AI to develop its own patterns through machine learning and then query the AI to see if it learned it in most cases the pre-trained AI like open AI chat GPT meta llama 3 Google's Gemini and Tropics Claude or X AI Gro are given raw data from the Internet or from books and documents a lot of terabytes worth of content but no one is around to validate what the AI saw the information was not vetted so not everything that is fed to the AI is necessarily correct the only way to actually find out what the AI learned is to tweak it later with a technique called back propagation where humans have to see if the AI learned incorrectly they will query the AI and then train it to modify its response this is also the part where the AI is censored by its developers but outside of that risk of AI learning something that the humans are not aware of the AI can also be quite useful as it is large language models or llms which is the groundbreaking version of AI shown initially by chat GPT are capable of deep conversation with humans using intense knowledge especially of technical facts and computer program in it can even invent new content like poems images essays or programming code which is a demonstration of the ability called generative AI it is not just regurgitating stuff it learned but is able to create new Concepts based on something I learned before now let me introduce some other new terms to you an AI has two main functions when you teach the AI it is doing its first function which is the learning function or Ma machine learning ml as we've discussed machine learning is a very expensive process and requires lots of expensive computers with thousands of gpus so only a few big companies can do this the final model resulting from this is called a pre-trained model the second function of an AI is to use it query it this action of quering the AI is called the inference function and this is where we as end users will utilize it thus if you want to build a pre-trained AI like gp4 you will spend billions on computers but to use the AI with inference you just need a standard computer with lots of memory a GPU Graphics processing unit and maybe an npu neural processing unit to run it efficiently and on this you can run an existing pre-trained model the models that talk to you are called llms or large language models an example is chat GPT but chat GPT is a proprietary model you will learn later that some models have been open- sourced so that we can use it ourselves for inference there are also chat models called slms or small language models which can only be a gigabyte in size they're able to have conversations but possess less World Knowledge Apple will for example load an slm on a phone and I would guess that Microsoft co-pilot will do it as well on a computer there are other AI models like image recognition voice recognition or OCR models which are even smaller the actual AI is done by passing a query through a software called a Transformer and then the Transformer encodes your input into something the model can understand and then decodes the output for you this Transformer is the Key software that enables the use of llms you've heard for example of the term GPT used in AI which actually means generative pre-trained Transformer so now you've heard all these terms used now let me explain how an AI can be really useful to you even as a privacy conscious individual you can actually learn how to control an AI the new expected power of AI is when a business leverages an existing pre-trained AI by adding their smaller knowledge base to the AI you will learn terms like rag retrieval augmented generation which is how a Content store like a company's private database or even the internet can be used with the llms general pre-training and this can then result in a very focused AI for specialized purposes AI can also be modified even if pre-trained to respond differently including adding immediate functionality to Hardware equipped with AI functions for example a future Tesla robot could be taught to cook a particular way for you based on your particular tastes the concept of adding new small data modifications for learning to a pre-trained AI is called fine-tuning and this will be very common and does not use a lot of resources so the AI model you get is not a dead end of usefulness based on what is given by the developers of the model you can modify it especially if it is open source and then you can hook the AI to software that actually performs a function on your computer based on AI results and this functional piece is called an AI agent again understand these new terms Rag fine-tuning and agents and you will learn later on that this is not difficult to do our particular interest in the use of AI is to use it for inference meaning to query it and have its responses be useful so our sorts of models will be open source models and you will find out what these are first let's talk about what Hardware is needed for the AI to run smaller AI models do not need an npu or GPU to run now what exactly are these GPU and npu mod modules on these computers for npus are new and weren't around much before 2024 these chips are called accelerators they are designed for specific tasks that can free up the CPU they can do those specific tasks at a much faster rate with low power use for example an npu is nothing more than a chip that allows for array multiplication as I said earlier AI when used for inference is nothing more than doing Matrix math on large arrays a GPU can also do math on large arrays and that's why they're used in the learning phase but usually on a client computer the GPU is being used to display graphics so it's often busy doing that however if it is not doing that you can actually have the GPU do these Matrix math calculations an npu allows the operating system to offload The Matrix math to it it also is able to mult multitask by doing multiple Matrix maths simultaneously it is a lot more efficient than the CPU especially when doing math on very large arrays that are often found in AI models so that's what an npu is for Microsoft decided that it will put co-pilot features only on co-pilot plus PCS which it has designated as devices within CPU GPU and npu apple decided to load AI on Apple silicon Max and iPhones with a neural engine or bionic chip Google decided to load AI capabilities on phones with a tensor chip tensor by the way is another word for Matrix array so that's where that name came from the reason for these companies requiring certain Hardwares to make sure that the user experience is acceptable on their more intense large models however small AI models do not need anything other than a CPU because there's not as much math to do complex models however would consume too much power and that would be important on phones a computer can run multiple models small models that can reside in memory like image processing could be always on and always be available otherwise it's just about moving the active model in and out of memory if they're very large large models would render a device without a GPU npu and lots of memory unusable one thing we need to be clear on we cannot assume that there's only one AI model running it is likely that the OS would load multiple small AIS for common tasks plus multiple models could be run sequentially using something called Model chaining also you cannot assume that your computer even if older cannot run some smaller AI especially if it's a PC it is actually quite likely so don't assume that the lack of an npu or GPU makes you immune from an A AI spyware it may make you immune from a large AI running locally but it could still run small AI especially one specialized as a spyware feature now here's an important point you can pass input to the cloud and the cloud computer can do that math and return the AI result to you just like you can go to your browser and talk to chat GPT this is no different for your OS the OS can openly or secretly talk to an AI in the background in the cloud this is why we all need to have a plan move to switch our activities to a Linux OS at some point to eliminate all these risks I just described I will explain this journey in another video for now let's not force any new tasks this is just explain a direction in other words you can stick to your Windows and Mac OS but just start planning on having different future options so to summarize you could run an AI on a normal computer without some extr sort of Hardware but to do larger models that really have broad function like an llm you should have a more powerful computer the kind of computer I'm talking about is the typical ones used for video editing and gaming a fast computer with an Nvidia card and newer models that have an npu added now here's another factoid accessing an AI from a browser like using chat gbt or xai and chatting with it is fairly safe as far as using these for inference so in the absence of a new computer you can use cloud AI for learning it will be safe at least from remote controlling your computer particularly if you're running on Linux but be mindful of the Privacy danger of sending your thoughts in documents to outside servers so always understand that whatever you say to a cloud AI is always visible to somebody else now let me a quick demonstration to show you how to do safe AI work in later videos I will show more advanced applications of this and I will actually use the AI to help me demonstrate privacy Concepts to all of you hopefully this will up the game on explaining privacy issues and I can use the AI to show things and code things so we can do more than talk so we will be the first to use AI to build our knowledge of privacy and Security in a YouTube channel I've already discussed the kinds of computers that will allow this demo so just so you know my setup my OS for this is a would to and my computer is a laptop a Dell xps15 running an Intel i7 12 700h 2.3 GHz 14 cores with an Nvidia GeForce RTX 3050 it has 64 GB of memory which is actually quite excessive it worked in 16 GB of memory initially 32 GB would be good to run the local AI we need to go to. a site which I will show you here Alama by the way is open source and you can see the project code on GitHub AMA is just the enabler the actual AI comes from the suppliers of AI open- Source pre-trained models and I will show you a list here I personally tried many of these and they have different advantages depending on what you're trying to do the most popular model is llama 3 but don't be put off by the fact that this model was developed by meta meaning Zach I'll consider this the first time I've seen Zach do something really positive for Humanity by open- sourcing this model this is a sensored model by the way but in later videos you can learn to get around that now to install this is super simple choose your OS and then just download the installer on your computer on Windows for example there's file called all LL setup.exe that you install on Linux you just provide the script they provide and when you run it you will actually have nothing to set up this is both a plus and a minus but it gets you running immediately pretty much immediately after installation which is quick you can then use the AI so in this example I will use llama 3 and for this demo I will simply use use the terminal command line and you type this all llama run llama 3 if you're doing this for the first time it will download llama 3 which is a 4.7 gigabyte file so it will take a while you may want to turn off the VPN when doing this so it's not too slow in my case it's already downloaded and I actually have a dozen models loaded on my computer let me make something clear here as we use this the AI is completely on your computer when using it this way you can disconnect the internet and it will still work so I can easily run it now and all I have to do is on this prompt here I will demonstrate a couple of examples first I will talk to Elon Musk let me see if I got it set up right by the way I found that AI runs faster on Linux than on Windows [Music] [Music] okay now let me demonstrate a more sophisticated example which we will delve on deeper in a future video I'm going to let the AI model write code for me in Python programming language which will do screenshots of the screen every few seconds and save it to my folder like Windows recall this is just a teaser we will go through a lot of videos where I will now use the AI itself to explain Concepts but combined with a few more AI developed code I can demonstrate how Windows recall could be used in the description of this video I will give you a sample AI exchange which is in a PDF file where I asked basic privacy questions and I will show you how using something called prompt engineering I actually have the AI demonstrate that the dangers of privacy are more serious than it originally stated there will be fun times in this channel coming up so Please Subscribe now if you want to see this kind of content folks as I discussed in this video big Tech is inserting various AI models in your devices and it's getting more scary every day so fortunately the approaches I've taught in the past are even more valid these are the uses of the Google phones running aosb hiding our identities and email and phone numbers and running a VPN all these products are needed and all these are in products available on my store on bra may please join us on the Brax me platform you will find the various products in the store on that site and you can also join the over 100,000 people in the community who talk about privacy issues daily hope to see you there thank you for watching and see you again next time

Channel: Rob Braxman Tech

Views: 58,290

Keywords: internet privacy, tech privacy, privacy, de-googled phones, brax2 phone

Id: cQs55PZdl-s

Length: 23min 31sec (1411 seconds)

Published: Wed Jun 26 2024