Direct Neural Interface & DARPA - Dr Justin Sanchez

[Applause] so I promise you nothing that I show you today is going to be an illusion so with that again my name is Justin Sanchez and I'm a neuro technologist by training and like was just said I was at my lab at the University of Miami and I got a call out of the blue at the other end of the phone there's a person says we need you to come immediately to Washington DC and come to DARPA and that's really where the whole story begins so what does DARPA DARPA is the high-tech research branch of the Pentagon and I'm currently the office director in the biological technologies office and like many of my other colleagues that are at DARPA my journey to the agency was an opportunity to expand the impact of the work that I was doing in neuro technology find new avenues that it could be applied and I was thinking very deeply about this problem I was thinking very deeply about the brain I've always been interested in the brain but not just from the medical sense I always wanted to use engineering apply it to the brain to deepen our understanding of the brain and then try to find new applications of what we could do with the brain so whether it's do the work that I did in the past or the work that I'm currently doing at DARPA the goal has always been the same develop new technologies that enable humans to use their brain to change the way that they interact with others and interact with the world and while I'm at DARPA we're thinking very deeply about national security but what I'm going to show you today is that a lot of the technologies that we're developing go well beyond national security and actually are going to challenge us as humans so DARPA got its beginnings in 1958 this is when we started pushing the envelope of things and that's when in our country we learned about Sputnik right the Soviet Union had Sputnik and leaders in our country were totally caught off guard by this and they said we could never be caught off guard ever again so the agency was formed with a singular mission breakthrough technologies and the agency takes risks where others like an industry or other parts of government are unwilling to take risks okay so we we set off on our mission and we're trying to make these breakthrough technologies now along the way we said okay if we understand very deeply the science and technology associated with these kinds of breakthroughs we not only can predict the surprises that may be anywhere in the world but we can also create a few surprises of our own now while we've been doing this over a vast number of years one of the things that did emerge from all of our work is it's not the technology alone that makes all the difference it's how the people of the world use the technology that we develop okay that's the fundamental game changer in all of this and a terrific example of all of that is the smart phone so all of you probably have one or maybe even two smart phones in your pocket and you may not know that a lot of the technology that's in the the smart phone has its roots in DARPA so her mission the internet GPS which enables us to find our phones or locate where those phones are the touchscreen that's on your phone that enables you to interact with it that was a DARPA of development the accelerometer that's in the phone that enables you to change the orientation of the screen as you rotate the phone Siri also a DARPA technology development and all of those aspects again while they had their roots and national security came together and the small device and it changes the way that we perceive our world in the way that we interact with our world okay now what I'm going to show you today is not the smartphone I'm going to show you a new way that we're developing technology to interact with the world for the future and that's really the technology of the brain now the brain is an amazing organ when it functions there are millions and millions of neurons that become active and they send signals not only to their neighbors but also to very different parts of the brain so to a person like me the brain is not a black box the brains not just as goop in between your ears it's a very intricate and elegant signaling of all of these neurons and how they evolved over time and what we've done at DARPA is developed the technology in order to sense these signals in real-time or even write signals in into the brain and today I'm going to show you a few examples of what that technology is and how it actually came to be now what's really important in all of this is that at DARPA when we think about the brain we think about the people we serve so make no mistake about it we're part of the Department of Defense that we serve military personnel now the part that really struck me so much when I came to DARPA was how hard a job these military personnel have to protect our freedoms protect our families and protect our way of life so again when we think about the brain we think about their job to control complex systems or learn complex tasks they're under unbelievable stress and then ultimately a lot of these people make the ultimate sacrifice and actually get injured and some of our most early programs at DARPA have been to develop neuro technology to restore those people back to their more whole self or their more natural self ok so direct think of direct interfaces to the brain to enable somebody to move again after they've been paralyzed in service of the country ok now what we've learned along the way in all of that is that those discoveries right those technologies are open the opening the door to a whole new set of possibilities for the future ok so how do we do all of this so this may be your first time hearing about a direct neural interface and in the middle of the screen up there it's actually an example of one of the types of neural interfaces that we're using in humans today so this is a sensor array it's about four by four millimeters and on this sensor array there are 96 sensors each one of the tips on that little array can detect between 1 and 3 neurons in your brain all right we have the technology in order to identify those neurons amplify their activity there's a miniscule signal is actually happening in your brain you can send those signals into a computer and that computer can interpret what all the signals actually mean when you're thinking about trying to do something and we can place these sensors anywhere in your brain or even in your peripheral nervous system right these are the nerves that are outside of your brain ok so while you may have thought of neuro technology as I've just described it as being something way in the future it's actually a technology exists today we're actually using it with humans now how did we get here okay so again I'm telling you about something that you may not be familiar with but we actually have a history of working in neuro technology and it turns out that in the early 2000s neuroscientists like myself didn't even know if it was possible to read out let's say hundred neurons of activity in real time from an awake behaving individual so we started in animal subjects we said okay let's try these sensors out can we read out the signals in real time and can we do something simple like control a robotic arm and we showed that we could actually do that just having the animal think about it and once we proved out that technology in 2005 we said okay we're ready to go to humans can we place the same technology in the human brain and restore the ability to move and even since after you've been injured and I'm going to show you a couple examples of this yes we could do that and we said okay again this is DARPA we try to push the limits of what's possible we said okay if we can do that for movement and sensation can we try to do something even more complex so we went to memory in the human and said ok for humans with traumatic brain injury could restore their ability to form and recall memories again direct brain interface now here's one thing that may blow your mind the kind of questions that we have to go after here are answering things like what is a memory in your brain right have you ever thought about what a memory is what those intricate neural firing patterns actually are and how you need to interact with them to in order to facilitate memory formation and recall that's the scale of the problem that we're actually working on at DARPA again being DARPA we don't just stop there we keep moving forward in our trajectory actually started a new program in 2013 called subnets thinking about the sub networks of the brain but for the most challenging problem of neuropsychiatry and that's you know mental states right think about depression anxiety think about trying to develop a direct neural interface to help people with their depression anxiety again the same questions are there what actually is a depression in the brain what are the neurons that are involved in anxiety those are the kinds of things that were ultimately going after okay so we have a very long trajectory here right over a decade of work in this space and what I'm going to do next I'm going to show you some examples of the achievements that we are able to do today and then paint a picture for you for what the future of neuro technology may ultimately hold for us okay so the first person I want to introduce you to is Nathan he's the one on the right side of the screen and Nathan is living with paralysis he was paralyzed in 2004 an automobile accident and Nathan is actually a fresh freshman in college he was studying nanotechnology when he heard about some of our studies that I want to be a pioneer in that so he signed up to do one of our studies and Nathan had that same array right that 4x4 millimeter array placed in his motor cortex right the part that is involved in movement he had another set of arrays placed in his sensory cortex okay and you can actually see on the upper right side of the screen there there's a little plug that's coming out of his head that's where those are arrays are connected to and the wires send the signals from his brain actually to that bank of a rack of computers in the middle of the screen process all of his neural activity in real time and actually send that activity to that robotic arm we also developed the robotic arm and he met President Obama was able to think about moving the robotic arm and shake shook the the president's hand okay now the other part of this story is that that robotic arm also had sensors in the fingertips so when the president placed his hand on the robotic hand the force transducers took that information and did the reverse went back through the computers went back through the wire back into Nathan's head and he could actually feel the president's hand on the robotic hand it was truly a remarkable moment okay so that's what Nathan can do let me show you a video of something else that Nathan can do so this is Nathan taking these cones and he's kind of building the structure he's doing all of this just by thinking about you can see he's not moving his own arm because producing the neural signals directly from his brain and stacking those cones right cos if right your paralyzed person being able to interact with the world in this way it can really be transformative for you right you have a new way to project yourself onto the world alright so Nathan you know it was astounded by this moment it's life-changing for him but we asked him Nathan what else do you want to do and he's a gamer and he said I want to fly an aircraft so I said ok we can help you to fly an aircraft so the next thing we did is we connected him to a f-35 Joint Strike Fighter and put him out over Las Vegas and we basically remapped his neural activity onto any control service that we ultimately wanted to on that that Joint Strike Fighter again put yourself in the place of Nathan think about how you're locked in this wheelchair and then think about your ability to actually control this aircraft change your perspective of the world and see it in a very different way and I think that he sees Las Vegas in a very different way now that he's able to fly over and Nathan's started having a lot of fun with this and you know at the very end of this run is like I'm just going to do a barrel roll here and you did a barrel roll in the aircraft and it just kind of shows you the creativity that a person like Nathan with a direct neural interface what they can ultimately do so that's what we can do today what does the future look like with these kinds of technologies ok so think about building with your brain think about changing your perspective of the world by flying over a city with the brain so in this vignette this person is an architect is paralyzed lost control of his arms he needs a new way to communicate his idea so through his direct neural interface he can connect to his drafting software position buildings anywhere he likes the details of the building maybe he can even connect to a collaborator out in the field to get a different perspective on the building ok and imagine in future building a skyscraper just with your brain just with the perspective of your brain it could be transformative all right so that's Nathan the next example I'd like to show you is a person his name is Doug okay and Doug was injured 25 years ago in a near-fatal electrical accident and Doug's very different than Nathan and the sense that she has no hand on both of his arms he lost both of his hands imagine living your life that way but for Doug we also explored the possibility of a direct neural interface for him so in this particular case it took that same since their array but instead of placing it in the brain we place it into the nerves of his forearm you can actually see on the right side of the screen there that his residual limb and that's where that sensor array is now what's different in this picture is that we connected his peripheral nervous system to that 3d virtual environment that's in the center of the screen and there's a virtual hand there and it's going to be touching a virtual door and whenever the virtual hand touches the virtual door signals are sent back into that electrode array into his nerves and this is what Doug can actually do with that interface I gotta you're still done for yes can you feel the fingers sliding when you do that yes actually it is before right get imagine working in that 3d world just through your nervous system it really is amazing so when we see something like this we say can we change the future can we change the way that we even play right so imagine in the future you get a direct neural interface and that direct neural interface gets you off your couch in a virtual way enables you to explore virtual worlds just through your direct neural interface and you know we've got game controllers and cameras to do this not that it's nowhere near the kinds of things that I'm talking about here again exploring your cognitive space in this virtual world could be transformative what if you could even connect to your friends all across the globe through your direct neural interface and kind of explore what that would actually be okay so what we're doing today would Doug is just the beginning of what we think it's possible in the future okay so the last example that I like to give for you today is in something much more difficult it's in that area of memory okay remember memories is a very tough concept in this particular case there's a person that's volunteered for our studies this person is living with intractable epilepsy have seizures that are uncontrollable and part of their therapy is that they come to the clinic and they have sensors placed in and on their brain in order to try to map out where this problem is occurring and it turns out that some of the places where those sensors are located or in the memory structures of the brain and we ran a test where we asked the question could we develop a direct neural interface stimulate the brain in order to facilitate memory formation and recall this for declarative memories memories about facts so this is how it goes in this particular example the person has to recall 12 words we know how hard it is to do something as mundane is that right think of phone numbers and things like that in this case we do it with brain stimulation and without brain stimulation we're going to sense its cognitive state and when we detect that memory is low we stimulate the brain in order to facilitate its ability to do it so the first example is without stimulation let's see how good he actually does won't work no simulation got these three of them and we've all experienced this you know he does the old facepalm and if there's a rest of them right so now we're going to do it with direct brain stimulation Paul claims don't worry no kidding at all of them [Music] establish a breakthrough moment for us he said had a good picture in my head I could just see it was the moment we knew that we were having an effect on his memory circuit okay so transformative moment for all of us that were involved so what does the future look like well imagine as you're getting older you have a more powerful form of this kind of neural interface and you're feeling maybe a little nostalgic and you want to record some of your memories maybe there's a possibility of using a direct neural interface to actually do that and maybe use that neural interface to record the moment you went on a first date maybe the first time you proposed or even the birth of your child and then if you even had the ability to share those sets of memories with your friends and family it could be transformative for how we ultimately live our lives so recall back to the examples I gave you with GPS and the internet and Siri does all came out of Department of Defense kinds of technologies but they ultimately came together in a way that changed Society and we think that in the future that neuro technologies like the ones I just showed you are going to be picked up by commercial entities right they're going to use neuro technologies in the future and you know at DARPA we create these breakthrough technologies in order to change the future and change the world that's what we do that's our mission whether it's for a person to try to command and control a complex system or it's a person that has extraordinary injuries and we brought them back to a more normal quality of life we know that these technologies are extremely powerful and we also know that they can be used for good or for ill and without a doubt these kinds of technologies are going to introduce new societal questions that we're all going to have to address and you know just a few to consider will neural enhancement be considered a personal choice like laser eye surgery or even braces will there be a huge disconnect between the neural enhanced haves and the have-nots in the future will neural enhancement or some form of neural enhancement be considered a right instead of a personal choice these are just some of the questions that we have to think about and they're not just questions for the tech Nalla gist here their questions for all of us so how the future of this very powerful technology unfolds really depends upon all of you and as we shape that future and we really make choices associated with that future it's the choices that we make that will define us as individuals and it will really reveal who we are as a society so as I've shared with you today the brain is an extraordinary organ it has the potential to completely change the way that we interact with technology so whether it's building with your mind right thinking of a new perspective of the world with your mind changing the way that you play and interact with your friends right or even finding new ways of recording and sharing your memories these are all the possibilities of the future and it's DARPA push into these very difficult areas which is making all of this possible and that really sets up the last question for the discussion today is what will you accomplish with your brain in the future thank you so much [Applause] [Music] Oh [Music]

Channel: Thinking Digital Conference

Views: 55,558

Keywords: darpa, neural science, neural technology, direct brain inteface, brain machine interface, HAPTIX, Restoring Active Memory, robotic prosthetics, brain implants, brain chip implants, human machine, human machine interface, neurotechnologies, brain implant surgery, brain implants technology, brain implants neuralink, New “Neural Dust” sensor could be implanted, How DARPA is creating the impossible, brain computer interface, How to Control Things Using Your Brain, Justin Sanchez

Id: nvUHDK59Igw

Length: 20min 51sec (1251 seconds)

Published: Mon Jun 26 2017