DeepMind StarCraft II Demonstration

welcome to the deep mine headquarters in London deep mind is a world leader in artificial intelligence they're widely known for their alphago and alpha zero a eyes and applying their breakthroughs to scientific and medical problems similarly to how deep mind has developed a eyes for go and chess they are now working on an AI for Starcraft 2 Starcraft 2 is a real-time strategy game for the computer in StarCraft you choose one of three unique unique races build an economy to advance your technology and gather units and try to outwit your opponent it takes a great deal of speed dexterity and strategic planning if that sounds confusing don't worry I'll be walking you through the games will show here today let me introduce myself I am dancin Koski better known as artosis I've been playing Starcraft for 20 years now and I'm a former pro gamer in StarCraft 1 and Starcraft 2 and for the last 10 years I have lived and commentated in Seoul South Korea analyzing the best players of the world alongside me rotterdam kevin van der coy radhiya why don't you introduce yourself alright well first of all it's really awesome to be here together with you then we were both I think incredibly excited to see how this evening unfolds but as you said I'm kind of on the koi I am a former professional Walker 3 player but for the last nine years I've literally only played one game that game is stalker to I have mostly focused on commentating starcraft2 though in these nine years I have I think casted over a hundred live professional stalkers to tournaments that's obviously awesome but I still love playing the game as well and actually recently for the very first time broke into the top 50 of Europe so this old man danced about it I know we have been in this genre for a very long time we love our RTS games so we're very excited about today and today we're gonna be joined by a variety of guests they're gonna help us to understand what deep mind is doing here with Starcraft 2 and we're going to actually be analyzing some replays of the deep mine agent actually playing Starcraft 2 games now Roddy and I will be seeing those games for the very first time so if we don't have any idea what's going to happen we're gonna learn alongside you and of course if you're new to Starcraft we'll hold your hand through it and try to make you understand as best as we can so without further ado I want to invite our first two guests up and talk about them a little bit we have Tim Morin the lead producer of starcraft 2 from blizzard and Oriole venules he is the co-lead of the Starcraft team at deepmind guys how are you doing I'm super excited and pumped to be here likewise yeah I'm really excited to see what happens yeah this is like the most excited I have personally ever been for event rowdy as you said you've done over a hundred events I'm right up there as well it's I mean this is just so exciting that deep mind is doing all this but Tim I want to start with some questions for you why is Blizzard so kind of excited and eager to work with deepmind well I believe Starcraft 2 is the highest skill competitive game out there bar none and Starcraft 2 being used as a benchmark for machine learning research really validates that sense of StarCraft twos importance in the pantheon of eSports and what exactly is the role of Blizzard here in this partnership blizzard and the Starcraft 2 team has worked really hard to create a special version of Starcraft 2 we've actually released to the public some tools in this version of Starcraft 2 but also worked very closely with the team at deepmind it's not exactly the same version of Starcraft 2 that players get at home it's got the same rules but it is geared towards AI research and there's some very important differences I should mention that because we've geared it for research it really isn't set up to do things like live observing so the games that we're gonna watch today will be from replays and you know watching live games we have to watch from the player perspective okay and oriole to jump over to you why does deep mind look at StarCraft as the next game the next thing that you want to kind of pursue and make an AI for right so well first and foremost the mission at deep mine is to build an artificial general intelligence and to do so it is quite important to benchmark how our algorithms or our agents as we call them on a wide variety of tasks so these tasks there's quite a few of them that we've tackled in the past atari being perhaps the first video games that we kind of started from as well as go chairs and many other games and then for us starcraft afforded some pretty unique sort of research challenges that we're for ask kind of the obvious choice as a kind of a next step for our agents to perform at a very good level and the one perhaps that i would highlight from from this graph we're seeing is the fact that in starcraft you don't see the board all the time there's this notion of imperfect information as you probably know yeah so so that means that an agent must kind of predict estimate what the other player is doing all the time and there's all sorts of interesting things that emerge and perhaps the other obvious one as opposed to perhaps go is like the fact that it's real time so you really must act now otherwise you might lose the game so those are a few of the highlights of why stock IV such an interesting research challenge for us well you guys announced this this project a little over two years ago so can you fill us in on what's been happening in that time yeah for sure so actually Starcraft is definitely not you know we're not the first ones to realize the importance of these as our domain for Nai and in this timeline we kind of see that the history actually stretches for over you know 15 years or so I in fact it was in 2003 that it was first sort of advocated that RTS games could be actually used to push the boundaries of AI and then perhaps another kind of key moment was back in 2009 where they someone like the community the open-source community has been incredible so they open source a tool for you to connect to Starcraft 1 the first version of Starcraft and ever since then there's been quite a few of activity in terms of AI versus AI tournaments and there's been quite a few of them going on for like even like you know the last eight years or so we're kind of people have built BOTS or agents to play the game and perform well and you know that's we an incredible exciting place to be in fact I used to you know I participated in the very first you know version there like the 2010 competition and I actually tested the agents so I was asked to be the professional gamer to play against them so that was kind of a fun enough throwback and then we really kind of after sort of mastering go in particular we approached blizzard and we decided to try to open-source first and foremost like Starcraft 2 so we kind of opened the tools for the for everyone to use there's been a quite an incredible take on that as well there's now competitions also on Starcraft 2 and then later like actually a few months ago at Blizzcon I sort of announced perhaps what the first version of our age and alpha star is I showed sort of the first few steps the agent took into playing the full game of Starcraft and I must say as a last kind of remark that this was and an incredible achievement not of course done by myself alone this is just really the tip of the iceberg there's been an incredible effort from the team I wish you know everyone could be here in the stage sadly there's not enough space but really really incredible effort here at deepmind to build alpha star alright it sounds all awesome well what can you tell us what are we going to see today right so in terms of what the games are going to be like there's a few match conditions that you know are useful to go over so the first is the map we are playing on just one map called catalyst that you know used to be in the latter so it's just a full map the game version we're playing is slightly old is the four point six point two I believe that's the one that was played at Blizzcon for the finals back in November that's correct and then perhaps the last not least detail is we are playing Protoss vs. Protoss matchup and then a couple of details perhaps is that the agent plays under limited actions per minute it doesn't click you know insanely fast we have more details on that later but I think people probably are more excited to excited to see the games first and we also played sort of a series of five games against you know people professional gamers that we will announce in a second all right well I I mean I'm pretty excited to see this alpha star going up against a pro-gamer why don't we go ahead and talk who is the first pro gamer that we're gonna be seeing here today so the pro gamer I mean obviously we tested the age and in house against you know our own like players that did mine I am not that good but there's actually someone who is no reasonably good and then sort of we decided ok the agent might be ready to face a slightly you know bigger challenge and we talked to blizzard about you know can you recommend someone to play against someone who knows the game and so on and so forth and they recommended us to contact liquid TLO so that's kind of the that was very exciting for me because I used to watch his stream actually and that's what we did yeah a very popular player indeed let's go ahead and learn a little bit more about TLO that was a really good play by TL oh so all of these immortals have come there's fraud Oh from steamrolling over everything on the ground liquid the little one or as we call em TLO is an absolute veteran in the stock of to community he's been around since pretty much day one since the day that stock of two came out he actually started off as a random player had quite some successes around the player as well then switched the terran for a while but over the last few years he's mostly known for his zerk and of course his incredibly creative playstyle that's what makes him truly stand out indeed he is really kind of a legend within the scene so TLO welcome up to the desk here first I just really want to hear what was this journey like for you how did you how did you end up here at deep mind first of all thank you for having me and it started with an email I saw in my inbox from Tim who was introducing me to the deep mind team by email and telling me that my feedback would be of interest to the project they're working on at that point I know very little because obviously there's a lot of secrecy behind this project but after very little time I find myself on a plane to London and in this very building that we're in right now and discussing the oriole different things about what would be fair for the match their planning that's actually Tim what made you think oh you know what the guy that you need is TLO well at that point in time we were looking for somebody who was fairly close and who we felt would provide really good analysis and good feedback that the research team could use to help advance their work but the real as we mentioned previously we're gonna be watching some PvP games today now it's been a little while since you played Protoss Ohio how are those proto skills these days well I specifically prepared for the for the match playing Pradas I played about a hundred games of pros prior to the matches I play it and you know it's not a pro level but it would probably still be in the top one percentile of all players on the planet so it's decent she's not professional okay okay and what kind of like mindset did you have coming into this what types of expectations you know you're asked to play maybe not your main or but you're still a professional gamer what were you thinking coming into this match I saw the video at Blizzcon the showing of what the agent can do or at least giving a little bit of a glimpse and I was extremely confident from seeing that because it wasn't much there wasn't much time between Plissken on the matches I played all right and what about deep mind did you guys have an opinion on how this would go was it just kind of a shot in the dark can you tell a little bit about that yeah so I mean obviously for us it was very exciting just to get someone of his skill level even though he was obviously playing he's off race and just seeing him sit down and just getting ready and seeing like kind of amazing skills when you know this when you see these professional gamers to play first they really play very quickly so so that was extremely exciting I was super like unsure what would happen I definitely knew we would probably see some interesting games but you know my confidence was not great I must say okay and Tim how about you what were you thinking when you hear okay Tilo is going to be playing Protoss he's a third player normally what do you know about it what were you thinking well to me the question in my mind was is this AI agent going to be at an extreme is it going to be extremely cheesy is it going to be extremely turtley is it gonna play completely unlike a human being I had no idea all right well I we're about to get into the first replay I know that that's what everyone wants to see and Tim we're gonna be saying goodbye to you during that so any final thoughts for you on this on this night I am so excited to see the outcome of these games but also so impressed by what the deep mine team has accomplished all right well that's well said we are just about ready to get into that replay now we want to remind you of a few things Rotterdam and I have not seen these games there are five games that were played we are going to watch two of tlo's games these games were picked because they're entertaining and they show something strategically that's interesting of course we don't know what that is yet now as far as the rest of the games go we will talk about them a little bit and all the replays will be released on the website after the show so you will be able to check those out and I guess it's time to get into that game with our wonderful observer mapu Kevin kremzer let's do it alright then I'm so incredibly excited oh my god you've said multiple times a lot of people here they've seen this we have no idea I can't wait to really break down some pvp once again guys this was played on the Blizzcon patch but it's still a very recent patch so we have noted into catalyst all the games will be played on catalyst all the games will be Protoss vs. Protoss but then I can't wait we're looking at the main base of liquid steel though right now but I want to see that other members yes so this is alpha star this is an AI that we don't know how good it is yet and we'll go over some of the fine details of the game but already we have some interesting things happening for a Protoss vs. Protoss you notice that up here TLO is making buildings right at that small choke point that small ramp this is a tactic that we use in Protoss vs. Protoss to make kind of a wall so that your opponent can't get into your base but alpha star is skipping that altogether there are very few proteases in Europe that don't wall off I like to think that I'm one of them know what you guys can mate ask yourself what's the benefit of not falling off technically you save a little bit of money like you save a few resources because everything well that's a lot of probes by the way just chasing around this is not optimal gameplay I think then that's quite a few problems not really I mean technically you can say it scouting but that's a lot of probes bouncing around and at the highest level of star path - we like the thing that we're all very efficient and very clean with our both orders so every probe that can be gathering resources early on it's very worried about cannon rush it seems yes yes yeah and a cannon rush is kind of a very aggressive early game strategy that could be used against it but TLO we can see is not going for anything like that now in the meantime we have all these probes they're just kind of gathering resources minerals and gas to build these buildings so they can build units to get out on the map to control area much like any board game that you might see but it's just I'm so interested right now because I see for instance TLO is making two adepts yep and this is the main reason while you'll make a wall at your at your ramp so that those adepts can't come in and start to destroy your probes nope even though the office star has created kind of a nice SimCity right there's a little bit of a circle around the middle line so you can say that the reefs or the workers are somewhat protected in general especially since diello use double chrono boost that's an ability of the Nexus 1 which makes you build units a little bit quicker in a regular game if we are casting this in a normal way we say that these two adepts of TLO are guaranteed to kill 8 9 workers and it's talk of two terms that means that you are incredibly far ahead if you can pick up that many workers of your opponent early on you are going to be very far ahead well right now we see the adepts using their shade ability to get in here and start attacking probes you see that the t-low is already eliminating some of these workers now alpha star is trying to target them down as best as he can but this is pretty significant damage I would say almost say this is a really interesting exchange because even though darío was able to pick up four or five probes there which we normally say is a very big deal you could say that the maximum amount of workers that you want to have on your minerals in this space in the game is 16 maybe 18 offices are technically still has that at least it's mining a little less gas but when it comes to mining minerals it's still mining more than enough and it did pick off to adapt so I wouldn't say it's the greatest art for off a star and don't think it's the cleanest or most optimal start but it's also not game over by any means yeah it's balancing of the economy is very interesting because for instance there's only two workers on gas on one of these geysers three is optimal and you know alpha starts skipping that TLO comes in again is harassing more of those probes killing them off and I mean I feel like it's a good position right now for TLO overall yeah it seems like his units are a little bit of a position to keep these stood up with their micro sorry actually getting quite some damage done I mean that's evens up the score yeah well is the worker count we can see at the bottom right now it's 24 workers sports yellow and 25 for alpha stars so overall I guess alpha star has recovered from the early game yep normally losing 10 probes in a four minute and 25 second game that's way too many will say that that's too much damage that's not you know you're not supposed to take that much damage but this game is not over by any means as we sawed off stars also going for the robotics facility is getting a warp prism this warp prism is gonna allow off start to be aggressive on the other side of the map and should be able to pull off some pretty nice micro I assume yes now if this strategy in particular is really really micro intensive as you said you have to control your units just very precisely which we've already seen the Alpha star is quite good at you're going to be kind of juggling stalkers these these big long-range shooting units in and out of the warp prism trying to dodge taking damage and doing damage to your opponent in the meantime I love Afsar is truly respecting the Oracle as well we'll just leave a couple stocks at home but at the same time still try to make something happen on the other side of the map and this is actually kind of scary but yeah because yeah Phoenix is about to come out soon but once again this war prism is gonna allow officer to micro these units incredibly well and I mean so far the micro is good it's it's not like perfect micro that we're watching at the moment but look at this getting backwards kind of kiting everything with these soccers some good juggling going on that work prism still alive though very low on health yeah a couple of stock is a very low in health as well nice pick up there on the Oracles of both air units went down 50 lava still has an expand is still trading out why he cently out stay in the middle of the map but if you take a look at the army supply the army of alpha star it's actually quite a bit bigger now obviously we left four or five units on the other side of yeah yeah so those units can technically join for the next portion since the shield battery went down 4000 as well just gonna kick it a little bit easy you're quite right even though TLO right now has an economic advantage having two bases two one I don't know that he's gonna be able to hold this assault from an alpha star I think this is maybe a moment where they can see that elo is not a natural produce player because I think the start was good for T alone and I think there was time to be ready for this it's still not over but the army of TLO is very small compared to the army of office star yeah the Telos is in a dire position right now these soccers just going in and out dodging all the damage that Telos trying to give to him and kind of choosing when to take these battles it feels to me like so far these attacks have been very well planned by alpha star and they're relentless does not stop I mean now him said he was worried that perhaps the off star was going to be incredibly turtley well it seems like the opposite the other thing is we is a term we use for a play that just never attacks I think six eight of the Hopf star is the opposite it loves to attack well is it the G G is called the good game here from TLO and the first game from alpha star against a pro gamer goes to alpha star before we get into that too much I do need to introduce our new guest up here at the desk we have Dave silver co-lead of the Alpha Star program here at deepmind welcome thank you it's a pleasure to be here well the pleasure is truly mine and Roddy's okay because we just watched an AI beat TLO a legendary pro gamer please talk to us about this what is going on here how did this happen well this is of course an exciting moment for us if we have a team that's been working on this and ramping up our development over the last few months and this represents you know a milestone where we actually for the first time where it saw an AI that was actually able to defeat a professional player kela what were you kind of thinking as you played this very first pro match against alpha star so I started the match very confidently especially when I saw those probes and the natural I thought okay this is not right you know something odd is going on here it's I thought - it was very worried about cannon rush and I must admit I feel I should have won that match but made a lot of mistakes because I'm not used being to being a Protoss player but even though I lost the first map I was still very confident because it was a one base push you know you can't lose to that but I felt like I would be very prepared to the next matches well the micro in that push seemed very very strong and I'm sure something that all the people at home are wondering all the Starcraft 2 players at least is what kind of speed does alphago have can we talk about that a little bit we measure speed in APM actions per minute in StarCraft so can you guys speak to it a bit yeah that's right so we thought a lot about fairness and trying to make a system make alpha star in a way where it would actually play the game fairly and not just kind of our win the game by playing an insane number of clicks or playing in a way that a human just simply couldn't so one of the ways in which you measure how fast a player is able to play the game is by these actions per minute these APM's that you mentioned and what we see here is actually the number of APM's that both alpha star and human pro like TLO will actually use in a game and what we see is that in there's often times where it's necessary to actually use more APM's or fewer APM's but the overall alpha star actually used considerably fewer APM s than TLO or a human pro would in this kind of situation and so that indicates that actually it's not just winning this game by by clicking insanely but actually by doing something much smarter than that yeah and I I do have to mention you know as a longtime Starcraft analyst that that's not a particularly high APM that we're seeing from alpha star so very impressive indeed and on top of that is probably worth mentioning as well that actually you know there's another real factor here which is whether whether alpha star is playing with like a superhuman reaction time but actually we measured how quickly it reacts to things so so if you actually measure the time from when alpha star actually perceives the game when it actually observes what's going on and then it has to think about it kind of processes it with its neural network and ultimately communicates the action that it chooses back to the game that actual time length that kind of reaction time is around 350 milliseconds which is again actually really on the kind of low side the slow side fro compared to human prose Wow well I mean it's very impressive that it's playing that well that I do have one more question as to kind of the the fairness of it how was alpha star actually looking at the game so if we think about how up star actually perceives the game it's very much as if it's kind of zoomed out so that it could see the whole map at once and so if you think about it you know what it's actually able to see it's kind of depicted here in this kind of video and alpha star is able to zoom out and see all of its own units at once including all of their attributes such as health or shields but in addition it gets to see any enemy units which are not which are actually visible in other words they they're actually not obscured by fog of war and they're not invisible so anything which can be seen by a human player if they were to move their camera to that position all of that information is available to alpha star straight away given this kind of zoomed out sense of the game so you might say well you know humans when they play the game they actually have to do something additional which is to manage something which pro players call their economy of attention they have to think about where they're going to click and where they're going to focus the camera on and that's an important part of the game to decide where to focus their camera and and what they're going to see so what we actually did was we analyzed how alpha star actually plays the game as well and what we saw was that internally even though it's seeing things in this kind of zoomed out view it's actually having to manage something similar with this kind of implicit focus of attention and what we did was we measured that focus of attention and we saw that actually changes that focus of attention and sees about 30 different screens per minute which is actually very similar to the typical number that human prose would would use now I've got one big question something that we see obviously very often in professional Starcraft 2 is if we are playing a best-of-five or in this case a five-game series we adapt like if we lose a game we will not necessarily go with the same strategy if we win we also may not necessarily go with the same strategy because you don't want to become too predictable those off a star have this thought process as well like will it do the same build again because it won game 1 or can we expect something else so will will have a a more clear explanation hopefully in the next few minutes but what I would say about that is that currently alpha star actually doesn't care about what happened the games so in a way it's playing sort of the five games independently okay and obviously it is true that as a human and I myself played there's a lot of kind of said that you get into if you've lost one and so on the games and what we're seeing here in alpha star it does not do that okay okay so we're gonna go into the next replay pretty soon but that's actually going to be of Game three of five we're skipping game two again it's gonna be posted on the blog of deepmind after the show but can you quickly run us through what game two was like so because the Vale Game one went down I felt very confident that I just need to play a clean defensive game and that I should easily defeat the agent that I I thought I was with Tim there a little bit oh it looks like it's just gonna be the ultimate cheese machine that this is gonna do risky one base all ends because that's straightforward that's how humans started playing the game so maybe that's how alpha star started playing the game and I played very defensive and then it basically played turtle into a viewer one Stargate fleet bacon with carriers and it never attacked until it basically had two hundred supply carrier army and I managed to almost come back by just killing all the interceptors with walkins but then it just had 15 carriers with three three upgrades and eventually actually the carrier versus area again so zero to Dario Wow Wow well I am very excited to see what is in game number three so let's go ahead and get into that replay that's and see what other strategies alpha star has in store for us that's amazing that is amazing mask arias line of the complete opposite of game on wow that answers that question as well alright we have loaded into the third game of this five-game series as this time in the right bottom side of catalyst we're looking in the main base of liquid PLO and in the top left we have alpha star once again of course we already kind of went over this it doesn't look like it wants to wall in at it's its ramp so you know kinda has that open main base now I think there are ways that you can get away with not walling off at the ramp we went over that a little bit in Game one why it is optimal or at least we think it is optimal to wall up in PvP I think the way that office tardy in game one is not perfect like I technically think that you can open up with the two adapts that he loaded yeah quite a bit of damage if you shade out with two more attempts after that I truly believe that you can do enough economic damage that can truly hurt the opponent where it almost becomes impossible to come back I mean a main reason I don't know how this went for you but you know when I got contacted to get here I was obviously very excited and had no idea what to expect well I was like man I'm actually a bit nervous like I don't know what do you guys want from me like well we asked you to come here to pay speeches observe and tell us whether or not this is good Starcraft yeah I definitely think it was good Starcraft but not perfect Star Trek certainly I would agree with you so far and what we've seen I mean it's very interesting to hear that game 2 was like a very quick carrier game because we don't really see that I'll have to check those replays out later but I guess we are gonna see this game was chosen of course because it is an interesting game and strategically something that people will want to see so it's really interesting to see how late off the star saturates the gases yeah it's actually pretty funny cuz I think that the TLO actually a while ago and we often get questions right whether we're caster or a pro game is like you know what is the thing that I should focus on the most in the lower leagues and one of the biggest mistakes that low league players make is that they take their gases very early not just in the main base but in their second base in their third base in their fourth base people take gases too early and obviously if you take your gas store the your mindless minerals but you need minerals to technically get everything else I think all sides may be overdoing it we're delaying it that much on the bombay's we like to think that this is not optimal but hey maybe the officer knows something that we don't well I mean it knows something TLO doesn't so right now we have alpha star making a couple of adepts a couple of stalkers over on TLO side Telos play to be to be fair after that kind of little joke aside it looks like professional play you know what we're watching like the placement of all the buildings the way he's moving around with his units this is what we would consent consider like a pretty standard Protoss vs. Protoss opening I actually love this the adepts going through the middle of the map oh god that's some pro Level II was if you talk about minor things like you don't do this if you don't let that shade finish up your adepts will run straight into the forces of your opponent they got a reveal they be take a lot of damage and see your risk of losing one that was a really good movement you saw where the shade finished the adepts were in that tall grass area and that's actually a kind of a big deal like you can't see them from outside but they can see you so that seems like it was a very expertly done move there by an alpha star I love how it went up the ramp it picked off one probe as quickly as it could this shape is not going to accomplish too much I wonder if you like answers and sneaks in right there but it's time is most likely limited the PLO switching things up here and he's going for the robotics facility so perhaps a little bit similar to what office start dating game one yeah in general and stalkers - we like to say that if you're doing the exact same build as your opponent defending is easier than attack yeah yeah now alpha star is kind of doing what we saw in Game one right it's getting that robotics it's getting a lot of stalkers I expect to see a work prism made here momentarily you see the amount of probes that all-star has in the main base I mean it is technically mining a few more minerals but in stock do we like to say that 16 probes on a mineral line is perfect technically you mind a little more with 18 and they don't warn with 20 and it's tiny bit more of a 22 and 24 but that difference is so small that you technically don't want to go there yeah yeah no competitive stock of two player yeah it's very true we normally try to you know minimize the amount of extra workers you have on a base like that especially if you're doing something kind of aggressive now seeing the robotics Bay being made this this helps your deck a little bit lets you make more sophisticated units like Colossus you can get some upgrades in it you can make disruptors and while it's not completely unheard of to get it on one base it's a very rare thing to see in a Protoss vs. Protoss match true I must say I love the decision to not commit to the attack though in the first game that we watch the first replay as well that we casted we saw clearly that there was weakness in the defenses of yellow and and maybe off star sense that off star picked off a couple units and even she was able to squeeze at a victory this time it seems that elo is a lot more prepared yeah and then immediately we see the decision of officer to actually go for the expand as well I mean that is the way you want to play soccer ya know tio right now looking very Saudis playing kind of a defensive game but you know his economy is much stronger than what alpha star is at right now he's getting into his Twilight tech after that that robo so he can get kind of some more into built mobility and power into his gateway units looks like he is gonna go for the charge upgrade but right now alpha star is coming across the map with the stalkers but where is that disruptor I think they're just waiting at home okay it's training a little bit behind but perhaps this is one of those moments where you know as a player you always want to be active you don't want to sit at home too long if you have units you want to try to get some value out of this units and it's not always about getting efficient rate or trying to get a massive advantage cuz just being out on the map often keeps your opponent busy if your opponent sees forces there is a bigger chance they make a mistake okay here we go he's actually coming up this ramp uses that disrupter shot couple force fields come out from t oo and he actually does a very good job carrying this attack from alpha star very risky by officer to go through yeah like this is a very narrow ramp a single force field can technically split this army in half yeah these are not oh yeah very nice micro there by alpha star guiding that in now that that disruptor it's a very high-tech unit it does a lot of area of effect damage so that little orbit that you see come out of you can't shoot it often but when it hits it does a lot but this is what I meant normally we don't go up and down a ramp like this too many times because single forsooth and shut this kind of movement down that's right army gets you know split in half you can technically lose half of it and not really get anything in return so these are very risky place yeah it really is coming up this ramp Oh another good hit though I mean the disrupter is getting some work done here for alpha star who once again is super saturating his Nexus here definitely creating a pretty big advantage since it has been building probes non-stop as well as our observer is showing us the income right now on the side of off star quite a bit higher than the income of TLO even though the nexus was later it's been ahead and workers throughout the majority of this game wow these disrupter hits are becoming ridiculous yeah just gonna back up I mean is tlo's economy looks like it's gonna get a boost if he can live through this but I out the star is just continually push mean he's even getting a second robotics at home which is a very rare thing to see but he's pushing right in he's better value of these disruptive shots doesn't lie right so ya might get a few more out I think these are moments where technically off star could be even more aggressive because it's in incredibly good position it has picked off the majority of the forces of TLO of course you want to wrap be rather safe than sorry and gentlemen start off - when you attack both these disruptive shots have done some phenomenal damage and all the star is actually in the tremendous position here yeah it's really interesting to watch alpha star just push in here non-stop keeping that pressure on now TLO is actually gotten a pretty decent set of Units here together so finally pushes him back down that ramp now once again it supported to mention that this was played on what we like to call the Bliss cone touch the disrupter has changed quite a few times over the years but this is still the disrupter that shoots forward what we like to call a purifier Nova but it will blow up as soon as it connects with a unit so you have to be very careful because if it connects with an enemy unit but your own units are too close you will end up losing your own units yeah it will destroy anything that it blows up on here now continually pushing up this ramp you know alpha star is having a very hard time with this small choke I see a lot of good redeeming things about his play but this is one thing that no professional would really ever do trying to get up that small choke that it was a phenomenal disrupter shot there but you're spot-on then we are very worried in general to go up ramps because once again the force field is an incredibly powerful spell in Protoss vs. Protoss if you don't have our cones or colossi which is our late-game units you can't really break force fields so we would normally be very very hesitant to even think about going up a ramp like that now elo is actually attacking into alpha star for the first time here this disruptor count is actually gonna incredibly high though yeah it's also something that I think you normally don't want to push into elo getting very ambitious here obviously did drop that's a lot of observers yes we have seen this in our life but perhaps off star lost a couple games against dark templar essences like i want to make sure that never happened yeah yeah the observer that we see flying there that we were just looking at it just detects anything that's invisible for you there are some invisible units in StarCraft oh and so you'll use this for that situation or alpha star is telling us that f2 is the optimal healthy to use you have to is the select all army hotkey we have always a very divided opinion some players love it and some players hate that some players will say you should never use it but technically if you press f2 if you haven't changed the alt keys in start with you you'll select all units at once and that's often when you see five observers flying next to each other alpha star is pushing up right now again just continuous blasts here from the disruptors and it almost feels like there's a little bit of sloppiness coming out of alpha star with it with the units but at the same time we don't have like the blink upgrade which is very common to see in this situation I love that move officer just immediately recall it as soon as it realized that it was a little bit out of position but what okay okay nothing to attack up there okay those are nut shots we would normally make but I don't like that move bringing the army back home knowing that TLO was in the middle of the map and trying to respond to it so it never stops to disrupt this how many disruptors do we currently have out on the map eleven eleven disruptors and catting would be so proud this is really kind of wild to see like I have never seen a game that looked like this and so far Alpha star actually has more supply if you look at those numbers at the bottom 152 of 181 against 116 of 133 so it's 155 supply against 116 which generally we look at that and just say okay that's a pretty decent advantage right there you just have a lot more units on the battlefield it's been a it's been a really interesting game this one because it started off it normally say in a good way for T alone but that office I really brought it back and a couple of phenomenal traits and now it just feels like we're in a face in the game where we're looking at an amount of disruptors that we don't normally see in photos business produce I mean disruptors are fantastic units but you'll make five six maybe in some crazy scenarios you make eight and we see 13 right now out of office time and and they're all moving around together as well you know there's definitely situations where you're trying to get sneaky with these units because they can do so much damage but just keeping them together right now I'll pass are definitely has a strategy and is sticking to it you always see Thea logo for a couple of zealots on the right website and at the same time also building phoenixes at home I do like this because I think one thing that we have seen over the last 5-6 minutes is a toughs are often runs around with the entire army in one place elo is starting to take some advantage yeah that's true by you know making a minor attack on the left up side saying a couple units to the right topside perhaps trying to uh and make it more complicated for all the story I I like that that TLO is definitely learning and adapting here getting some units that are actually very good against disruptors disruptors can't hit units that fly so these Phoenix's are gonna come around and lift the disruptors up and really cause a problem for them a lottery a fake void ray but yes you're spot-on TLO is building a unit that'll be very careful being aggressive once again a couple of these forces of TLO do go down I mean supply wise it really doesn't look good the numbers that obviously are next to the names the office are is close to having the biggest army possible instructors do not necessarily the most optimal army because this is any crazy composition but you cannot go over 200 supply so mm-hmm I guess you yeah has done what we call maxing out a alpha star is maxed out to supply and it's just a gigantic army as you can see mostly disruptors 134 army supply overall so definitely feels like alpha star can win a battle at this point 18 disruptors never have seen that in a program no that is a there's an insane man there's also a lot of stalkers and no blink upgrade this is also not something we see at very high level Starcraft 2 this army composition however is incredibly strong and I think TLO is in a world of trouble because a couple of Phoenix's who that's a way to not be maxed out anymore then yeah I'll serve those up a lot of its own units here the Phoenix is coming in and lifting up so many of the destructors that will cancel their shots as they come out and it looks like TLO is going to take this battle pretty decisively but still down in supply quite a bit I mean that's that was an interesting battle officer clearly one of these purifying Nova's of the disrupted connecting with the own forces men that TLO was gonna get a better fighter cuz a lot of Units went down before to fight but I mean now at the same time office we're still getting a couple of phenomenal disrupting hits off and TLO simply doesn't have the amount of units anymore to really fight an army like this no not not too many but ELO has taken the fourth base I feel like TLO has done a very good job of economy management the way that we understand it as humans so far you know keeping that mind going but alpha star just completely relentless double observer once again as rico is being used and all these disruptors as well plus soon you know what i think it's one of the most interesting things about this game the officer has not decided to go for playing a lot of stalkers have been produced in this game Oh Blake actually spinning something yeah just very very recently okay and that's something that you normally see on the the pro level you get blink with your stalkers it makes me very mobile you your stalkers can kind of just flash to different locations like that we just saw yeah okay then it does make sense but it was late because during this big battle we didn't have it yet yeah it was finished we don't often see high level games with 20-plus stalkers and no blink upgrade that's is something that we don't see very often now alpha star seems to be coming in once again with just about twice the army supply it feels like alpha star is going to be able to take this game its own units but I mean the amount of disrupt it seems like it's a little too much to deal with it's not an optimal composition but it seems like these numbers don't lie GG once again well then Wow indeed Teela what are you thinking these are three pretty drastically different games that you played at this point yeah I think that was the main difficulty I have I I'm not a Protoss player and when I was practicing most of the humans applied against played very standard Starcraft so that was kind of my knowledge base going into these games none of these games look like any of the games I played on ladder so it was very tricky to counter that because I once again I assumed after the first match I'll probably have a good idea how to play against series agent I did not every single game I was again in the dark and I needed to come up live how to counter the strategy on the fly yet proved a little difficult for me especially not being a protist professional I mean the three of us all we do is watch and play Starcraft and the fact that none of us have really seen anyone play like this definitely kind of adds a crazy factor into it or it's very hard to to come up with that on the fly but I got a no now guys Oriole Dave how do you actually train alpha star yeah so the process of training actually starts with something that I was describing at Blizzcon which is called imitation learning and what this means essentially is that we take many replays from you guys and many of you watching at home and we try to sort of understand the basics of Starcraft through just essentially looking at a situation that a human is in and trying to imitate the best we can that particular move so here we should see sort of how that kind of first step of the process happens and that is what I showed that Blizzcon that kind of almost v0 of alpha star this it's inception which uses by the way not only professional games it uses 3500 MMR an hi so really many of you probably have kind of helped in a way train the first version and then what happens next I'm Dave is gonna tell us okay so we train alpha star using something we call the alpha star League and the first competitor of the league is actually the neural network that's trained from human data as oriole just described and then at each subsequent iteration new agents are forked and branched from that previous agent and added to the alpha star League these agents then play matches against other competitors in the league and depending on what happens in those matches their neural networks are updated by a process called reinforcement learning so as to defeat all of those different strategies as effectively as possible in addition the competitors are encouraged to specialize by adapting their personal learning objectives for example some of them might have preferences to play against particular opponents or incentives to build a particular unit type and finally at the end of the alpha star League we select the least exploitable set of five agents out of the league as something we call the national of the league and that's the five different agents that TLO was then actually playing against oh so he was actually playing against five different alpha alpha star is that one an actual league where you had almost like just a huge amount of alpha stars playing against each other over and over and learning from each other that's right yeah so basically this you can see this league as kind of the process which in which alpha star learns the game learns about worker rushes cannon rashes some agents kind of maybe obsessed with a certain unit that agent we saw was a bit obsessed with these Raptors one of the five best exactly so then the cool thing is that then these kind of knowledge of all these agents that we've trained through time gets distilled into like this what we call distribution / agents in which then we would just kind of play a best-of-five or a five-set game here and what's important to also note is that the order was also randomized so I said before there's no adaptation between games that means that we kind of look what are the five agents that stand out and we kind of toss a coin order them in some way that's the way in which the player experienced them the office tower League sounds awesome yes so how long does the office tower League run so the league here was run for about a week so the first training process of supervised learning learning from replay replays takes about three days and that gets you to perhaps a platinum level player it's it's hard to estimate and then the league itself as I was saying was run for seven days okay what does that mean like if you would compare it to let's say us playing for seven days yeah so seven days of you know real time is actually longer it slightly longer in kind of StarCraft as team was saying before we get a binary that can run the game quite quite much faster so the most experienced agents we see today have played about 200 years of Starcraft 2 slightly years of StarCraft yeah it's a fun life I guess it is I aspire to be one of your agents Wow that's I kind of caught off guard there I do want to ask you guys about like how many of these agents have really bizarre strategies because I feel like we've already we've heard about one we just watched one the first one seems kind of normal but the how weird are these strategies getting so the beautiful thing about the actual training process of the Alpha Star League is that actually develops a whole diversity of different strategies over time so you can think of this as mirroring the way that that professional player started playing the game of StarCraft when it was first released that they would start off discovering one kind of strategy for playing the game but then someone else would find like some counter strategy to that strategy and that would lead to some new way to play the game and over time a whole set of different ways to play was kind of introduced into the into the ladder where poop lying against each other and we see something very similar emerging over time in the Alpha star league where it starts off doing really crazy things you know a lot of worker rushes initially you know zealot rushes this kind of thing and then over time developing more and more interesting strategies such as some of the ones that we've seen Wow is there another strategy that truly stood out for you guys that I mean a funny story to share maybe maybe interestingly sometimes very nice proxy strategies emerge I am NOT a Starcraft 2 professional player so I cannot judge or whether these exist or not but it's interesting that even when the agents are not incentivized to do a proxy I mean they just play just kind of to beat the league we see that emerging sometimes then some other times it goes back to doing like Phoenix's or like so but that I think the emergence of proxy plays is quite notable and I'm sure in the replays you guys can kind of analyze and tell us if anything weird emerged that we just don't understand enough probably well so far we've definitely seen some of that I you know that's the last replay that we're actually gonna watch of your series TLO but you did play games 4 & 5 can you kind of go over them for us a little bit tell us about them yes of course so game 4 once again completely different from anything I've played against before and as we know now it's actually basically a different agent that I played against which I you know countering what I did before wasn't very helpful it played massive amounts of playing stalkers and we saw some really nice playing micro and it basically it's just odd maneuvered my units it did very human moves there as well you know how usually you plink the wave of stalkers in the normal but once you have more stalkers you plank on top of the enemy army exactly that happened as well and I actually had some duties in my base as well very much like a human player yeah very very Protoss typical style so I lost that game too and in game number five I decided I identified a weakness in alpha star that it didn't Scout very well so my plan was to build a proxy pylon in the enemy base and go for four gate ah however coincidentally alpha star also decided to go for proxy and put a proxy pylon in my natural and went for four gate I went for three gate but unfortunately my pylon was just one inch off and got scouted and I had three gates but my pylon got unpowered and alpha star beat me with the proxy it was really interesting that we both decided to go for the same strategy there but yeah it was a fool sleep oh five Wow well again you are actually zerg main race player but having played this and you're a very good Protoss player there's no doubt about that what are your overall impressions after having played these five games so even though I was defeated I actually still felt very confident that if I would have more time playing pros and if I would have more matches that I would win a significant amount of the matches because even though I lost all of them some of them were close and I could identify some problems of it and I felt if I would have another week to try and Protoss I would easily defeat these agents as well so you know I I didn't feel too bad about losing okay and for you guys like your your agent beat its first pro gamer five to zero you must be pleased with that what did you think about the way that it performed yeah so it wasn't incredible just experience for the whole team to be you know in the room watching a pro gamer I remember actually after the first game he said oh guys you've done it so that was kind of a relief and this a kind of happiness moment and then then every game after that was kind of a show that the approach we took was really working you know at the same time we realize while we we won 5-0 again it's not obviously and LoZ main race he plays earth as a proto skis you know meet grandmaster so we're still extremely good so you know we decided you know that was kind of we were celebrating you know and we might have had one or two drinks in lorry and I was celebrating and out with the team and one thing led to another and we started discussing and realizing that you know given that we had won 500 that maybe we didn't know the upper bound of how strong our agent really was and that maybe it would be a good idea to actually get over someone who wasn't playing there off race and and actually play them so this is when we hatched the idea to go back to the office press the green button and restart training on our agents and invite over a really top top professional Protoss player all right characters spoil it for the audience oh so well we we kind of contacted TLO and we said okay we we want to play a Protoss professional gamer ideally you know in the top 10 range of proto's and you know assume I guess because it's actually one of his teammates he recommended that we play liquid mana all right well I think it's time for us to learn about liquid mana thank you so much TLO for your participation here it was fantastic and let's go ahead and learn about liquid mom mana can also go to the low ground three bt5 stalkers into it to go through that reality there is simply no you even our polish brothers has done it [Music] liquids mana is just like the alone absolute veteran within the stock of to seen but also a very very successful actual Protoss player had a lot of success in the beginning of his career he wants some of the biggest tournaments around back then 2011-2012 but he even comes off a very good 2018 where I think in this summer he had his biggest success of the year where he took the second place at a big tournament as we call WCS Austin that's just less than half a year ago so mana is absolutely a top rotor yes indeed he is I'm so excited to watch those replays mana welcome can you tell us a little bit about how you got here what was this like for you to meet up with deep mind so I know very very little about the mine and Tila was approaching me from time to time hey like how do you play pvp you know so I was getting a curious about that so he told me that he's going to play against deepmind because it's only a Protoss vs. Protoss player so he was trying to learn a little bit from my side as I I'm a profile Protoss player and then shortly before Christmas he messaged me hey do you want to come to an event somewhere around Europe like dude like I didn't know exactly what this is going to be about so I'm like yeah but it's just like around Christmas so well like I need more details details about that right so I think it wasn't a day that Theo told me that this is going to be a deep fine show match and then very shortly after a couple of emails exchanged and I was introduced to deep my team they took a very good care of me and yeah I arrived in London to play a couple of matches against the Alpha star well that is that is excellent you guys said that you immediately put the Alpha star back into training mode after you had a couple drinks and decided on this plan can you tell us kind of like how much learning data - how long was that exactly that's right so one of the obvious things is that mana as his main race is much better than TLO at proto's probably he would win definitely more than 90% of games in pvp so that's definitely a step up in difficulty now that being said we train the agents for about a week which was kind of the delay between the two matches and you know during that week agents also became stronger it's a bit difficult for us to estimate how much stronger we don't you know we cannot be playing professionals all the time we can only estimate their relative wind rates against other agents the agents looked like they'd learned to beat the previous sort of iteration that played TLO and honestly that I was super excited to see what was gonna happen because this was really it this is a top professional player I was actually having dinner with manna and he told me that he had played Starcraft since he was five I mean I'm sure professionally then I thought to myself well twenty years versus you know it's not as fair as 200 years or but you know it's it's it's clearly he dedicated a lot of time to study the the race the game so we were very much looking forward to playing against him so mana what were your expectations as you came towards this match like how much how much did you know what were you thinking were you confident tell us about that kilo didn't want to spoil anything so I got very very little knowledge all I knew is at elo lost but I didn't know if it was zero five one for two free I don't know how many games he played so I only know he lost so like if Taylor lost like I can't lose as well alright so I I was you know in a position that I was feeling confident I wanted to defend the humanity so I was very feeling very confident going into this okay and and you guys I know that you already kind of mentioned that you're really not sure is it trains up like is it going to be that much better that it can beat mana but did you have maybe like a gut feeling as to how this might go so well maybe you go first so I guess it's um you know when you're when you're actually trying to watch an AI train you have to evaluate it yourselves to try and get some sense of how it will do but of course you never really know from that evaluation how that will transfer into the real world against against top pro players so we'd seen that of course these agents had been training as kind of sparring partners against all of the different agents in the Alpha star league that had played against elo and we'd seen that it they'd learn to defeat and outwit a lot of those strategies but that doesn't mean that they had seen every kind of strategy that there is out and we knew that there was a good chance that there will be big holes in it strategy space and so really the only way to know for sure was to play the game did we have a gut feeling I think we would honestly say that we we really didn't know it was a it was a scary scary moment time yeah like I'm more a person I definitely thought well this is a much step up I again was hoping for some good games but I had very little sort of confidence in winning the series but you know it was still like an exciting time again you know after a week of an exciting time again CLO we were all ready and excited in the same room with the team to to just enjoy some starcraft games in the end right yeah I'm very excited to see how a professional Protoss player is going to take on deepmind here we're gonna end up watching three of the replays of your five-game series it's going to be games 1 3 & 4 I do want to mention once again we are going to have a live exhibition match after all of these replays that we're going through and of course all replays will be put on the deepmind website at the end so thank you guys it is time let's go into game number one of mana against alpha star hmm incredibly excited for this then I mean obviously I think the previous series comes as a little bit of a shock to all yes well I didn't drive now I did not expect that but I mean you know when we are analyzing starter through the way we normally do clearly the office star played pretty well but if this would be the same agent which is not I mean we've never learned that this one was later this one has obviously more games but normally you would say that mana should absolutely be a take care of the previous one of the one that elo played I would definitely believe that mana can take care of that office tour yeah it felt kind of like like you could see a lot of the fundamentals of TLO no matter what race he plays are going to be very strong but some of the very specific counters mana I think would have done better now like I believe that when it comes to the opening we already went over the openings a little bit in Protoss vs. Protoss but once again I believe that there is a much harder way to punish the fact that office star is not walling off untl oh there Telos it off to a reasonable start I believe a player like Monica bonuses a lot harder unless officer would have the absolute perfect defense which you could say maybe a Phoenix and the depth and the shield battery okay but we haven't seen that yet so that actually very curious to see how this places mom might not realize that this is kind of the the way that alpha star has been playing so far we should mention alpha stars in the top left as the blue Protoss player and liquid mana is in the bottom right as a red Protoss player one thing I did notice that was kind of interesting is alpha star immediately hooked to the side with his initial probe sent out to scout the map and see what his opponent was dealing and that's normally what you do to scout proxy buildings that are aggressive yep well Tilo also said that it felt it didn't Scout perfectly if you take a look at the mini-map you can sort of see the path that the probe of officer took so it's counted a little bit yes so what would happen if a Stargate or a gateway would be a little bit further to the left that could definitely make things pretty complicated liquid mana is going for the two adepts like T Logan or in the very first game that we saw as well and no this is cute talking about proxies yes yes but normally you would say that the two adepts of mana should be able to get quite a bit of damage done in the main base of alpha star this is what I would expect now both sides of this look pretty normal so far proxying you know putting buildings near your opponent's base in Protoss vs. Protoss is a pretty common strategy we see alpha star is doing that it will probably be a Stargate if it was a human it would definitely be mana is going for a Stargate of his own in the main base so this is very very standard of course as mana is a top player a gateway is not very uncommon either this yeah that is pretty familiar at very high level play as well building the Gateway on the other side of the map we said to expurgate this okay that's not something we see soon Oh anymore but a good old four gate I think this was the very first strategy we had in StarCraft II yes and it's been pretty strong and scary ever since okay the two adepts get into the main base of alpha star and alpha star is actually losing a fair amount of pro so far said three or four probes already going down take a look at the top I've well one was the Scout as well so this is kind of a funny thing about alpha star though is alpha star always over makes pro so the economy is not actually that bad now but normally building two gateways on the other side of the map yeah and it being scouted this means that you are really committed to this goal as we like to call instructive to this is not something where you can just stop your plan and immediately do the complete opposite because you've sank a lot of resources into going for this strategy if there's one thing that really sends out of the last game we saw off the star vs. TLO that officer doesn't seem to fear what ramps very much no we do that's true yet we are very worried about going up ramps in stalker to there is no high ground vision as we like to call so the units on the low ground cannot see what is on top of the ramp unless you commit to it yeah they're just gonna take free hits and you can see those health bars going down for alpha star stalkers now alpha star does have way more stalkers here then liquid mana does but with those shield batteries to peel them up a little bit maybe mana can hold on force field is a little bit late on the side of mana but it's still pretty good as it splits this army in half at the same time an Oracle does go to count on all these workers on the left up side of the map and it's ready I think here you can see the difference blue okay well that's actually a little bit scarier from yeah yeah yeah of these stalkers entering the main base well this is not over yet the immortal pops out but instantly targeted here by out the star oh my gosh alpha star would have enough units here to actually win this game the micro is really good so far it's important that your stalkers the units from officer here don't get surrounded by these probes because stalkers are very good they're fast and mobile but they're not very strong and not very tanky so they can take too many it's but this micro is very solid yeah or and where things look perfect for mana it actually seems like all stars taking this wrong way you know in it we would normally see if mana win a position like this but the micro overall this control of these stalkers has been fantastic alpha star is just playing really well here and once again showing no respect move around just walking into a Pro Tools main base this is not something we see super often at high level photos news photos play because we saw one century but normally you would see multiple centuries and if they keep forcing you cannot enter the main base okay so Gigi is called an alpha star actually pulls it out mana I need to hear what you're thinking here because that looks scary yeah you explained it perfectly alpha star like he's not scared about the the ramp so well if I would be playing against a human player right there nobody's going up that run especially I forget like twice yeah I was just confirming in I was like yeah that's that's a very typical strategy I can do it so I Kris go with the Oracle and the others half dozen map I do a lot of damage and I feel safe in mine yeah yeah but then like one of my gateways was not to being a warp gate so what my century was late so he kept trading and like draining the energy of the shield batteries and then he had so many stalkers still as I follow up I was really really shocked so it was again that I think I could have won if I did just a few minor things better mm-hmm you know it was a very close game Indiana I actually thought you were gonna win it for a bit as rowdy did as well now we're not gonna show game 2 really in its entirety but can you just tell us briefly what game two was like mhm surprisingly we both go went for a mirror bills that means that me and alpha sir went for the exact same bill loader we went for it with a Stargate it was a rather short game we both went with like a gateway heavy style with with phoenixes we were kind of fighting in the middle of the map but with the superior micro of alpha sir I went a little bit behind so I wanted to go for an all-in strategy I didn't want to go for a later game because I knew I was in a bad position so I went to the offense and surprisingly alphas are simply had way more than I did so as soon as he destroyed my army he counter attacked and destroyed me so it was a 2-0 okay alpha star playing pretty well so far what was the reaction of the team at this point writing these games like I'd love to know what's going on well super like relief as well in terms of it's it was actually better than the previous weeks agents as they've said it's a bit of an uncertainty for us it's really really important for us to have such talented players come in and test the agents it is obviously people have really perfected playing Starcraft it's such a long-standing playing game so it's very very important for us for us to not only just have agents that seem to play good but also to verify that against these amazing players that we got super likely to get in our offices I mean that also was super cool to have these guys around and the team was also super excited to meet them some of them are you know they're fanboys right I would just add that of course alpha star is a team effort and it took quite a number of people a lot of effort to actually get to this point where we were able to play matches against our amazing people like I'm tier low and mana and you know the team really just had this immense respect for the situation and we're loving every moment of seeing this match up and there was not just relief but also we had you know a really celebratory atmosphere in the room we were all sitting there together like tense as anything watching this game and then at the gg I think you know there was a little bit of a moment of excitement and the team was after a game number one in game number two I they were literally in the room next next to me so I could see like wow just behind the wall so I knew they were cheering hard for definitely the hard work paying off so far with a 7 to 0 map score now going back to just game 2 first thing I understand that we have some video footage of it which you guys are actually going to walk us through and kind of show us how alpha star knows what to do with in the game so if you guys could get us a bit about that yes so once the the media rolling I can kind of a bit of unpack it for you guys perhaps so this is a very nice visualization also prepared by the team after the matches which essentially shows quite a few things so here starting on the top left we see alpha star view the game as it's kind of it's focusing its attention on this area of the map as they've said we don't have the notion of a camera but it kind of focuses wherever you're seeing that screen on and importantly and interestingly alpha star observes or perceives the game only when it wants to act so these arrow that appears on these appears it means when it appears it means now it's actually looking at what's going on then these kind of observation goes into what we call neural network I must say these words here for for kind of the machine learning people out there these three sort of spheres that are kind of changing in color is actually what we call an LS TM but let's not talk about that in the stream perhaps so this is kind of a bit of the brain of alpha star and it's what kind of it's deciding what to do so after that the arrow goes into kind of an important area of the screen which is what actions should I take right the first injecting the observations thinking a little bit of the situation and then we see kind of important points here first is what should you do what action should you do there are many actions in StarCraft so we see for instance what buildings does it want to do what units does it want to create and that's kind of the the little balls we see on here on the bottom right and also we see which locations it's considering issuing this action right so it's building a new unit it's it's moving it's it's it's kind of set of units around and we can see kind of what worried things it should be moving next and last but not least is the outcome prediction right so alpha star requires two kind of gautsche itself whether it's a head or not at this point in the game clearly it thinks it's a head it's it's really confident it's gonna win and if we analyze this game in terms of supply and how much you needs and an economy and we would understand that you know alpha alpha star here is actually a head although the game is not over so that outcome prediction is kind of also a testament of like what is the agent perceiving the game should it push forward should retreat those decisions are so critical and so difficult to make as a prize you know you know going back and forth should you engage or not these are actually what makes StarCraft a very hard challenge for AI because how are you going to higher code that encode whether you should go up the ramp or not as you were saying right so that the solution we adopt is to not hire code any drew at all we let sort of this whole system that they've described learn by itself what is it going to be that alpha star should be doing at all times so this is a bit of unpacking we will obviously have these and more details later on today but I hope I mean this is a kind of a cool way to see stagger I'm pretty sure you guys have not seen this hello know that outcome prediction is oh my gosh I'm getting chills right now this is just so cool Wow so you know after these games mana yes alphas star is up to 2-0 against you but it doesn't feel like these games were completely unwinnable for you especially game number one as we were kind of going towards game number three here were you losing hope did you have a new strategy a new plan I was feeling more nervous than before obviously I was very content going into this I lost game number one let's say luckily or unluckily it was a game that I could have won normally if it was a human player game number two was I could I must say it was a disaster for me he dominate I'm in alpha the Alpha star dominated me and going into Game three I was like yep this is the time that I need to turn it around okay well I want to see if you turn it around and I think the people at home do too so let's go into game number three and see if I can do it can you pick up a map I must say like we didn't see everything there of Game two but I do totally agree with everything that man has said game two looked very solid and if you would go up against that I think that's where the yeah starts getting really scary I agree with Manas assessment of game one and we are not saying this like a lot of people often think about stark of like well just me you know just because you say it doesn't work doesn't mean it shouldn't work like it clearly did so it was the right thing to do I don't think that's how stark of two works just you know sometimes you can have a good out poem but it doesn't necessarily mean it was the right play and there are moments where you clearly shouldn't run up ramps because you know that sure you're giving away half your army more often than not and you're putting kind of the ball in your opponent's corner right it's not even about you making a good move your only relying on your opponent not making the correct play material that's kind of what happened in game 1 game 2 we didn't see everything but what I saw from those clips there that looked a lot more solid and definitely a lot more intimidating well I off against I can already tell just with the way that the star has been moving in the games against mana that it's quite a bit stronger than the the agents that went against elo so you know that's this is very exciting to see now look at this alpha star is for the first time making that wall that we've been talking about this is a normal standard for human players that's actually is super interesting because despite the fact that in game 1 it didn't wall off and it's still won it seems like perhaps that's an adjustment that at least this agent felt like it should have made all right so far that's really cool to see by the way that this is the first time we see this after all these games mm-hmm Somaly in the middle of this five-game series there is a well off yeah so what will be interesting here part of the reason why you make that wall off is so that you can clock it you can build a building there that's very hard to kill and it will it will stop any units from coming up and trying to attack your probes so are we actually going to see alpha star utilize that technique or is the the wall just you know a fancy paperweight well mana after scouting the opening of all-star this game decides not to go for the two adepts and when it comes to Protoss openings there is no such thing as an absolute best opening a lot of pros will like the opening that Manas going for here which consists of one stalker in one sentry stalkers are strong defensively started centuries as well and sentries also allow it to scout a little bit what's happening on the other side of the map the two adapts is a perfect opening if your opponent has no wall off but his mana scouted that the office star actually did go for a potential wall up at least because the gateways are near the ramp I think Mama's opening makes a lot of sense and yeah this is all very normal and now stalkers being made on both sides again pretty normal stuff you showed me this replay just randomly last week I would have told you that I'm watching two humans play each other and mana going to go ahead and expand first now when is alpha star going to do this each game so far alpha star has been pretty slow on that but continually making those probes as you can see 21 in that main base so far but at 303 Nexus as we're just taking a look at the game clock real quick this is not weird and especially in this patch because this was played on the Blizzcon patch the way the patch that we had the world championship finals on just a couple months ago this was very standard expand diamond like this is as normal as it gets and even when it comes to the probe moving even when it came to the gas saturation I can see a very big difference between this office star and the one we saw three years ago now you're you're certainly right about that now some really nice micromanagement coming in from alpha star forcing back you know three soccers verse three stalkers whoever can control better is going to take that advantage and we see alpha star gets it to feel like minus 20 to get these stalkers up there ramped since alpha star has not shown a lot of fear up to this point and this time all-star is not committing to a program and the micro I mean really on these stalkers is incredibly really really good that is top tier micro right there pulling back the very injured stalkers with almost no help it's just respect for the redness yeah it's being a bit more careful that mana is hitting the forcefield but does mana actually just lose the Nexus from here but I mean if we would normally see this we would go up to the point where whether or not the Nexus girls down at this point doesn't matter that much because all-star actually has a very strong built or they're on the other side of the map as well it's following up with Phoenix's I mean it's a nice to see that all-star the 200 years of breakfast came up with the conclusion that Phoenix's are awesome yes I agree that Oh a mana gets out the immortal mana also showing a very expert professional micro here you know mana was poking down trying to push those stalkers back threatening damage on them so you actually saved his expansion and he's got some strong tech yeah it's not the Phoenix but immortals are very very strong against starters yep Phoenix could potentially lift this immortal temporarily disable it to not let it participate in the battle and then at that point officers army would be a tiny bit stronger once again but it is hard to be this aggressive in a Protoss vs. Protoss for this long especially this early on into the game yeah if there is no way for you to have quick reinforcements there is no war prism there is no Pilon on the other side of the map so these are attacks but we would normally say like ah it seems hard to really get a lot down here yeah yeah but as you said you know with those phoenixes out they can disable some of these really strong units so I'm not like completely on Team mana here as far as whose way even though it feels like this is really anyone's game right now I'm definitely with you this I just didn't think there was a lot to accomplish there but seems like Afsar felt the exact same way because it didn't commit to anything it didn't throw away units it didn't go for a fight it was not winnable this is you know this is almost like when I have get further ahead and just played very safe and steady the one thing that's a little bit odd I feel like from alpha sir just lots and lots of stalkers and non-stop Phoenix production it's not that bizarre but you're playing against some mortals so you know you could get a little bit nervous that those immortals will really punish your stalker count that's very dangerous stalker movement and the centuries would have been a tiny bit closer officer could have lost a lot of units there of course with us go down to Phoenix moines you got that war prism I need something we see in a professional soccer play very often yeah and some good micro alpha star actually giving up on it because mana pulled back the warp prism quickly enough that that would have been like an over commitment of the Phoenix's I mean we didn't see everything of Game two but the cliffs that we did see I mean I was kind of focused on the outcome prediction because I think that was super awesome and interesting but you could see that the Phoenix micro was that's something else that's really good yeah that's really good and now a second Stargate that's a bit uncommon in this type of situation like the Phoenix's are good here but you don't feel like they're that good that you want to stargates making them feel like this officer is showing a lot more respect for force Wilson in general comes in and if this is the big battle right now mana is going and trying to get a kill here the Phoenix is just lifting very important units picking some of them off taking them out of this battle and mana actually has to recall what he has left over alpha stars decision-making so far in this game has actually been fantastic only taking engagements when it knows it can win also lifting the sentries there as the absolute is right play sentries don't have a lot of hit points but do take extra damage from these Phoenix's so that's the first unit you want to take out and at this point I think office tower realizes that it's at so many unit yeah that it can just start lifting all the units of mana on the other side of the map and definitely a bit of miss micro there as alpha star comes forward but I don't think it matters this is just too big of an army Phoenix's are very very good units yeah this this has been a fantastic game from alpha star separte it looks like you know the game 2 looked very strong but this this game overall it was like not exactly human play but a lot of respect fantastic control on the unit's good moves running away and and mana has to GG here and I mean it's gonna be a full 5 games but you've lost three in a row now what are you thinking at this point so game 2 and game free were quite similar it was a Phoenix Phoenix control that really carried alpha star to the victory in this games so in game 4 I am expecting to just move away from the Stargate and Phoenix's because it came to I went with the Phoenix's myself game 3 I wanted to kind of contr the Phoenix even though the early game micro was heavily in favor of alpha star so game 4 I'm trying to simply survive okay okay fair enough I can fault you for this now the deepmind team at this point I mean there's a variety of strategies it seems like the decision makings game better it doesn't look exactly like human play but I guess the decision-making is what's starting to really blow me away yeah the the micromanagement is great but some of these retreats it's like going in with the Phoenix's and then withdrawing after taking a bunch of damage not not sacrificing any extra units what were you guys thinking at this point yeah so I think what you say is great the the decision-making the kind of high-level decision-making of alpha star is really spot-on I did you know a bit of a project in back in 2010 to try to build an agent or a bot that would try to understand when to engage when to disengage and it's extremely difficult to come up with all the situations you could be in and in here we're seeing adjust that how this neural network is deciding that and it's doing quite a good job at this and of course after seeing the the the game kind of the the 3-0 at this point but we were quite cheerful and unhappy and one thing to note that you perhaps noted here is that these games in terms of style of alpha star they start to look slightly more alike even though these are different agents they might discover a matter of like maybe Phoenix stalker expansion and this kind of play is not optimal but it's kind of a very good kind of solid way to play the game yeah yeah now talking about alpha star like hey where do you guys run alpha star from is this in a data center is it on a computer what exactly is the force behind this that's destroying mana right now right so the actual games we're seeing when alpha star is already trained and it's just playing against us that is actually ran on a extremely normal like a commodity desktop that just has a GPU just that you can just go buy on a store so the actual like that that little brain we saw is just done on a single GPU and alpha star takes about maybe 50 milliseconds to compute from observing the game to actually eating an action so it's fairly modest in terms of what we call inference or playtime and then in terms of actually training and we actually use what's called a tensor processing units which live in the Google cloud and the agents in the Alpha Star League actually use 16 of these tensor processing units now I know many people won't know what these things are so just to bring that down to earth a little bit that would be something like having say 50 amp GPUs which you might have on on a kind of a decent desktop computer and being able to actually use those for training one of these agents in the in the Alpha star league okay very cool stuff I'm excited to see game number four here where mana is going to try to stay alive so I have a quick question just like TLO mentioned he played against five different agents or at least you guys let him know later on it's the same case here for mana that mana also play against five different agents it's the same case and I mean he actually asked and we told him there there might be different agents okay and of course it's kind of common for players to also look at replays off day what they just played so so they asked if they could do that and and we we let them do that just maybe they can spot some deficiency and so on right so I would say especially for for mana he asked we just told to talk him right okay awesome one of the nice things actually was that the Alpha star league as it develops you start to see quite a wide variety of different kind of macro strategic ideas coming into play but what happens is at the end of the league we use this this idea that we actually find this set of five that works best together to be kind of hard to exploit by the opponent and our ideas behind that this new algorithm before going into this series against mana did you guys have any idea which of the five agents was the strongest like it did you guys know that agent two or three was nice and agent one for instance I mean I I'm not sure strong it's very hard to know we we did play the agents but I mean obviously we're not very strong players I did have favorites I think everyone kind of uh you know and obviously each member of the team you know might be training or they kind of developing you know they're they're kind of idea and so on so sometimes but at the end of the day yeah like I just have favorite in terms of how they play the game but which is stronger is very hard to tell actually I don't know if they've had to favor it I mean I'm really hoping to tell you what you guys think really is I would be fascinated by we're not strong enough to have those opinions and this is why it's so wonderful having you guys here to really tell us what's going on I mean my mind is all over the place but because after game one I was still absolutely not convinced I believe that if you put man and at position a hundred times again he's gonna win ninety nine out of under times after Game two in Game three yeah I've almost have nothing to say because that looked there very good and that looked like something very intimidating to go up against well maybe after we go through all the games mana can tell us which one was the strongest one and if this is gonna influence him in the future so let's go ahead and get into that game number four out of five here and check out how mana does all right I'm pretty intimidated at this point yes yes I am as well and as mana was saying he's trying to survive at this point mana is the red Protoss in the bottom right right here that you see and in the top left we have alpha star hmm this agent officer decides not to go for the wall oh so we saw the agent in the previous game or officer in the previous game did actually go for the wall off once again we still have agreed as the star core to community that walling of is the optimal way to place talking-to yeah unless you are a hundred percent convinced that you have the right answer for a potential first to adapt so I'm really curious to see if Manas about it I think mom has scouted every single game up to this point and if he once again you know realizes that this is a no wall of opening if he decides to go for the adepts again and perhaps get even more damage done than before yeah possibly that'll be something we'll see but the counter so far against that because we have seen you know Tilo is killing quite a few probes and we've seen mana do some damage as well through that economy I are just kind of makes a lot of probes to make up for that of course I def sound not free and that is you know logic that some players have applied over the last few years of PvP where it's like well I'm actually okay with losing two or three workers if I am able to pick off to adapt because that often also means that the person that didn't go for the wall up maybe open up with stalkers and if you open up with stalkers then you will have a army advantage over your opponent so that is logic that we have applied as well just in general most pros have come to the conclusion that losing workers this early into the game is not more yeah that's like a very long-standing thing that he's believed about Starcraft Starcraft's been out for over 20 years now that is one of the basic tenets don't lose your workers early on they are very important building up that economy but mana also mentioned that he was obviously a little shaken up after these first three games and felt that maybe being aggressive or going for stargates doesn't seem like the right way now if you want to play defensive normally you don't open up adepts because adepts have one purpose and that is in general to be aggressive on the other side of the map this time it's actually all of us are opening up with the adepts while mana is indeed sticking to what he just said on the desk where he favors defensive strong play and stalkers yeah they suit that a little bit better yeah and even puts that pylon on the high ground so it seems like mana is going to be very careful about expanding that's placed there so he can probably put a shield battery down and have that kind of defenders advantage if he gets attacked again by alpha star because you know the alpha star definitely has been attacking pretty early and pretty often so far vemana avoids the two adepts of all a star and he's gonna be able to get his probe into the main base of off a star here's to see where these adepts will end up I'm even like I'm just generally curious to see how the adept movement is going to be I can see the shading gulls read a defensive rather than committing with the shades forward and going to your enemy's base as quickly as possible you can see that officer there is trying to preserve its adepts if there's a little trend that I've seen from the agents I know that every agent that we've seen so that was a very good recall by alpha star actually we haven't seen a move quite like that yet we've seen recalls from the previous agents but that was kind of a very clutch one where you're going to lose an adept maybe to adapt snap situation I think one thing we do really still have to point out then is that if you're asking me what is the one big difference that officer is doing that almost no other professional starting to play those is the amount of workers that is being produced yes on base take a look at this mineral line and once again you are technically mining more minerals you know up to 24 you'd like going over 24 is a hundred percent pointless but in general going from you know above 16 there's just very slow progression and we have decided as community that you really don't want to go over 16 too much maybe 18 is except yeah yeah but normally you don't see 24 workers on one base that is one thing that truly stands out for me well with this Oracle from mana flying in right now and getting a decent amount of probes that get pulled very very quickly I guess that the stars gonna be happy once again that it has these extra probes so its economy won't be completely destroyed and another thing I want to point out here rowdy that we've seen in these games is quite often there will be probes that are off minerals like with the stalkers chasing down units or are kind of running around chasing probes so there are certain ways in which alpha star is utilizing these extra probes that we never see because no one makes these many on so few bases but I do like as a moment at the moment that this second base finished up that you immediately see those workers being transported so officer is clearly aware of the fact that having 24 workers on one base is not optimal it just likes having them early which is you know that is a theory that we're all familiar with is this in general we prefer expending earlier and getting those workers later while off star seems to be doing it the other way around yeah right now you know mana is looking pretty strong overall I would say alpha start going into that Twilight tech we would imagine that is going to be the blink upgrade for these stalkers so that they become very easy to micro very powerful in that regard but mana I feel like he's in a good spot with these Oracle's flying around trying to get some probes getting the information and making immortals at home which are gonna do really really well against this high stalker count but I must say I'm loving the stalker positioning that I office star the way that these stalkers were spread out in the natural yeah base yeah pop star that just made it very hard for these Oracle's come in and get damage done that's something that during the TLO match that we were talking about where alpha star is keeping the entire army together and not spreading now once you start to see really high-end pros play they will split their army up like this and defend multiple locations and only bring it together when it's truly needed you know the level of this office to her is a lot higher than what we saw in our first broadcasted series that is I think very very obvious in so many ways now that blink upgrade is on the way for alpha star it seems still like a very very close game mana is going for the Bey the Robo Bay to increase that tech a little bit and as second robotics on paper you do normally like this for mana because the army he's working towards a stronger army these stalkers stalkers are very strong units defensively they're really good in protecting and the mineral line for instance so to make sure that these probes will not fall against the oracle but eventually we like to say that stalkers do start falling off a little yeah they have a lot of micro potential they have a lot of they're hurt fast units so there is you know a high mobility factor that you can really make place happen but they are units where you need to make place happen because in a big straight stone right they are inferior units do for instance immortals yeah there's there's a lot of units in Starcraft 2 where they're very strong early on and then as you get later and you get higher tech units out to kind of counter them more strongly they lose that power and you almost get punished for over making them early on now is that going to happen in this game I so far looking at the compositions that these two are making I really feel like there is an advantage here for mana this is perhaps the most interesting in that we've seen so far because I agree with you that composition wise there's absolutely an advantage for mana but you can also say that the ball is in the corner of alpha star off star needs to make place happen but if there's one unit in Protoss versus produce where you can say you can't get value out of them you know you've made a lot of them early on it is in general the stalker now 29 stalkers are going to fight this trade up there is a shield battery there more yes there are stasis traps that will freeze those units but let's see if there is some potential here yeah there's so many stalkers out 30 is not number beyond anything that we really ever see now mana is kind of zoning them out with that powerful disruptor here in all the circles trying to target down some of these important units and actually picks off the disruptors so that was pretty strong and some fantastic micro blinking back okay there's not guys starting to get a little bit the ridiculous yeah I don't think a singles talking when done off to this point okay there we go okay losing a few of them here and starting to pick off some of the immortals now a stasis work gets tripped so that's definitely gonna help mana a little bit and these immortals are starting to do serious work yeah I know what we went over in a straight-up fight immortals are simply quite a bit stronger than stalkers but alpha star was displaying self phenomenal micro being able to keep these stalkers alive oh my goodness the stalker count is out of control yeah now it is 32 so we have even more than alpha star started with but six immortals and shield batteries and stasis Ward's should be able to hold on at this point no amount of micros should be able to save you here I do love that helps our is transitioning during all of this I love actually so there are a couple of tricks that we use in photos with protists without getting too technical here immortals have a barrier that can absorb quite a bit of damage now what pro players like to do is target the immortal with just one unit you can see a barrier go off and then you use the rest of your army to gun this immortal down officer is using this trick over and yes over again it is fantastic micro now we should point out that mana just warped in dark templars these are invisible unless you have a cannon possibly an oracle it has a spell that can see them or one of those observers that we saw in one of the earlier agents matches so do we actually have that there is an observer on the way right now for alpha star I believe we saw a cannon somewhere as well but I'm not a hundred percent positive about that there is a cannon yeah all the way in the back mata is actually targeting the robotics facility here yeah it's not a bad move okay so once again goes in these stalkers aren't getting softened up you can see on those health bars a lot of them have taken quite a bit of damage after these uh these dark Templars actually got recalled there by mana we can see these immortals of Sonic to do some very serious work here stalkers have micro potential but the damage output of five or six of these immortals from Anna that's simply too high and yet no amount of micro can save you in these kind of fights and now that he has these dark templars at home you know making an Archon mana is playing an extremely intelligent game right now like I'm very impressed with the control of alpha star the fact that alpha star is taken a third base and gotten the observer out in time to not die to the dark templars but mana is looking pretty scary here as well and we take a look at is that charge on the side of office time I don't think so oh he's already now this army of mana is very powerful and the immortals will always take care of stalkers but if alpha star would be able to by some more time for itself there is a chance that you know 20 zealots can show up and then 20 zealous can surround his army this L star is a base ahead yeah now these traits those seem to be going extremely well for amana it's like we keep seeing alpha start do that trick that you're talking about hit the barriers on the Immortals and then blink away not that much damage on these stalkers I feel like most pros would have lost all these stalkers by now multiple groups of stalkers being controlled here as well there are stalkers everywhere I think at this point mana is also wondering okay what am I going up against because this is I mean not even the best Protoss players can often pull up movement like this you're really quite right about that all the Walker ISM oh that was a great pickoff right there I am getting the disruptor as well oh my gosh alpha star with the pure stalker strategy this is insane control though multiple armies being to go down and now it's just a couple of zealots and obviously stalkers are fat well there are still couple of more to get website but it's incredibly difficult to do this in a game of stockinette oh well you might draw units on the south side of your screen but at the same time you also have to do it on the north side and you know what's really kind of shocking about this is we went over the APM the actions per minute and it's not really that high it's it's an acceptable pro level of speed coming out of alpha star it's just the the decision-making of which stalkers to grab and pull back it's just so so nice this is phenomenal units control this is not something we see very often this stock is coming in from multiple angles as well a forward link at this point all of us are prepared this is just unbelievable like having mana has made so many immortals this game I can't even count how high and the fact that it has been defeated by literally pure stalker the the unit that be immortal most counters it's so surprising and GG is is called by mana there and I tell you you put out a wonderful game for mana it didn't work so I was very very disappointed I lost this game because I thought I have everything that I need to defend this immortals Oracle's of stasis shield batteries decent upgrades but they could have been better I had only plus one and very very late charge but like 80 mortal versa blink stalkers yeah come on if I play against any any human player they're not going to be microing these stalkers that that nicely so there he was triggered the alpha star was trading very well in the beginning but the more important I got the better it was for me and then in the middle of the map I was at the north I was attacked in the right side and the bottom side yeah like I can't see everything right so I was very very surprised the way that alpha star decided to engage into my army because my army like a straight-up engagement no micro wins 100% of the time yeah so the way that Officer Mike rode was incredible and I I really just to emphasize something you said that's very interesting right so in the game you mentioned well the APM's actually do look reasonable but not only the decision making one thing that is very hard for for us to also model is well not each action is created equal right so so the precision of the actions of alpha star is indeed maybe perhaps one of the advantages right like it's it's it's clicking not very fast but eight each click it kind of computes the quite a bit quite well what to do with with that sort of action right and you know that's critical to see like amazing games like the one we just saw yeah yeah yeah I mean I don't think we'll ever see another game like that because as far as I'm concerned there is not pro in the world that can really control stalkers in that way with that type of precision and deciding all these different flanks to move in on it was it was super human yeah we have seen a lot of fantastic blink stalker micro over the years yeah then often it comes down to having an army on one side and a lot of pros are excellent when it comes to controlling stalkers but then focusing on one fight but mana said as well in the middle of the map at one point our stocks on the left up side on the right top side and on the south side it technically is impossible to micro you know you can't do that because immortals hit so hard that if you are even late for a half a second you end up losing three four units very quickly and that can be crucial in a game of stalkers too and what we saw there that's not human yeah it was amazing indeed now we're not gonna watch replay number five right now mana can you kind of walk us through what happened in Game five yeah so Game five was the most bizarre one out of the out of the five so like vs. TLO you could see a couple of proxies bizarre strategies and in my games it was rather standard very good play by alpha star so in game number five alpha star decided to steal my gas and I immediately recognized the the decision that officer decided to steal my gas and I immediately prevented it so officer was a little bit confused and at the very beginning of the game he flew down a second pile on in my own base so at this moment I'm very very like confused and on the other side of the map I'm scouting I want to see what he's what alpha star is doing I see low ground buildings gateway in a cyber core not a - gate built not a warp gates research I am absolutely confused so what alpha star does on the other side of the map he proxies on Robo and wins with a proxy morale but just just barely with animals surviving surviving with a shield battery that was proxied as well this is a game I definitely recommend to watch for people who understand stalker and how PvP works so III lose the game number five as well and I am 0 for well 0 5 at that point 0 5 sorry yes so at this point now alpha star to Hanano against professional gamers what is this experience like for you mana to have gone through this and and lost you such a variety of plays and strategies yeah so I was going confident into this match right I knew TLO lost I didn't want to lose I'm a better protis player than teyla of course after losing 5-0 I have learned a little bit about PvP the way that alphas are played the matchup was not that something I had any kind of experience with it was very hard to judge whatever alpha star was doing and it was different kind of starcraft that i've ever played and it was a great experience for me to learn something new from anna died from an AI that is just so fascinating now what was your guys's impression having done this to to mana and TLO over the course of two weeks I mean that one week just improved your AI significantly in our opinions that that looked much stronger than what TLO was going against and just fantastic player can you kind of speak to that for me honestly the the best part of it all perhaps is what just mana said that he learned something he told us well I might try these I might try that because at the end of the day you know playing against AI is great but because of the way we train it to try to be mimic human play and so on some of the move some of the decisions maybe oversaturating probes maybe that's the optimal thing to do me we're really excited for for the community to kind of maybe challenge some of the wisdom that has kind of spread amongst top players and you know just also new years that are trying to learn the game and it's amazing to hear you guys actually saying that alpha stars discovered strategies that the top pros don't really use like actually you know overproducing probes in the nexus and yeah actually maybe maybe there's an opportunity there for us to actually look at what the AI is doing and see that it's maybe discovered something quite interesting for not just the AI to use but for humans what I'm quite shocked about is that obviously this was announced quite some time ago and you guys have been working on the off star for quite some time and the off side had played against elo obviously that's impressive and it was capable of playing Starcraft and it won against T los Prados but the improvement that happened within a week like whatever how do you guys think that happened because that is remarkable to me because that is completely new levels so much better yeah that's not one level above that's like three or four levels that's great to hear we I mean obviously the the games where were seemingly better and the player we playing against who wasn't playing in tough race was obviously also much better but yeah I mean I I think at the end of the day once the whole system works right there's idea of the league that grows it's in size and it learns more and more strategies and can develop a more solid Metta strategy of the game well that really worked and scaled to the next week as he turned out it might not Mike have not and I must say some of these games indeed are close I mean it's it's it's still kind of exciting of course to to see them and and you know that's that's just feel like this game is amazing right so but the improvement yet was clearly noticeable I would say yeah one thing I must say that I love as well is that it doesn't go for the same build over and over yes I think that proves that we have a pretty awesome game I tells is that there is not one optimal way to always play soccer after no certainly not yet at least I mean I don't think that this is the end so far and it's not the end of the show either all these replays are going to be online on the deepmind website so you can definitely check those out and I think everybody is going to be downloading this replay pack but we have one more match here tonight we're gonna have an exhibition match mana you're gonna play an even newer version of alphago right now it's it's gonna be a little bit different we'll talk about that in a second but for you coming into this match here tonight this single game it's still gonna be PvP it's still gonna be on catalyst what kind of mindset do you have you have like a I'm sure you've been thinking about this a lot how have you prepared for it so this is going to be the the revenge I hope so I mean I started one five zero versus steel of five zero versus me so it's 10 0 against the pro gamers and both Team Liquid so I want to defend the honor of team as well in sure so I've been thinking a lot about what to do and keep in mind this is still on the old part the Blizzcon path so I did not get to practice it properly or in my home so all I could do is practice in my mind and prepare the strategies in there all right well mana we're gonna let you go ahead and start setting up in wall mana is setting up let's take a look at some footage from when the match is actually took place in December the decades progress in AI has been measured by how well we've succeeded in playing the games the humans play we've already created systems that can learn to master chess and go and many people views Starcraft as the next grand challenge for the AI community a couple of months ago we made an explicit choice to try and scale up and speed up the Starcraft project the way we went about that was you have different versions of the agent compete against each other on something we call the alpha star League this one learning to beat that one this one learning to beat that one and that leads them to improve rapidly over time and discover new strategies the way it played you could see it was getting Starcraft has imperfect information and is played in real time it also requires long-term planning and the ability to choose what action to take from millions and millions of possibilities we were able to be done in the best divine Starcraft 2 player that definitely exceeded expectations the next step is we can a book in intro to play I think there's nothing better than you know a big external test like that to focus the mind [Music] if they can already beat me that would be incredible I really thought TLO would you know beat us no matter what happens just well done it's been amazing progress really amazing alcohol is not just two defeats these players alcohol is to do it in the right way good a little nervous because unlike a human player alpha star can see the whole map at once but we spoke with elo and created as level a playing field as is currently possible in particular alpha star can't react quicker than human player can no kinetic scheme or actions clicks per minute that human player [Music] I have really seen a pro play Starcraft up close the 800 clicks per minute I don't understand how you can clip 800 times let alone if doing 800 useful clicks [Applause] after the first match I knew nas was on and that I actually have to work pretty hard to to beat this thing I didn't want to lose credibly this just even held off I was surprised how strong the agent was [Music] I actually lost every single on the fire mentions hopefully I'll get to have a rematch where I get to play my strongest race well then I think I would be the TLO is an amazing player but he plays zerk and our Asians they proto's for now with TLO they were still that but at the end of it you know but yeah he's a zerg player and so now we've addressed that back i guess they need a proto specialist and that's why i'm here i'm hoping for a 5-0 not to lose any games but I think the realistic goal would be four and one in my favor I think he looks more confident and elo elo was quite nervous before [Music] the room was much more tense this time really didn't know what to expect he's been playing Starcraft pretty much since he's five I wasn't expecting it to be that good everything that we did was proper it was calculated and it was done well I thought I'm learning something it's not better than I expected it that would consider myself a good player right but I lost every single one on fire we're way ahead of what I thought we would do given where we were team unscary she's trying to digest it all actually very very cool I think that progress has been opportunity it's humbling knowing how many people are working on this project we'll start off to some of the top lines of the world these complexities are important to us because they're representative of something bigger they're representative of the challenges that face the whole of AI which happened yet been solved I think everybody's just very excited to see what comes out of this and hopefully then Starcraft is going to be a part of history when it comes to AI [Music] well this is just so exciting and while mana is still setting up a little bit we have a few questions for you guys kind of to lead like we've seen a variety of strategies but do you have like a game the strategy so far is there is there an agent of alpha star that is better than the rest so interestingly because of the way that alpha star trains we have this league where every single agent is actually trying to defeat all of the other agents it's ever seen before and what we've seen is that throughout training there's never been a single strategy that hasn't then been defeated by some new counter strategy and so in fact even when it comes to the end of the training we see that each of those agents has its own personal weaknesses and can be defeated by some of the other agents in the league so there is hope so what we're saying here for mana I what is different about this agent that he's about to play right so as I'm sure mana has kind of prepared himself to play this one game we also wanted to prepare something quite special for him so one thing that we kind of talked a bit about is the lack of a camera even though there is kind of an implicit camera that looks around and does about thirty screens per minute so instead of just carrying on training what we did is we kind of started an agent from scratch that would learn to utilize the camera explicitly so the agent we're gonna see and we can also show some footage of a previous version of the agent is actually an agent that in first person bill utilizes decides where to look what to do with the camera as well which perhaps removes you know some of these kind of in terms of furnace in one thing that we could say well maybe that part even though the agent you know still acts very locally maybe that's that's not so great about it so we decided to train a brand new agent really like you know hot off the press we obviously don't have pros to test this again so it's the first time we see it play like against you know such a caliber player we're very excited to see what you know what man has in in place and also I've seen some some vehicle you know moves or games that the agent has played so I'm hoping to do just here a really really entertaining game hopefully yeah it sounds a lot more fair but to me that also sounds like it could potentially be wicked and what we just saw because what we just saw was basically an agent that's all over the place microing stock is at three places at once despite the fact that it doesn't have superhuman speed or anything like that that still seems like something that's a lot harder to pull off with this agent so would you say it's weaker or does that not mean anything so surprisingly when we actually started to train this agent we saw that it started off a little harder it was hard if the agent to learn how to to play using the camera but over the week or so that we were training this this agent we saw that it started to catch up and eventually became as strong according to our own evaluations as their previous agent now of course that doesn't mean that it will necessarily actually be as effective against pro players it's in fact as oriole said is really hot off the press we just finished training these this neural network and it's literally just been put on this machine to play this game for and this is the first time we've seen it playing pro so who knows what's gonna happen alright so no big expectations one way or another it's going to be great we're gonna get into this live game just momentarily one thing we need to mention as Tim Orton from Blizzard was talking about earlier there is not an observer mode yet so what we'll be watching is actually mana zone of view you're gonna see what it's like for a pro gamer to actually play Starcraft 2 and so that's that's gonna be exciting it's gonna be fun a little bit more jumpy than what we were watching before but this replay as well will be on the deepmind website yeah on a personal note I actually I mean we saw all the games obviously not with an observer mode because it does not exist but it was exciting also to see the game from the player's perspective because you can try to god how he's feeling where is he looking at what's he worried about it's it's really also a different way to watch star curve that's quite exciting obviously we're not gonna see everything that goes on stack up using perfect information game and then also like just to note the indeed there's no observer mode but also it must be said that you know this is fairly like a binary mostly done for research the stacker of binary playing so you know obviously the the the live game hopefully goes well but I mean there are its it's not kind of production level so let's hope like the game works well but I'm just a caveat right so for us to be ready yeah the alright any thoughts before we get into this game now I just want to see a good game good game absolutely good game we're all excited ok very much of a Starcraft answer all right let's let's go into this game Ronnie and see what what mana can pull off now again this is Manas point of view it's the same map that we have bound catalyst so you see mana up here he's gonna be the green produce and of course we already know where alpha star is it's it's in the bottom right this is very fun for us because you know then and I had absolutely no idea about any of the games and having played we were absolutely kept in the dark about scores but what we did know is that there was going to be an exhibition match in the other day and the way that I've seen mana today is kind of similar to how I see him at tournaments he's getting a little bit and yeah excited but at the same time a bit nervous as well so you could really see that he is taking this match very seriously and after I saw those previous games I said oh absolutely and I loved the fact that they hid everything from us Ronnie I mean we got to kind of learn with everyone else that this was a 10 oh so far but you know now we get to see because as you said it seems like it could be a little bit weaker here because like that stalker game it felt like oh my gosh how can you how could you pull this off I mean the first agent it looked very beautiful the one that elo played really felt beatable even though we saw the yellow tried different strategies and Telos of course a great stalkers to play but he's a lot better with Zerg than he is with Protoss then the first game that mana lost him like okay that's a little bit sloppy mana if that would happen in the tournament we would really criticize him for it it's like okay that's a mistake you're not supposed to make sure that was your game but throughout that that's the fire axe in the five-game series it's like okay I can actually not blame you for losing this game I can absolutely not blame you for losing this one and then we just saw Game four and it's like yeah okay I don't think anybody would be dead so mana now has scouted he's playing a very standard game at this point and we see that this this agent of alpha star has decided to wall that top of that rant so you know we've seen that off and on but mostly not happening it's an interesting thing to know probably won't see adepts coming out right away from on it because of that it's so interesting to think that it's stalled itself that though cuz it has been you know laying against itself that reinforcement learning and that eventually you know one office star made two adepts and kill the whole bunch of pros like I should actually start welding oh my gosh the Alpha stars in a room for 200 years yeah get some very strong strategies one of them was to open up with still obviously following - point of Humana has not revealed us what kind of a strategy wants to go for other than the fact that mana open up with the stalker and the Sentry I'd still say this is the most common opening among professional stalker - it's good to scout it's strong defensively and it doesn't really have a weakness well overall style wise right now what we've seen for mana he's scouting a lot he's has a probe out on the map that he's checking a lot of areas with the stalkers have been back and forth so mana is being careful looking for anything alpha star might be doing on his side of the map that that could catch him off-guard mana hasn't seen a whole lot yet even though he has me scouting for everything yeah now saw units you I have not seen a single unit yet so if mana hands rise by monos approach here man actually wants to get you know very aggressive too many workers unless he's learning from officer was same process yeah no this is this is a real thing you saying that maybe he learned some something from this I mean if alpha star went ten and OH against pro gamers by over making probes maybe all of us have been under making probes the to gauge Robo opening is engine this is the most defensive way I think you can play Protoss with yeah autos even the Nexus for mana is quite late as we are watching - point of view - scouting at this point on the other side of the map and these spots at the office star a has a Stargate Wow also has a faster expanse and an Oracle being needs specifically so mana is to defend against this right away Wow really the decision-making here actually sacrifices the Oracle for a couple of centuries so that's III don't mind that at all from alpha star I like what he did I mean that's a personal preference right like obviously picking up centuries of your opponent is awesome and mana losing two centuries that absolutely stinks but I think in general I would prefer to have an Oracle alive in this face in the game than picking off two centuries book well there is a second Oracle on the way Rayna I just caught it on the mini-map so I think we are gonna see one fly-in towards that main base and we'll see if once again alpha star wants to go for centuries or maybe something else now alpha star is actually attacking right to the front with these stalkers the same time the second Oracle shows up in the main base as well imagine a world where office star would have had both Oracle's alive at this point damn the stalker aggression combined with two Oracle's would have really paid off but this is still nice it's an even game but alpha star is definitely dominating the pace of this game right right now this really looks like I'm watching a professional human gamer from the Alpha star point of view you know watching the fact that alpha star is coming into the main coming into the natural you know we kind of see hey there's that second or go you were talking about as well so now Horrible's is showing up and at this point the shield by the way that mana has in his mineral lines okay the micro and the Oracle is really good at this point yeah the Oracles are excuse me the shield battery is out of energy at this point as well which means it cannot heal up these workers anymore and all of us are has picked up a tremendous amount of workers of mana I'm getting chills right now they eat like what we're seeing from alpha star this feels so far like the most human-like game that we've seen just the Oracles coming in harassing you know maybe the the century trade wasn't something every pro will do but overall very very good stuff now mana is fighting back though mana is defending everything kind he's lost probes and want Offutt doing a bit of counter damage and getting some scouting done as well I feel man I got a lot of damage done here with just two adapts that's not a massive investment in this space in a game and these are the apps definitely paid for themselves I am incredibly impressed with everything that alpha star is showing when it's attacking when it comes to defending it seems like things could be cleaner yeah so mana is still getting very good scouting Intel with that observer seeing exactly what is going on in alpha stars base and that's such an important aspect of this you know Amano wants to know like is this going to be mass stock organic kind of looks like it actually decided to go for his own Stargate all timing yeah officers already going up to three base them in the amount of workers that the Alpha star was able to pick up in the first few minutes of this game as mana is cancelling that's target matter yeah this really starts to seem paying off and I think that office actually pretty far ahead in this game yeah alpha star is just playing so smartly and comes back in with double Oracle once again eliminating quite a few probes but it mana did cancel at Stargate like you mentioned like he's getting so much scouting Intel that he does know what are the right choices for him but the fact that mana is sitting here like if you see someone making a bunch of immortals to you know counter your stalkers what do you do you take a third nexus and that's exactly what alpha star has done here we all I mean I love the mobility of the Oracles the Oracle seems like they're never away from the keyboard they're always active yeah flying in again once more picking up I mean normally we have an observer in space where we can tell exactly how many work has been done if I would have to make a rough prediction I'd say it's been 25 but yeah in this game you've got more than that and in Starcraft terms that is a ridiculous amount of workers to pick up in an 8-minute yeah it is a huge amount now it seems to me that mana is going to be relying this game upon tech right in the superior tech he has a warp prism right now with immortals in it he's trying to get upgrades he's trying to utilize these units to counter stalkers once again it didn't work in that other game but maybe here I like the positioning of the observer on the left side of mana you can see that mana knows about these stalkers coming back as well I think mana was a little bit worried because the stock account was so high that perhaps office I was actually able to just close out the game on the other side of the map so man I start back and these immortals are I mean this is a dangerous game that mana is playing because if this war prison bells down you think it's safe to say the game goes down yes I think you're right but if mana can continually lure alpha star back that's a way that mana can actually gain an advantage another Oracle being produced by the way I mean one stalker being walked in in range of these immortals models absolutely striking back here - playing brilliantly like you see those stalkers continually going back and forth alpha star either doesn't know or doesn't care about the observer watching his movements so mana is just going in and out every time alpha star leaves mana comes back in now this is kind of what I'm used to seeing when humans battle ai's right is you're you're finding something that they're doing that's a mistake and you're making them do it over and over and over but you know in defense of alpha star officers are still up on three base but you are spot-on well mana was doing there was correct I'm curious to see or I mean I'm curious to find out why offside asides at this face in the game it feels like it needs another Oracle while you would normally say in a professional game you make a single Phoenix you shut this war prison down yeah and you move on with your business and you start focusing on attacking a single unit of that's target good shut this down but instead of star and yet another Oracle and it does keep track of the war prison it's nice it's using the Oracles to watch the war prism but you're very right if you make one Phoenix here mana has to stop this this more prism play absolutely no mana has you would normally say a more powerful army but I think the numbers are yes so heavily in favor of alpha star because as annoying as that immortal you know kind of harassment that your moto attacks were in the main base of alpha star I don't think it did that much damage so I really think that there is a chance that officer has an insane amount of units somewhere there are a lot of stalkers right therefore alpha star Manas army counters it pretty darn well look at this brain over these other two immortals this is like seven immortals here this is interesting to see as well cuz now once again mana is in the middle of the forces of office star and this is where things get very interesting especially with the new camera movement we went over before this game started yeah previously we saw alpha star be able to pick a partner army like this but Motta's army is stronger than it was in that previous game this is a ridiculously strong army the probes starting to go down heavily now where is out the star whereas alpha sorry I don't see officers units anywhere recall use perhaps unless all this talk has decided to attack on the other side of the map I mean it's a possible ship hit by now kind of just running around force field being dropped it really seems like mana has brought this game back even though yeah we would use the term outplayed normally I think in the first six seven minutes in this game mana was getting outplayed by alpha star at this point it seems like mana has created an army that is too much to deal with even though there's quite a few Oracle's actually that is a lot of Oracle's you are right about that if all of the anti-air units go away the Oracles actually can clean everything else up so we should not be counting out alpha star yet but alpha star I don't believe has really any mining bases so this is a very uphill battle right now for it well I think mana has done it and that's actually very impressive because mana was in a rough position yeah but it seems like officer was quite confused on how it should have dealt with the warp prism oh right yeah if there's one thing that mother found in all of the games that we've seen so far is that yeah the response to the war prism arrest was not optimal now the the harassment of that war prism was so important just the immortals overall it feels like the games in which mana has made a lot of immortals are the ones that were a bit closer but I mean hawkers still really trying to hold on it seems like this is the point of no return now yeah but the majority of the basis when the most of the workers have been picked off and you Oracle's are not going to save this game now we do know one thing and we haven't seen it yet because all the stuff has only been winning so far but then yes alpha star cannot ggl the start does not decide that it has lost the game and then leave it so mana will have to go to the wind condition which is to destroy every building of alpha star and as you see there are a few left alpha star has been trying to rebuild but at this point we know as professional commentators that alpha star has a zero percent chance to win what do you think are the odds if I'll start building a pile and then we write club side of the map watch enough replays you'll see some humans do that that's better and that is that GG mana has defeated alpha star what do you guys think about this game that we just saw cuz it's starting out brilliantly for alpha star yeah awesome it's it's great to see that he's really made it I think there was there the interesting war prism bringing up the two immortals that I think maybe confused a little bit alpha star but it was it was yeah it like the beginning looked really solid and mana has done a great great job I'm looking forward to hearing his thoughts oh I think he will have him here very soon absolutely he's actually coming up right now so we'll be talking to him in a second but it was what really surprised me about this is it started out looking the most human like that was the most standard play that we've really seen it really you could have mistaken it for a top to your pro but then mana starts to come back and tear it apart with that that harassment that's right so first and foremost congratulations to mana that was just an amazing performance though just really a just once it's yeah thank you good game good game if the agent doesn't DG but we can it wasn't like he really didn't want to leave like the game was over for a long time such manners no matter first question that I are free after the game is the first five six minutes or maybe seven minutes it felt rough like it it kind of felt like you were being outplayed there yeah the constant our Oracle Harrison but it did some micro mistakes I think there were times where the Alpha star could have saved some of the Oracles and decided to simply commit more or just fly around a little bit so while the the the first thing the feminists did look rough I still think I had that better unit composition and I could see what the observer that was my my planted to see how much I mean to see as much as possible of the observers so because in the in the previous series that I have played against alpha star I was in the dark I didn't know what is going on and the lack of information cost me cut the cutting the economy that means I will have less army with less army I can do a less stuff so with this approach to the game I was able to see what officer is go is going for and then just react accordingly yeah and you did it just a fantastic job of that I mean I I mean that was an amazing game you're the first human to beat the star has a pro-gamer you know you guys have any thoughts on that game other than what we've already gone over well I think the nature of StarCraft is that you know it's an incredibly rich and amazing space of strategies that can be played by both players and I guess part of that means that you know it's you have to play extremely well but even the very top players in the world don't win every single game and so I think it's really nice to see actually what happens on the other side of of the table when actually it's possible to reverse it and see how what happens when when alpha star actually loses a game and so it was I'm just really grateful for you to actually showing us yeah side of the game yeah I'm quite happy for forum Anna actually because he played really well in the Sirius so this is really really well deserved I think indeed well I want to say first of all I really enjoyed that exhibition as well was awesome awesome to see mana pull it back as well but I think a burning question is every Starcraft 2 fan has that's out there watching the screen right now is are we going to see office hour play the other races as well I mean what about Terran what about zerk is that something you guys are perhaps planning right so obviously these could potentially answer the question which is the best race in in star as a player I'm super excited to see how alpha star is going to play other races so absolutely would would be like I mean the approach we take here does not is not specific to to one race we really picked proto's just to kind of reduce the amount of matchups and so on but clearly we you know we we can just apply the same sort of technique to to get the all versus all matches and that would be awesome to see I think that's something we're all very excited yeah and to kind of build upon what you're saying here what is actually in the future for alpha star and for deepmind in this venture right so many of the sort of techniques we actually borrowed from other fields in particular the agent architecture boroughs state-of-the-art technology from from natural language processing areas like machine translation and so on so forth so one thing we're quite hopeful for is to kind of bring back or some of these ideas and advances towards those feels like kind of for instance not only natural language processing translation just any sequence modeling this is at the end of the day a very complicated sequence task the sequence of actions that you have to go through so for instance weather predictions like long term planning of a very complicated sequence that's something we would look forward to also thinking about now in the in the next you know few months and so on and in addition if you look at the history of AI there's often been a problem with systems which have somewhat learned for themselves but a very particular way to deal with the domain and that can end up being quite brittle and one of the amazing things about humans is their incredible capability to kind of figure out different ways to solve a problem and what we were after in and one of the reasons that Starcraft is such an interesting domain is that really encourages us to find algorithms that learn for themselves how to deal with a really wide range of different situations and hopefully become quite robust against them and we think that the Alpha Star League represents a step towards that kind of system well well I mean this has just been a fantastic opportunity for the world and the Starcraft community especially to see what you guys have been up to do you have any final thoughts so I'm actually my heart is sort of divided into two here I'm you know an AI researcher and as such I think it's it's kind of very satisfying to see the approach of a near network playing in such an amazing game such a stack of to play at the pro level I mean really challenging the best in the world that's been fantastic to see the progress and and hopefully people are excited about that and then in kind of my sort of Starcraft heart I actually like what I'm looking most forward to perhaps is these idea that man a kind of and I also said is very exciting for me perhaps us to learn something and actually we saw in the game mana was doing the probe yeah I don't know we maybe this will get a name so so I need you know it may have worked quite well for him indeed he won right so those sorts of things as a stack of former Starcraft player I mean I'm super excited about those jvd final thoughts I guess the the history of AI has been marked by a number of significant benchmark victories in different games for example when deep blue defeated Garry Kasparov in chess or when alphago was able to defeat Lisa doll in the game of go and I hope although they clearly still some work to do but I hope that some of the people in the future may look back at some of the events we've seen today and and perhaps consider this as you know maybe another step forward for what AI systems can actually do and and achieve well it certainly feels like it we want to thank the entire deepmind team and of course mana and TLO for the games don't forget there's gonna be a lot of information as well as all the replays the archived videos and everything going up on the deep mine site and don't forget there will be a reddit AMA tomorrow with Oriole Dave mana and TLO so make sure you tune into that and other than that thank you very much for watching thank you

Channel: Google DeepMind

Views: 2,589,876

Keywords: science, ai, starcraft, starcraft2, artificialintelligence, technology, computers

Id: cUTMhmVh1qs

Length: 142min 25sec (8545 seconds)

Published: Thu Jan 24 2019