How To Use Your iPad as a Virtual Camera in Unreal Engine 4

what up what up wimbush here and today i'm excited to show you guys how to use your ipad or your iphone within unreal engine for a virtual camera so without further ado let's jump right into it all right all right so what we're going to do first is i have unreal open right here i'm actually using a set that i got from the store i think it was free one month this is like a sci-fi kit so it's already put together it's already lit so i figured we use this for the example but first i want to come up to the settings come down to plugins and i want to come over to here where it says built in and i'm using version 4.24 and so i think this comes on by default but just in case it's not enabled you want to click on your search bar here and let's type in virtual and then you'll want to make sure that you see everything that's here so our take recorder our virtual production utilities our virtual camera just make sure all four things you see here are enabled like i said i think a version 4.24 and up everything is automatically enabled but you just want to make sure so you want to check that make sure it's all enabled and then we're going to come over to our window and we're going to come down to where is it at under cinematic we want to make sure we have our take recorder up so once we click on that this is what's going to activate it once we have it hooked up i'm using my ipad but if you have the iphone same thing is going to hook it up to that and so now what we want to do is you want to make sure that you go to the ios store so depending on what you're using let me pull up my web browser here so like i said i'm using uh ipad all right so i'm going to come up and type in unreal remote so i clicked on the search bar click unreal remote and this is the one that you're going to want to use so it's unreal remote too so we click on that and you're going to have to do this on your device but i'm just showing you what it is here so you come down and you see you have two different versions you have the iphone and the ipad like i said i'm using the ipad generation six for this example but this is what you want to do you want to make sure you install that onto your ipad and then you want to come over and i have the documentation up here but you want to come over and you're going to have to type in your ip account so let me actually activate my ipad so that we can see okay so now that i have my ipad opened up you can see in the blank box here this is where you're going to want to type in your ip address and i'm not going to bring up mine but over here in the documentation like where you have to type in the command prompt and then you're just going to copy and paste this in here so where it says ipconfig let me hit copy and then i'm gonna come down to my search bar type in cmd for the command prompt you open that up and then you're just going to paste in here where it says ipconfig you paste that in there and it's actually going to pull up your ip numbers and then you'll type that into your ipad and hit connect like i said i'm not going to do that just for security sake i don't know if you guys could hack it to my ip or not but that's just how you're going to do that and also i'll leave this documentation inside the description below as well because i mean you just go through here and you can run through the steps yourself but i figured a visual example is always best and so what do we want to do next we want to come over and i'm going to bring in an actual camera into my scene so over here on my left hand side i'm going to just type in cam and i'm gonna bring in let's say i'm gonna bring in a cinema camera here we go okay so i have my camera in here now and i guess we're good up on the steps area right there and then you can see down here my cinematic viewport exactly what the camera is seeing so yeah we'll start on the opposite side of the corridor here and then next what we want to do is we want to make sure we come over to world settings over here on my right hand side and where it says game mode override click on none and then come down to here where it says virtual camera game mode you want to click on that and you're going to make sure that now that you're in a virtual camera mode so when you pull up your ipad or your iphone it's going to connect it and give you the virtual controls but that's not the only steps you're going to have to do so now that we have our camera set up the next step is we're going to set up our ipad or our iphone to have full functionality whenever we're moving around with the ipad so what it's going to do is depending on the shape of your phone or your ipad like i'm using the generation 6 ipad so i'm going to actually be able to type that in there and it's going to know right off the bat that it can make it full screen for my device and you'll see the drop down menu you can actually pick any device that you want so let me show you guys how to set that up now so if i come under settings here up top and come down to project settings then if i come over to input what we want to do first is right here under mobile where it says always show touch interface mine has already checked on because i was using this earlier but yours is probably going to be checked off if you haven't used this before so you want to make sure that this is checked on and then we can close out of this window and then now we're going to want to come up to edit and come down to editor preferences and then over here we want to click on play under the level editor and right here where it says common resolutions this is where we're going to be able to pick out what device we have so once you click on it you see we have access to all types of different phones all types of different tablets laptops monitors and so what i want to do is since i i'm using the ipad generation six i'm gonna go to tablets come down to ipad gen six click that on and leave everything else alone and we should be good to go and so now what the next step is i'm going to take my ipad and actually hit the connect button on here and then i'm going to hit the play button over here but i'm not just going to hit the play button what i want to do is you click this little triangle here to bring down the pull down menu and where it says new editor window you want to click on that so give me a second to get everything set up i'm going to have to mic myself up with the live mic and then i'm going to show you guys what it looks like inside the ipad and on a computer when it's connected together over to wi-fi all right so i have my ipad right now hooked up to unreal engine and if i turn around you can see we have the doorway there so with my left hand if i click this little up arrow here you can see now we have on-screen displays and i can actually move forward with this controller and like i said i can make my camera go up and down with this one on the right hand side and then move forward if i need to and what's cool about it is okay so let me move back a little bit maybe pin up nope let me go down a little bit here so say i want to focus in on this touchpad here up here in the top right if i click the a button that's for autofocus so whatever is in the retinal here that's what's going to be in focus so now i can actually walk forward that might be a little bit too close but yeah something like that and i could bring that into focus i could step backwards and try to bring something else into focus but this is going to auto focus on whatever it's pointing at and then the t that's for whenever i click on my screen here you have to have the focus here but like so right here where it says focus i tapped on this arrow to bring a drop down you have to have that drop down down or else the focus is not going to work but if i tap on it you can see how it's highlighting that geometry so that means that geometry is always going to be in focus no matter where i go to so if i step backwards a little bit that door should stay in focus let me tap on it again and there you go and then once i click it up that means that it's not going to be that focus anymore so this menu has to be down for that to work and then we also have manual focus which i believe this has to be dropped on again and then if i click on it it's going to manually focus kind of like if you have auto focus on your camera when you tap on the screen and how it brings that into focus but i'm going to leave it on autofocus for now so like i said you could walk around let me see what's on the other side here so now i have this door over here and go walk forward a little bit you can see i'm moving up on my touchpad because my room is not big enough to really like fully walk around in anything and so having a touchpad here is really beneficial but like once i get close to something like this keypad then i can physically walk in and you can see that i'm actually moving around the room so now a lot of you guys are asking me how to get this hooked up so this is just a quick one-two step on how to get everything hooked up for your system like i said i have some stuff that's being shipped by amazon my final destination is i want to be able to hook my ipad up to my blackmagic camera that i have sitting up there and then be able to do this with the green screen like i did in my other tutorial so that we can actually walk around our environment in the green screen and still have full control over that so look for that maybe in a couple of weeks here but for now this is how you get your virtual camera working within unreal engine and your ios device so i know a lot of you guys have been asking for this tutorial for like a week or two ever since i started posting that stuff up on instagram show a mixmaster mic on top of mars with the ipad you guys have been asking me like crazy like hey how do you do it so hopefully this was a good step-by-step rundown on how to achieve that if it was make sure you leave me a comment down below show me what you guys have been working on with it and as always subscribe to the channel stay fresh keep creating and i'll see you in the next video take care uh you

Channel: WINBUSH

Views: 53,756

Keywords: motion graphics, winbush, unreal engine, virtual production, ipad, pro, 6th gen, apple, ios, ue4, virtual set, virtual camera, how to, setting up, 4.24, 4.25

Id: PktWwOs5jek

Length: 10min 34sec (634 seconds)

Published: Fri Apr 24 2020