Realtime 3D Video Production is here! (Unreal Engine Tutorial)

[Music] oh hey guys i was just taking a walk in my desert which is actually just my green screen studio anyways guys everything that you see behind me is all rendered in real time yes even the camera movement right now but this is all possible because of unreal engine big thanks to them for sponsoring this video and guys unreal engine is free to download so you can just go ahead and do that and follow along with this tutorial video and see how we created all of this without any prior experience yes it's that easy let's do this [Music] smooch if you didn't hear me so there is some work to set everything up guys because we need to wirelessly send a video signal over to the computer then unreal engine is going to process that basically doing a green key and then it's going to have to send that back wirelessly to the camera so that way we can see in real time what we are keying out [Music] [Music] all right guys we've set up a big green screen that you don't need this size of green screen of course but later in this video we're going to try to work with camera tracking as well and then this is going to be helpful now your idea today is to do a live green keying and replace the background with an environment created in unreal engine now in order to do that we're going to have to send the signal of the camera which is currently done wireless through hdmi over to the computer and let's check out how that is done over there so here comes that hdmi signal which is being sent through a capture device now we are using the cam link which basically transforms the signal from hdmi to usb 3.0 now you can also work with something like the blackmagic products they also have certain capture devices that doesn't matter you want to bring it into the computer and then into unreal engine to do your live screen keying but that is something for lorenzo doing a live green screen in unreal engine is actually very easy in the software itself you have a library where you can install a ton of plugins which can help you out with whatever task you may need and in this case i use composure which makes real-time compositing super easy i set my cg layer the desert and my media plate which is the camera input and composure and with a simple click of a button i was able to key out jordy i was responsible for building the world an unreal engine and to be honest as a first time user it was very easy to work with of course i watched some tutorials to learn the basics but once i understood those basics i was off creating giant worlds with ease now for the assets that we used in the landscape they all came from the mega scans library from quicksole this is a huge library full of 3d models 3d textures and the best thing it's all for free if you're using unreal engine they have this deal set up with unreal engine so you can download as much as you want and believe me guys their library is super awesome super realistic and makes it even easier to create such realistic worlds in unreal engine now for the landscape itself i just dragged in some assets positioned them where i wanted i used some foliage to make it more realistic so everything is more combined into a real world and then there's the lighting personally i find lighting very hard to recreate in a 3d environment but the lighting feature in unreal engine really amazed me with just a few actors or lights you can create such a realistic light setup we use a sun simulation and some atmospheric fog to create this moody vibe and that was really it our light setup is done easy as that however the best thing in unreal engine in my opinion is that you can work real time when creating stuff what you see is what you get and this makes your workflow so smooth so believe it or not but i created this entire desert world as a beginner in just a few hours which we can now use in our green screenshot alright guys now that we have the green key working which is awesome we're gonna have to try and match the lighting a little bit with the unreal engine scene the compositing is done and we were able to change the lights and the environment and everything in real time i really believe that the way that we create vfx is changing just seeing what unreal engine is capable of creating photorealistic renders in real time is really something guys it's super easy to get into and you're not wasting time with rendering now we are still new to this but if you can see what some of these professional creators are putting out it is astonishing i can barely tell whether this is 3d or real you know what i think guys it's unreal this looks really good like it looks so realistic as well you wouldn't say that that is 3d so we can say that the green keying is successful but now let's take it to the next level we want to move in our scene with our own camera let's do some camera tracking this is the easiest episode we've ever done guys like seriously it's just doing a drinky that's it or at least for me i mean yannick built the world and lorenzo figured out the whole keying and tracking for me it's the easiest episode all right we've just done the green screen test and it went perfect this is something that you can all do at home you just need a green screen and unreal engine which is completely for free now we're gonna take this to the next level and also move this camera around at the same time we want the background to move as well so we're gonna have to figure out a way to send over the movement of this camera to the computer now since we have a vr setup here in the studio which is through the valve index we can actually use these controllers to send the movement over to unreal how cool is that lorenzo really cool i don't have any clams for the controller so this is a little bit diy but it works and yet again i use the plugin library that unreal has and right there they have this live link plugin and what this does is easily take the tracking data from our controller and put it in into the software once that was done i connected the virtual camera to the tracking data and now when we move the tracker around the virtual camera followed our exact movement next we attach the tracker to the camera so that our virtual camera takes the exact same movement of the physical one since we're working with a wireless transmitter the movement of both plates originally didn't match up our tracking data was faster than the camera input so i needed to add a small delay for the tracking data in the live link settings to sync it back next up i use the sequence recorder to record our scene in here i only added our virtual camera because we only need that footage to record our green screen we simply press the record button on the camera itself we could record and use the composure output which is already keyed out but we only use it as a reference while filming since what unreal gets is a downscaled and compressed hdmi signal it's best to record a green screen with the camera itself in our case we even get red raw so we're going to sync both recordings and pull a perfect key in [Music] post-production [Music] it's like i'm filming in the desert right now guys i can just feel it i'm so thirsty now something really cool about unreal engine is the way you record for example we can capture this nice pen movement in our desert but what sequence recorder actually does is not record the screen of what's happening but it creates keyframes of our camera and from here on out you render your shot this means once you recorded your scene you can adjust it without having to redo the shot we can easily change where the light comes from add or remove objects keyframe focus pools basically anything you want [Music] so now this is a pretty cool environment as well guys well actually this is a demo project created in unreal engine 5 which is currently in beta but everyone can try it out you can download it from your epic games launcher as well as this demo project isn't that cool guys go ahead and download unreal engine have fun with it you can click the first link in the description down below to learn all about it thank you so much for watching guys thank you unreal engine for the support and as always stay creative you know what the real challenge is now guys that is for the actor i have to pretend to be in the desert [Music] it's really hard now who put this stair right here

Channel: Cinecom.net

Views: 215,843

Rating: 4.9378028 out of 5

Keywords: unrealengine, ue5, madewithunreal, virtual production, epic games, unreal engine 4, virtual reality, virtual cinematography, virtual camera, game engine, visual effects, 3d animation, unreal engine 4 tutorial, vive tracker, green screen, unreal engine tutorial, unreal engine 5 demo, virtual set, real time, unreal engine 5, unreal engine 5 graphics

Id: 2k1QTEDOcYA

Length: 9min 13sec (553 seconds)

Published: Wed Aug 11 2021