How to send live camera footage into Unreal Engine: Using Composure in UE5

hi my name is jovan and today you'll be learning how to send footage from your camera live into your unreal engine scene for real-time compositing i'll be using ue5 but this works with previous versions of unreal as well so what you need is a hdmi transmitter i use the elgato cam link this works great i use a black magic pocket cinema camera and allows me to send the footage from my camera into my computer to then be loaded up into unreal engine to connect your camera to the computer you need to use a hdmi cord and this hdmi transmitter and then just physically connect them in you can also use wireless transmitters but i'll be doing this wired because it provides a better and faster connection usually and is a lot cheaper then open a new unreal scene go to edit plugins and enable the composer add-on it'll then prompt you to restart now with a little button in the bottom right corner click this and it'll reload up your unreal scene then go to window and click on composure compositing this might be under the virtual production tab in the top left corner this will either open a pop-up window or a new tab on the top right corner next to your world outliner which will have your composure settings there then right-click in the empty space in your composure compositing tab and click create new comp then create a new camera in your scene by going to the top left corner clicking create cinematics and then dragging a cine camera actor reposition it and then go back to your composure tab right click on the newly created comp and press add layer element and add a cg layer this will automatically select the camera in your scene then right click on the comp again and add a new layer and choose media plate if you can't see any of the stuff that you just created you might just have to click the drop down arrow where the comp is which will expand what you've created then to add your real camera input go to your content browser at the bottom of your screen right click and click media player and tick the video output asset here then open this media player go to the top left corner and click the folder icon and go to video camlic 4k a live feed from your camera should appear here if it doesn't try unplugging your cam lick toning off your camera and trying this process again then once you see your feed click save and minimize a window don't close it or it won't actually work go back to the media plate in your composure tab and go down to the details tab click input inputs media source and drag your newly created media texture from the content browser onto the empty media texture in your details tab this should now appear in your unreal scene in the bottom right corner to key out the green screen in the details tab of the media plate go to the transform compositing process and click transform chroma key and press a little plus icon next to key colors here you can use the crosshair button and select your green screen there are some parameters below to further refine your green screen if need be you can also add another key color if it needs further corrections finally to combine your footage with your own real camera select the comp in the composure tab go to the detail section and click transform and then press the plus icon next to the transform passes expand this new section and where it says material click on it and create a new material for your comp open your material by double clicking on it and then a material editor click on your material and then go to the details section on the left side of your screen and change the material from surface to post process to make sure that your output is correct then right click and search for a node called texture sample parameter 2d rename means to be your media plate and your cd element make sure the names are exactly the same or it won't work then combine these by right clicking and creating an ovo node and attach both of these to the rgba sections of your texture sample parameter nodes to the a and b sections of the overnode and then connect the rgb output of your overnode to the emissive color section of your material save this and that's it to see your comp right click on it in the composure tab and press preview this will make a pop out of your comp if you can't say anything go back into your material and try and switch the cg element and the media plate in your material so making change from a to b to b a and then reposition your camera to properly suit your scene if you want the virtual camera to move when your actual camera does then you can set up a tracking scene using an ios device or a vr tracker i have a video in one of these corners on how to use the ios live link app there is a new updated app that just got released a few days ago and once i get that working you'll have a video on that as well you can also alternatively use a vr tracker which hopefully wants to figure out how to do that you'll be able to use as well it's very popular to use a htc vive but that's extremely expensive so i'm trying to figure out how to do this with an oculus quest 2. thanks for watching this video i hope you enjoyed and learned something new if you have any questions or comments please leave them down below if you like what you saw and want to see more i make four videos a month or something blender or unreal engine related so if you want to see more of this kind of content feel free to like and subscribe thanks for watching and i'll see you next time

Channel: Jovan Tomasevic

Views: 3,023

Keywords: unreal engine, composure, tutorial, green screen, keying, live, ue5, ue4, blackmagic, bmpcc4k, bmpcc, blackmagic pocket cinema camera, compositing, real time, cam link, elgato, camera

Id: xK9WqOmJbAs

Length: 4min 5sec (245 seconds)

Published: Sat Sep 25 2021