Afterwork Shenanigans in the Virtual Production Studio - Join and ask questions

now go live on a so proton to eat alone [Music] [Music] taken on Sam come on Sam you feel of a fairly copper Posner the only thing Singham dance company nan-oh the Common Era oh yes hello guys or you're out there or are used boats let me know in the comments we're here after a long day work and just having a beer and trying out some stuff because unreal they released a new plane with the latest update that's called a composite plane and it's it's quite cool actually so we're thinking of trying it out a bit and showcasing it and I maybe can show how my setup is if you want to otherwise I can show you something else so we're gonna give it a few minutes before we start playing around and if you have questions just let me know [Music] Wahhabi wife tracking us a stir I left on that Oh perfect mmm hello Greg what's the time over where you are can you hear me we're hi Peter can you hear me and can you see me it's the first time we're doing this cool no I ain't using ray-tracing actually I've been I've been toying around with it but I haven't got I don't really know how to use it yet so that's something I really should look into if especially if I want to render out from unreal and make better CG backgrounds I guess cool cool cool so maybe we should start we don't have any plan or anything we just hanging out and been seeing what we can do with the composite plane and trying out and we don't have any any any lights to light our excellent actor Carla so the key will look terrible but I guess you know how to do it so Carla you want to join us let's let's see if you could get some cool stuff going so so the composite plane is really a billboard that's placed in the 3d space and you have a another camera that's projecting the live feed at the plane and that means that you can get reflections and shadows and also move around and is free to space as you can see here so as you can see you get the shadows on the on the table and you can walk behind everything and it's all yeah of course you have to tweak stuff but but it all works in synchronize with with the camera tracker how far can you go out can go out with him let's go I never see their our kitchen in the back yeah it's pretty cool so this is the White House model from from the unreal marketplace which is a pretty awesome model and it's always fun to be you know in the white house so how I get the shadows color can you go so we can see the reflections in in the doorway okay can you tilt the camera down and as you see can you back up a bit so pretty much what's going on here is where McCullough the guy outside he's pre acted on a plane and the plane has an alpha so the free world in our reader can read it and block shadows and block lights and cast shadows and cast reflections so this is something new for from the new version that are really released earlier this week and let's see I can show you how it's how I build it up I learn and how you do it so I'm gonna stop the livestream and I not stop the livestream yeah I'm gonna stop playback so let's stop it and we can have a look at how this is so this it's gonna see that so this is the scene location it's the parent of everything regarding the wife tracker and beneath that I have a a wife tracker and that's this is the wife tracker that the actor hold it and it's the same it's it's it's a blueprint based of Gregg Horsens blueprint which has an delay for tracking data and behind as a shine to the to that tracker they have used a simple plane with the material from the composite plane and then then here's the camera tracker it's the same that I've been using for a couple of months also based on great whoresons and this is my camera fix to get the wide tracker correctly aligned and here's the interesting part this is a new thing from this is the composite plane camera which is the prick prick it's projecting the live feed at the above plane so here is issues where I want to protect it and I choose my billboard and I choose which live feed I want the project and this is based of an alpha Channel it also has a keyring built in but I had trouble getting the key to work so what I did was create a compute composure comp like we've been doing for a couple of months and adding a color difference key here yeah Peter so he's holding the white tractor and that's why the plane gets tracked so he can walk around in Freda world and the plane follow follows him with with his exact movements and so I used the key with a new color difference key I did some erode alpha and I did a dis bill on the key it's the best I can do with no lighting so and here's the funny part I did render it to a render target asset and this is the same asset that I bring into the pro this camera where it's project pro sorry I'm Swedish what are you gonna wear I projected the live feed so it's pretty cool actually and but you have to enable the plug-in first by going to composite plane and just enable it and then you can find the BP scene camera pro so that's that's pretty much it so guys are you have you left the building already get back here we're gonna do some more tough so what what what should we try now guys Oh this Kabbah should we do more stuff outside or or move into indoors let's see where we are now we don't have a tractor or yeah we do yeah I'm looking at the wrong wall can you see yourself yeah do some cool stuff then yeah do the stairs Gregg are trying to find the link where I've found it there's really no documentation at all so I just figured out but it was quite easy and yes we use in the HTC why the tracker can you bring the camera closer bring it into the camera can you can you get that shot with the tractor yeah so it's it's it's the regular white tracker and we have two one on the camera and one on the table so when he's walking around he gets tracked in the free the world and what are the specs on the computer I don't know but I'm gonna find out properties I guess so here's the specs its e9 3 comma 6 gigahertz and the 64 run and let's see exactly what kind of we're gonna be fine it's a Titan I just gonna ride it Titan or Tex 2080 I never tried with the oculus tracker I only did it with the wife but I've seen some people do it with oculus so I guess it's possible a phone call you know and then your little Mir do some more stuff now your entire I'm even nervous give me give me go hit the mirror after manda yeah you could get the shadows in with the new plane it's pretty dark right could I maybe let's see if I can let's see if I can can I do this live yeah all right zero you got monitor data fused can we be somewhere we don't see the end of the green screen so I think you probably could get some ambient occlusion or something going but I haven't messed with it but it's but this means you can do a lot of stuff and you can also have the the plate react to the light that's in the Unreal world top of a moment Orion sorry can you see me now but the nice thing with having a play too is that if you walk into frame a bit salon so we can see you look at him when he is do a 360 I don't know nice period but salons era is that we can do a 360 without using a garbage matte yeah it's just a free reflected plane yes I'm gonna try to make some more tutorials but we are super busy in the studio making everything ready production ready and trying to do the best of it there is always something to figure out you know I have no experience of using a lead wall or on display at all so I have I can't really answer on anything regarding LED walls yeah you can use composure but composure is just too two-dimensional composite and this is a 3d composite and that's why we get the reflection and he can walk behind stuff because show show him the white wrecker can you hold it so we can see it as you can see he's holding a white tractor and that's tracking the plane around in free the world yeah we be doing some music videos but we were also I've been doing a short film and we are doing very a lot of you know pitching where we make something to show what we can do and that's stuff I can show really so but that's the really polished stuff I still think it's hard to do you know to get final pixels in are real because you have a problem with taa the anti-aliasing and also I guess you could get get a good key but I haven't played with the tears so much so I can't really know if I can get a good key out of the built-in unreal tears so but what I do is I record the plates and record a camera tracking data and then I do all the compositing in DaVinci fusion afterwards and now now we're shopping your leg yeah I don't know where to put the flight tracker when we're gonna do a shoot for real but there are some blueprints on the on the internet where you can do your own vibe tracker so pretty much you can do something very small almost like this type or I think Moses have a small thing so that's pretty much what we're gonna try to do or or you just put it on the back and yes we use I'm using a black mattock due to card but I probably want to upgrade to a 4k card to get better resolution all over but you know budget constraints Korona times we make do so what what should we something you guys want to see you're gonna lay down I think it's gonna look terrible but let's see regarding making lights that match unreal and vice-versa we're actually working on something with DMX and to have everything synchronized and try to do something cool with it but it takes time and everything is pretty normal in Sweden I don't know I don't know if you have seen the news we are not in a lockdown but everyone is taking it very seriously and doing the social distancing thing we are pretty good at doing the social distancing thing but we can pretty much go on as usual but there's no productions everyone is just trying to take care of their own nest in a way and trying to survive because all the business in Sweden is on the low end so let's see what we can do so long why everyone sounds the relevant I can call over be honest answer if int the camera is a bit off axis so can I get in there yes we are based in Stockholm I myself live in Uppsala but we were supposed to move here about now but since the corona thing everything is on hold a final filter community coming in student Ally in the rumen yes Scott it has changed a bit let me show you so I'm using the same blueprint both for the tracker that sees holding this is in his hand and also on the camera so now you see you see it's Lakes disappearing and that's because somebody maybe can tell me how how do I make the plane look at the camera at all times if you could if I can manage to find that out his legs won't be cut so let's say I have a look at the blueprint again so that we're always oh yeah you you rotate it too much you have to be on this side and now you're going behind walls but that's nice so let's find the track a blueprint sorry so my last tutorial like a second did it didn't December something unreal has updated a lot and also steamvr has updated a lot yeah you can great courses rig is awesome and that's also what I based my blueprint on and so this is pretty much it you guys can do a screenshot I try to share it as often I can when I find people asking on the forums but this is the one I use and this is just the tracker data going in and it's going through an array and I delay in it three frames I guess Greg and then it's going out but the funny thing I've found out too is that you can also let's see if I can find it to find unit even further you can so this is super massive but this is my experimental project let's see if I can find the black media bundle and see if I yeah so this is this is the black media bundle that takes the camera feed going in and I use the time delay to I don't know what's that 16 point 16 milliseconds oh yeah it is you who can see so I'm delaying the tracking data free frames and I'm delaying also the video feed with point 16 milliseconds or something and this is just something I experimented with and I think we are pretty close to having it locked in but we're gonna are gonna do further testing oh yeah get look get look rotation I actually looked at that before this a live feed but I couldn't understand how to do it so I will I will sleep on it and maybe fix it tomorrow but thanks I don't know if this is gonna be available afterwards it it depends on it depends I guess maybe is that is that a good thing to have it available afterwards I don't know this is pretty rough so yeah Greg the delay thing is something that recently got implemented I think because I haven't seen it before I just found it by accident after updating something yeah so you want to know something more I don't know I don't know I don't know show me that it's pretty low poly but it's a fun project to be playing around with so we're I'm thinking of low enough if you don't have any more questions let's see it's drops in oh yeah no I don't I think this thing solved the problems with the trackers so now I don't have to do anything actually it's the trackers used works all the time I did that finger egg where from your tutorial where I set up the trackers in in the steamvr interface and after well after I did that I haven't touched it it just works yeah scope what I do I have another computer at home where I do my posting so I can sit and work all through night and I what I do is I added the green screen footage first and then I export the background from unreal and since everything is time coded since there's a few versions back on our wheel it's really easy to match the 3d background with the live-action material so it's it's it's a pretty easy workflow and I also like the key afterwards because you have more control and you can always change stuff afterwards I don't have the blueprint available I don't know how to do that but I guess take a screenshot or tell me how I can share it I would like to share it it'd be awesome so the main important things are this hierarchy and on the blueprint I also I can maybe see if I can show you I have a let's see if I can I doesn't work I mean I mean trying to do I don't know exactly how to do it but I want to have like a mast master camera tracking blueprint or project where I just design the levels in another project or something and then I can import that level to the camera tracking project so I don't have to reset up everything for every new scene we're shooting so what I use is levels so I used import levels on top of the camera tracking project trying to find a blueprint I think I have it somewhere yeah I gotta find the blueprints or maybe I can do a screenshot there yeah I make sure you guys get it after the after the show so I'm thinking of long enough and then grabbing another beer it's it's almost 12:00 at night here and I think we did good job today so well I guess thank you for today and thank you for tuning in and and maybe we do this some other time it was fun take care

Channel: Richard Frantzén

Views: 10,328

Rating: 5 out of 5

Keywords: virtual production, unreal engine, composite plane

Id: CcLFF9lBYeY

Length: 37min 16sec (2236 seconds)

Published: Fri May 08 2020