How to Replace a Phone Screen in Fusion - Blackmagic DaVinci Resolve VFX Tutorial (Advanced)

you guys ready for like you know more of an intermediate Advanced compositing tutorial infusion well so am I let's replace a phone screen with some interaction infusion here we have a very nice piece of footage with a little green screen phone and scrolling through the feeds you know what I'm saying today we're going to replace this screen with the digital screen and make it look pretty darn realistic so how do we do such things well first of all I would recommend if you're going to follow along with this tutorial that you are pretty familiar with Fusion if you're not and you want to be you should check out our Fusion Basics course it'll help you understand the need to know awesome stuff about doing visual effects in fusion and if that's not enough for you I we even have an advanced course so that being said I'll try to explain everything that we're doing here I'm going to make a little bit of room on our interface I'm going to get rid of our page navigation and also get rid of our toolbar so we have a little more screen real estate here and we need to do a couple things so why don't we just take some notes I'll get a sticky double click on this one thing we'll need to do is track this screen because it moves a little bit not much but a little bit I'll need to get rid of the green screen put in new screen put in Reflections and that should be pretty good that's a pretty good little Hit List there so I'll put this little buddy just off to the side there just so we know what to do I'll call this to do so first thing let's do is track the motion for this screen screen does move around a little bit if we were to not track the motion this would look dumb you all people don't believe me just throw a background in here and we'll just see if this looks like it's on the screen no it doesn't it looks dumb look at this looks bad we don't want to do that so we're going to track this motion I'll start really anywhere it doesn't matter I'll start in the middle of the clip if you do have something that has like a big sweeping motion or something like that it is a good idea to start sort of in the middle of that motion rather than at the end or the beginning but this it doesn't really matter very much I'll just track in the middle somewhere and let's make a planar tracker p-l-a-n-a-r that brings up the planar tracker in our select tool palette or the Patra as I call it once we have the Petra then we're going to select a portion of the screen that we want to put a whole bunch of trackers on and so I'm going to track all around this screen and I'm going to track in kind of a big c and a big square e c track in all the edges we don't need to track the green part of the screen because there's not really any contrast there anyway and we also don't want to track this part with her finger so if I move this back and forth her fingers moving around but everything else is kind of just staying where it's at okay so now that we have that I'm going to go over to our inspector and here where it says track we're going to say set for our reference time we started at frame 28. for our tracker we can leave it Point motion type instead of perspective I'm going to switch this to translation rotation and scale the reason for that is because this isn't changing a lot in perspective it's not getting like rotated or anything like that so it's kind of facing away from us or something and if we don't need to add that kind of motion we probably shouldn't because sometimes it can just mess the track up because it's more complicated than it needs to be right so the further up this list you get the less complicated things are and you generally want to stick to as close to the top as you can translation is just Movement we have more than that we have more than movement and rotation we have movement rotation and scale and we might be able to do just movement and rotation but we'll call scale good and everything else should be good and I'm going to select track to end and we'll track this to the end I'll hit go go back to our reference time and then track backwards there we go and let's see how that looks oh yeah I think I think it did a good job now we're just going to let that chill for a second let's make a background I'm just hitting shift spacebar to bring up this menu I'll type BG and we'll do the old background test we'll just make a red rectangle merge this over everything and we'll just add a rectangle mask to it and I'm just gonna like kind of make this a little smaller than our screen so we can see in very high contrast where this is at in the world I'm going to match the screen there this is just to test to make sure that our track is working you can do this a bunch of different ways but I think it's nice just to see if a big rectangle sticks to the screen I'm going to put this rectangle into the background because I want this mask to move with the rectangle let's take this planar tracker and say create planar transform I'll take this planar transform hold shift and drop this in between our background and our merge and now that's going to apply the motion from our tracker to that background now let's see if this looks legit let's Zoom this in okay it's looking pretty good it's looking pretty good looks good up top let's look on the bottom yeah buddy that's looking dope okay so we have a good track that's great we don't need this background actually but we are going to use this planar transform here in a second we don't need the planer tracker anymore I'm just going to move that out of the way and I'll look at this baby we already tracked that screen boom next we have to get rid of the green screen okay whatever you say to-do list so I'll get rid of this extra merge here and we're going to key this screen just because they conveniently put a nice green background on this let's go to media in I'll hit shift spacebar and type Delta that'll bring up our Delta keyer this is the tool that lets us select green screens and get rid of them so I'll grab this background color eyedropper here grab this and just drag it onto my green screen and that's going to do a pretty good job to start out with just because we have a very nice very even green on this phone if I click into this viewer and then hit a that'll bring up our Alpha and it's pretty solid we do have a little bit of kind of Gray so what we need to do is make this mat be perfectly white and black pretty much so let's go over to matte and I'm going to take the lower threshold up a little bit that's going to make more things black I'll take the upper threshold down a little bit that's going to make more things white and it's going to fill in these holes right here so I'll take that and just fill that in white and that looks pretty good now we have perfectly white and perfectly black and I'll click in here and hit a for Alpha again and now we have this screen removed one thing I want to do with this Delta here you always want to do this this replace mode right here where it says soft color turn this to Source because then it's going to take away all the random junk that it adds I don't know why but it adds a bunch of junk trying to get rid of this extra green spill and it just makes everything look bad so it's better to just deal with this in your own way than to deal with all the crap it does to this image speaking of that let's go to Fringe and here under spill method here I'll bring this over so we can see it let's switch this to well done and that's going to get rid of a lot of those problems spill suppression kind of gets rid of that green that's going to do a pretty good job here that's probably going to be fine this is probably going to be the worst looking frame and it looks alright it's okay so we're going to call that good for now and we might refine that later so we got rid of the green baby all right we got to put in a new screen show let's go ahead and just make a screen of some kind gee I don't know what should we put on a screen just I mean you can really put anything but you know when you can do anything why not add a kitten let's go ahead and put a kitten on this screen the way that we're going to do that is we're actually going to put this under this piece of footage we can do that a bunch of different ways but a way to do that would be to add a background I'll hit shift spacebar type BG this is just a black background see told you and this is going to be connected directly to our media out so now we have a black piece of footage and we'll take the Delta keyer take the output from there and merge this over the background and all this is going to happen over here towards the right this is going to be kind of the last thing that we put over our image now we have a black screen instead of that we want our cat on the screen so I'll merge this over the black background let's make a transform node and we'll scale this down there we go there's our King King bing bang and I'm going to do part of this wrong just to make a point here for a minute this is a really really common thing that you'll run into in Fusion let's take this planar transform which just has all of our tracking data in it anything that we run through this is just going to move along with our phone I'll take this hold shift and drag it in between our transform and our merge like this and it's supposed to move this screen along with our phone what it will actually do is some weird thing where the screen moves around and it slips and it looks real weird okay that's not what we want why is it doing that we have our cat we have our screen we've tracked this what more you ask for the problem with this is our sizing this image is about 3 000 by 5000 pixels it's a different size than the background that we tracked and so I don't know all of the reasons why but it gets confused because the sizes are different so what we need to do is make the sizes the same so that it will move this screen in the same way as it tracked the phone so there's a bunch of different ways to do that probably the easiest way to do that would be to just merge this over another background here so I'll just copy and paste our background I'll take this transform merge it over the background take this merge and put it into our planar transform so now we have a black background here and we're merging this cat picture over it and we're taking this new comp right here and we're moving that around with our transform so now look at the difference of this going on and it sticks perfectly to the phone it's a terrible problem took me forever to figure that out when I was starting fusion and now you don't need to figure that out because I just intelligent all right so now we have the cat it's beautiful look at that screen it's just amazing okay put in a new screen and we actually forgot a step here we need to add motion so sweet we got rid of the screen but look she's interacting with the screen she's editing it and scrolling up that kind of thing we need to move this picture along with this motion that she's making here show we're actually going to need a different picture this cat has done well but we need some friends as well so what we're going to do is actually copy a asset that I already made prepping this tutorial because I don't want to make it again but I'll show you how it works this is what I've called a cat array if you double click on this move it up what this is is a big long white background with various cats posted in order like this was an Instagram feed something like that and we're going to take this thing and we're going to merge this over our black background so now again we have the 1920x1080 just like regular sized video and we have our screen over that we're going to want to animate this and move it around so let's shift space Spar and make a transform node now we can move this around and you see where we're going here it's going to be great let's just take this down to kind of the beginning here maybe we'll scale this a little bit to something pretty reasonable like that and now what we're going to do is match the motion of her fingers here as she touches the screen and kind of moves it and Scrolls it we're going to move this to match that motion so let's kind of scroll through this until it looks like she's touching the screen maybe right about there frame 11 or so and let's make a keyframe right here at the center like that and now as she moves up she kind of lets go maybe right about there that's where we're going to have another keyframe let's look at where she touched here on the screen like right about there right on the Cutie's chest and so here we're also going to move this so that it's in between the Kitty's chest so it moves along with her finger like that okay so every time she touches the screen or stops touching the screen we're going to add a keyframe so we'll just scroll through here like this and looks like she touched it right there set a keyframe and then she Scrolls up again yeah and probably stops right about there there's another keyframe so she touched right there at this second set of keyframes let's move this up a lot like the next cats something like that we can adjust this later we'll start right there she's touching right there at that grass and then here we'll move this up again so she's coming that up like that so now as she kind of swipes up uh looks like she doesn't really swipe up for a little bit so let's move this back down so she Scrolls like that okay that's the last time she touches the screen so now this is going to sort of work let's take a look at what this looks like so she's gonna grab the screen and kind of throw it up like that she catches the screen and throws it again this last keyframe we're gonna push this up to actually something like that again we can go in and adjust this and it's amazing how not uh careful you can be and have it look pretty good so yeah that works that works we do want to make this a little better though so I'm going to adjust this Movement by selecting our transform and going up to the spline panel and opening that up and here under transform one under displacement click that and this will be a graph of all of our animation here so we have our first keyframe where she starts moving it and then she let's go and it keeps going for a while and we want this to kind of by itself slow down a little bit so let's take this and we'll just hit F on the keyboard to flatten this out a little bit and then I'll take this second keyframe and hit s that's going to smooth out this first keyframe and it's going to kind of ease into that second keyframe until it kind of stops same thing here let's flatten this last one and S to smooth this out and now let's take a look at our motion grabs it moves it and it kind of slows down ever so slightly before she touches it again that's kind of how a phone works yes whoosh looks pretty good I'd say looks pretty good so now we just matched the motion of her scrolling just by seeing where she's tapping on the screen when she starts tapping and then when she's done we make sure that her finger is basically in the same place so as we move over here it's similar place so it's going to move the speed of her finger in between right because it goes in between so here's four it's like right at the top of this and then after again it's like right at the top of these little armpits right here now whoosh we might even want to flatten this out a little bit there we go now that motion looks pretty nice last thing we want to do for this motion on this transform node under settings make sure that we tick motion blur I like to have motion blur at about four makes it look nice without being too crazy we also want motion blur on our planar transform make sure that's a thing and something that's starting to stick out here is there's kind of a little halo around her finger here you can kind of see this this is from our key so we want to make sure that that is taken care of we'll go back to our Delta here and here under matte let's go ahead and bring this up in our second viewer too and I'll hit a so we can see our matte let's just push this threshold up a little bit that might be all we need to do now we have kind of this black halo around there which we might be able to adjust with a little bit of a road and a little bit of blur might be messing with the side a little more but it might not matter that much how it is adjusting a little bit it's one of those times where I don't know if you'll care too much looks pretty good pretty solid we've added motion we've fixed green screen problems yes next is put in Reflections and also kind of color correct it so this is where uh I feel like a lot of um TV shows and everybody kind of stop and I'm sure there are legit reasons for that they probably have to do 50 of these in a day and they're like dude I don't got time to make this any better but if we do want to make this better look a little bit more realistic there's a couple things that we can do one is that this screen is kind of unnaturally Poppy and bright if you were to actually take video of a phone screen it's not this great looking so what we want to do is color correct this screen and let's do this before our transform so right here after our cataray we'll hit CC and bring up this color corrector and one thing we'll probably need is to boost up the lift a little bit the reason I think that is because this part on the phone is almost black and if I Mouse over this black right here and I look at the little numbers that pop up down here in the lower left red is like 0.6 green is 0.4 so it's not all the way black it's not perfectly zero okay point seven point four something like that and here in this black part this is like way way darker this is almost black this is really really dark so it's .007 so it's nearly zero so what we want to do is take this lift up just a little bit so I'm going to hold Ctrl and just push this up a little bit probably more than I think I need to and then Mouse over this yep that's too much take this down and now we've brought those blacks up so here's before and here's after we're just kind of washing out those darker tones and look at the difference here this is before this is after like it already looks a lot more realistic just with that lift adjustment same thing with the gain what's the brightest thing in this whole shot here we have this nearly at one so that makes sense that's really really bright but like bright skin that kind of thing is like 0.8 and so pretty bright stuff here should be about the same and point a yeah something like that we might be able to just take the gain down a little bit just so it's not the brightest thing in the world yeah just kind of taking that contrast down making this look a little bit more realistic now if this is a phone commercial you might not care that much if this is uh realistic but if it's actually a shot that's supposed to look real that's not showing off how amazing the screen is yeah this is probably a good level to have that at okay so that's pretty good the one thing I want to do is add a little bit of reflection a little bit of glare because that'll also help here we can easily add that I'm just going to get rid of some of our other stuff and we'll take our cats and our background move them to the left so we have a little bit of room here in between our fake screen and our actual footage and here's where we can put a texture or anything we want I'll go to the media pool and I have this smudge texture here I'll bring this up so we can see it it's just a bunch of kind of smudges and stuff this is really really helpful to have on hand if you're doing visual effects I'll take this and merge it over our screen and yeah so now we have these kind of smudgy parts I'll how to transform here and just scale this down to be a little bit closer to the size of the phone and this looks like we sprayed spray paint on it but if we blur it add a lot of blur like this then it looks like some kind of weird reflection right we can take this merge and here under apply mode Let's go to screen and now we have this little reflection that we're adding so here's before and here's after and again just makes it look a lot more realistic so easy to do that I don't even have to track it because one a reflection wouldn't track perfectly on the phone it would have its own kind of rotation and stuff and two it's so blurry and so subtle nobody's gonna care okay so we're just gonna paste it over there all hack like and that'll help add a little bit of reflection and it's going to go a long way for making this look like a realistic phone comp so nice now one last little piece of advice now this is optional but I mean it's not really optional but it's one of those things where you might not notice it you might get away without it but it's really a good idea to try and match the grain of your shot okay there's a few different ways to do that the easiest way the best way to do this is to just remove the grain from the shot and then add fake grain back in over everything so how do you remove green well we want to take our original shot this is this media in one right here and if we zoom in really far and we look at something like the blue Channel we can see there's all these little Speckles that are kind of happening right here this is that grain animated noise that's in every shot ever what we want to do is get rid of that and you can do that with some built-in Tools in resolve but I really recommend I mean I'm all for using the native tools and resolve but honestly reduce noise which is a open effects plug-in from the guys at neat video is the best man literally okay here's why it's the best you don't have to know anything all you do is put this on the shot that you want to get rid of the noise for click and drag and a place that is noisy but is kind of all the same thing so something like a green screen or a background or a wall or a sky or something like that it has the same kind of noise all over it hit build profile hit apply and it will get rid of the noise check this out it reduces so much of that noise to where this thing looks beautiful and it doesn't over soften it it doesn't mess with the details or anything so here's the difference so it's getting rid of that noise and it's really not messing with the image too much which is the problem with trying to reduce noise in resolve which has great noise reduction stuff but you really have to know what you're doing to not just ruin your image this is so stinking easy man and now that that's gone we don't have any noise here we won't have any noise in our composited screen just type green and we can just put the grain back over everything and the difference is it's going to be the same grain over the fake image as the real footage I'm Gonna Leave the power up actually for a second and here where it says spread I'm going to take this corner down a little bit because I don't want to add as much green to The Brighter parts of the image I just want to add it to the darker parts for the most part so just kind of do something like that I'll take this power all the way down and I'll push it up just to where it's noticeable maybe take the grain size down a little bit just to add a touch add in some of that grain back in and we can see on the left we have our original grain and on the right we have our new grain and we can make this kind of look similar then we'll be doing pretty good probably hard to see on YouTube but they look pretty similar and now look we have that same dancing grain here on the back wall as as we do on the actual screen which is beautiful that's what is supposed to happen so now we have our finished shot interacting with the phone looks realistic oh baby I guess that's she's not really scrolling through the cat's feed so there you go that's a little bit more advanced tutorial for all you Fusion nerds out there and if you do want to learn a little bit more about Fusion we do have a course which goes over all kinds of advanced awesome stuff working infusion make sure to check that out there's a link in the description below or you can just pop it you can just pop it right there bam you can you can do that I don't know it's there though and I we worked really hard on it and I think it's really good and if you like this you'll like that too you can make some magic it's a movie Magic

Channel: Casey Faris

Views: 34,475

Keywords: Davinci Resolve 17, blackmagic design, casey faris, how to, free video editor, tutorial, davinci resolve 18, davinci tutorials, editing, fusion, how to make a green screen video on phone, replace phone green screen, davinci resolve 18 tutorial, davinci resolve fusion, davinci resolve fusion tutorial, davinci resolve fusion effects, how to put a video in a green screen phone, fusion tutorial vfx, fusion tutorial davinci resolve 18, davinci resolve 18 color grading

Id: Q7B4OHEj1mM

Length: 21min 36sec (1296 seconds)

Published: Fri Dec 23 2022