Add 3D objects to your footage | After effects MASTERCLASS

so last week i posted this on instagram and it was a mix of a few things that i've done in the past 3d integration specifically and you guys seem to like it and had a quite interesting reaction to it and so today we're gonna learn how to integrate 3d into your 2d footage and sort of replicate what i made on instagram and also this technique applies to a lot of other things and you'll be able to create various things and and i know this is this is a really long tutorial i think one of the longest that i've ever made around 30 minutes but trust me this has so much backed in it and and i promise you're going to learn so many things here and i can't wait for you guys to enjoy this so let me know what you think and let's just jump right in here we are in after effects i'm gonna import my footage and yes i've shorted vertically so i'm gonna just rotate it back to its position and yeah the first and the last few bits is a little wonky in terms of camera and that's gonna be a problem when we track it so i'm just gonna crop them out i'm gonna find a suitable point even at the end where we can chop it off and get a good quality cut around 15 seconds seems like a good number so that's what we're gonna do just chop it off at that point and yes so what i've noticed in this shot is there's a lot of highlight you know the screens kind of reflecting the window towards the left and that's causing a bit of fade of the color there so what we're going to do is take a lumetri chest so we can clear all of it and kind of bring all these levels to us to a place where we can work with it's clearly not the final product and we're just going to use this for the data that the footage has [Music] all right now that we have this our next step is to sort of mask out only the phone so that we track only that space and what what we're basically doing is we're not tracking the scene from my perspective of the eye rather we are creating a camera that is sort of locked on to the phone so we'll have to mask out if any other distraction and only use the track points that the screen has these black dots to kind of create a 3d data the masking doesn't really have to be clean it's called a garbage mat and we we're doing this very roughly just so that we have enough of the phone so i'm just gonna fast forward because you i'm telling you guys you do not want to see the pain i'm in all right so now we have some sort of a rough mask that i've applied throughout the video so as of now we only have the phone and we have a black solid underneath it so what we're gonna do is pre-compose this create a precomposition called track so now this will act as a footage to track data from now typically what you could do is apply a 3d camera tracker to this but what i've noticed in my experience is that it doesn't really go according to plan i mean i knew this was gonna happen but yeah so i've figured out a workaround and that is basically to kind of export this footage that we have now and then re-import it and track that one so that we can then use the data from it and we don't really have to use the footage but so what we're gonna do is sort of export an intermediate file that is a prores 422 you can keep the settings as it is and this just going to export it so i'm just going to fast forward this as well all right so we're just going to drag the footage back into our scene and we're gonna do the same thing that is use a 3d camera tracker and track out the scene so once we have that i'm pretty sure we'll have a solid track which is quite precise and first things first i'm just going to select all of it and create a solid and a camera that way we have a scene set up all the hard work is sort of done and what we can do is we can get back our original footage so we have something to work with right now we just have something black and green and that's not gonna do i'm pretty confident we've gotten a good track but just to prove it to you guys i'm going to put like a text layer and kind of make it 3d so we'll okay never mind all right so now we'll know what we're working with and we'll see it in real time so usually such layers take a very less resource so now we know that it's acting the way it should so we're all set and we can all start the fun stuff the stuff that you've been waiting for i'm going to create a new solid and let's call it landscape and once we've done that we're going to add a plug-in called element 3d so it's pretty popular you must have heard of it if not it is a must for your after effects work and once we add this it's going to take a while to load we're going to click on the scene setup so this is where you import your 3d stuff and you make all your 3d work happen so i've already made one and i have a landscape that i've used for my earlier work but being the good guy that i am and it's the holiday season and stuff i'm giving it to you guys so you can follow along so in fact i'm giving all of the assets that i'll be using today and it's down in the description you'll find all the required textures in the folder but let's let's start with a bump or a normal texture so basically that is what adds undulation and it determines the lighting and shadow for your work so make sure you enable the convert bump over here so that it's actually translated into your model and that is an important step and one of the key um textures that you need to put so diffuse and reflectivity and all of this can be played around with to achieve different effects so for example i've just taken a height map and plugged it into the occlusion so now you know there's like this really weird effect that we're getting so it can be manipulated in different ways in inside we have a few options of gamma contrast brightness and it's all up to your experimentation and what your purpose with this particular model is yeah you can play around with the tools and you can explore the different aspects of this and once you have something that you're satisfied we can go ahead and click on the ok button and that will drop the model that we just worked on into the scene so now what we're going to do is we need it aligned to the phone screen so what we're gonna open up element 3d so you're gonna open up the group and particle replicator and now we're gonna get the x y and z position so a good way to manipulate all of these is by creating a group null so what it does is it basically creates a null layer where you can manipulate it just like how we do for other layers of after effects and it will actually change the model itself so you don't really have to go into the menu of element 3d to do all your tweaking you can just apply it to your null layer if you notice that your model seems to be disappearing it's because there's a option that you need to check which is draw back faces so whenever you click on a material make sure you enable draw back faces so that it renders out both sides of your 3d model so now we have our model ready but i think it's flipped so we're just gonna play around with the orientation of it and the scale to just get it right and get it to the way we want it to look all right in a typical scene which is well lit and there's a green screen you can directly go ahead and apply a key light effect onto your footage and select the green color using the eyedropper tool and we'll sort of get a clean result more or less but we have to sort of tweak a few settings and that would be under screen map elements like clip black clip white screen d spot screen d spot black and white softness all of these are things that you can tweak and get a perfect key but in this particular shot like i told you earlier we have our window on the left creating a glare on the screen of the phone which is why we are losing out color over here so we're just gonna do a same trick of using a lumetri and trying to figure out a suitable color tone over here that is under expose the highlights get back the green color so that we have a footage to work with all right once you do this and i'm just going to place the lumetri above key light we'll have a pretty solid mat so the next few steps is a bit important so i'm gonna try explaining it as easy as i can so what we're gonna do with the footage that you've just color corrected and we've done all this stuff only so that we get a clear black and white information of where the opacity levels needs to be zero and where it needs to be a hundred so we're gonna just duplicate the file clean out everything so that we have the footage the way it is right and we're gonna use the screen mat and provide information to it we're gonna do that by using a luma mat and a luma matte is an option that you select by pressing the toggle mode and then select luma mat so that way now we have the information of blacks and bytes being portrayed onto our footage so we completely cleared out our screen and we'll just bring down the landscape to get behind the phone and we don't have these weird edges over it awesome i think this looks pretty cool it's doing what it's supposed to alright so the next step is typically this works and we've just figured out a new way to key but sometimes there's a lot of leak in the sense the green spills out and after effects has a really good combination of preset for keying to exactly combat this and you can just search it it's called it's a combination of key light key cleaner and an advanced spill suppressor so what it basically does is it's the same process it's like you pick out your colors and refine it but the extra few uh additions of the effects lets you actually clean out the uh remaining colors from it so you know the remaining green edges that might otherwise be visible so this is another good alternative for you guys to use [Music] all right so if you're smart you're gonna notice that there's a bit of color in the bottom footage which is the original footage and the reflection of the screen has been cast onto my fingers and an easy way to get rid of this there are multiple ways you can get rid of the green so what i'm going to do is just go to the lumetri and just pull down the saturation of the color green just like that and it's already gone you can also uh change the hue to towards something more of a skin tone right so you can pull it upwards until it reaches a color that sort of matches the skin so this is just one way to do it that you might have a lot of different cases where you might have to try using different strategies but this is easy and it gets the job done so cool and yeah about the smartness earlier i'm sorry i was just kidding i know you guys aren't smart at all all right our next step is going to be to recreate the lighting conditions right so i'm just going to create a light a point light maybe and if you notice i've put a sort of bluish tinge to it and now that is because i can notice there's a bit of blueness in near my fingers and the palm so i'm trying to get as close to it as i can and i'm just gonna find like a right place to achieve the right shadows so something like this seems to be a good light and obviously the light is again gonna move along with the phone it's not really stationary so it's just for that first few frames where people are gonna actually notice it you know so we're trying to get the immersion happening and then it's just gonna follow along the the camera so you can do this or you don't have to all right now the next step is going to be the sun so we're going to sort of emulate a sun that is right next to the mountain and for that i'm just going to duplicate the light and try to find a suitable place but now if you notice i i'm not really trying able to find the right point for it so the good part is we have our footage with the track data all you have to do is open up the 3d camera tracker tap on it and then you'll find a few points now you can just right click create a null the moment you do that you have a lot of information in that null which you can just copy and paste into your light so now i've just copied the positions i'm going to rename it sun and i'm just going to go open up the position of it and paste it so we have it right over there and if you notice it's just gonna follow the camera and this is exactly what we need perfect i'm gonna slightly change the position of it and sort of kind of recreate a sunset kind of scene and i'm just going to grab it and take it a little upwards i think that should do cool now the way we're going to recreate the sun is by creating a lens flare and i'm going to use optical flares by video copilot on a new solid and this is a brilliant tool i've been using it for as long as i can remember so here we're going to switch on the track lights because you already have lights in the scene and we have uh the letter right so we can actually rename our sun and i didn't think through i'm gonna rename it light now yeah and we'll have a crazy sun so we can put the blend mode into reveal on transparent and now we have a perfect sun that is causing realistic flares tada are cool opening up the options will give you a bunch of presets which you can browse through and i found that there's a sun preset that i really dig and it's kind of kind of looks crazy in the scene i'm gonna use this one all right so the next step on the list is to make particles so we're gonna emulate snow we're gonna try to recreate uh this environment of a snowy mountain right so we're going to create a new solid and we're going to apply a plugin called particular so i'm just going to rename this particles and effects console particular and this is another amazing plugin that you guys need to have it and yeah i'm just going to open up designer it's going to take a bit and there are tons of presets here as well we're not really going to go in depth and create from scratch but we're just going to take from the presets and i'm pretty sure uh there is uh there is i think quite a few snow presets to pick from i've just taken one right now and yeah i'm just gonna try to move the layers so that i know the particle has been generated usually when you use a particle system it starts uh producing particles from zero onwards so we're gonna take the position data from our track um and we're gonna place it into the position of the particle system so that we know the system is right near the phone i think the particles are way too small so i'm just gonna increase the size of every particle and uh increase the diameter as well sure why not there we go i'm probably gonna try five yeah five seems to be a good number um pardon my ocd i'm just gonna rename all of these again otherwise i think i might myself i'm not gonna get confused i have no idea what's gonna happen to you guys [Music] and also yeah i've forgotten you guys have to enable motion blur to all of your uh assets so basically the landscape the snow the sun and that's just gonna add a whole level of beauty to it [Music] the orientation is all wrong so i'm just gonna play with the emitters rotation values and match match it to the the scale of the phone also if you notice the mountain seems to be higher than the phone in terms of its horizon so we do not want to over complicate it by masking out the peak of it so what i'm gonna do is just go to the 3d system and just pull down the mountain a bit so that the whole 3d environment is below the surface of the screen if you know what i mean um i think you uh you'll know once the there we go yeah i'm just going to play with the orientation just to make sure we have it properly aligned to the surface of the screen that all right that should do i guess cool so as you can see there's a black spot which is the background and it doesn't really have anything so what we're gonna do is add four planes to sort of close this whole mountain right so i'm gonna create a plane i'm gonna rotate it and yeah if you notice there you see the drop back face needs to be enabled to this material as well so i'm just gonna um enable yeah all right show back face and yeah i'm gonna just resize it i think they should do yeah another thing is i'm i'm going to make it more of a glossy material so i want an end product to be sort of reflecting the mountain and one way to do this is we have to go to the reflect mode and mirror surface so right now so now it reflects everything that is on the scene and it's the software is brilliant dude i'm gonna play with the glossiness and the reflecting values just to try getting something that i like so here i'm putting a roughness map uh reflectance whatever it's called here it's a roughness map basically so i have this uh sort of this earthy texture now what we've noticed is so the white and black value determines how rough the surface is gonna be and we get an interesting effect oh wait it's on top my bad so we we're gonna replicate this on all the uh four sides so i'm just gonna fast forward this bit so you don't have to waste our time your time and my time and and there we go this seems really good and i'm happy with how this is turning out so i've quickly quick quickly made a ramp review and so we can see what are entire rendered timeline looks like if you notice there's the track points that's still remaining on the screen and we've this is our next step we are going to clean it off and this is pretty simple you can just mask create a mask in the screen and go forward in your timeline and do a rough tracking of it like you know add keyframes however it's moving and we put the the mask option so uh hold down m on your keyboard and that opens up the mask and you can select the subtract layer to it and now we don't have it anymore uh and our next step is going to be to add a depth of field so i'm gonna enable it in the camera and we're just gonna quickly check if our uh focus point is is right or wrong so all you have to do is apply keyframes and then find the right point in space where your focus is spot on and i'm just going to follow this bit as well cool all right so now let's get into the whole hologram part of it you know tex overlays of text and stuff i'm just gonna open up the track solar duplicate it now we're just going to use this as a reference right as a as a frame as a block and yeah you need to make sure that you've switched off accept lights and accept shadows etc so that it's not influenced by our lights in the scene and what i'm gonna do is try to position it to where i need and for now i want it on the top right of my phone so i'm just gonna find the right position so now once you have that set what i'm gonna do is i'm gonna right click and pre-compose and let's we can just call it text i think we're gonna leave all attributes outside and what we'll have now when we double click is just us empty space so now we don't need that green color space but instead we are going to add a few texts and i'm not really gonna show this bit i'm gonna skip through um and i have a title animation tutorial that you can check out to make some interesting titles but what i am gonna show you is an interesting way to make this rgb leak in led screens or lcd i think and what we're gonna do is we compose all of our text and we're gonna duplicate it thrice yeah so we need three instances of it and what we're going to firstly add is a grid effect basically this is what is going to create a pixel sort of an effect onto your text and we're going to go with slider and just you know moving it across until you find what works but i usually keep it around this range so that we have very smaller pixels some 25 should do i guess and yeah we're gonna tweak the feather and the border so maybe the border is gonna stay at three four play with the settings here and see what works i also add usually a one or two of feather so that it's not really too sharp and the blending mode for this case we're gonna use a screen all right so i'm just gonna copy this and paste it through the rest of the comp and now we are going to use an effect called set channels basically we are restricting the channels in rgb and that's why we have three of them so we're gonna have separate channels for each of these and basically we are actually squeezing out all of the colors and putting them back in so each of the layers will have red green and blue and the rest of them are switched off once you have that once you've separated the red green and blue channels we're gonna screen all of them so we're gonna put the blend mode screen remote screen and voila you have something crazy i mean it doesn't it looks the same but the moment you start moving the positions of these layers is when you see the magic and we've created that leak right rgb leak and there we go you can notice it you can actually uh intensify it by pushing the position farther away but this will do for my preference i'm just gonna turn the blend mode into screen because i'm not really a fan of it popping too much and it's just subtle right so i'm just gonna screen all of this into the frame now that we've done all of this our next step um before we move on to the next step i just want to show you guys so this is a plug-in called optical glow by again red giant and basically this is just another glow tool right to achieve glow and i've put this on top as an adjustment layer so that i emulate this glow out of the screen and i haven't really focused on this in this in this tutorial because it's not really of the concern but it is just a filter that i've applied and that is why you can see the sort of faded misty effect to it just too much information for no particular reason all right all right next on the list is this interesting thing i'm not sure if you've noticed but if if at times you look at things through a glass you notice this double layer that you it's sort of this refraction feel and i don't really know how to exp how to explain it but we're trying gonna try and achieve it and to do this i'm simply just gonna duplicate the layer drag it down and maybe put a fill and completely whiten it and then obviously i am going to remove the opacity maybe 15 15 should do and basically it's just that subtle reflection kind of quality that we're adding and trust me guys all of these little things add up to sort of form this beautiful overall imagery the placement of it so that it doesn't look too fake and it sort of acts like a reflection underneath the layer i'm just going to move it slightly so that i can achieve it [Music] another another cool thing what i'm gonna do is i'm gonna duplicate this snow layer and now we have another set of particles right i'm just going to increase the overall scale of this so the ammeter size is going to be massive all across so now what this is going to create is a few particles in the air and the as the phone moves around these particles move along with it but the distances are too great so they form this really crazy effect and that looks so cool and and this is what we're looking for these weird crazy stuff all right i'm gonna rename this as environment just so that i'm a little more clear on what i'm working with in the similar fashion like our text effect i've created another one which is the song that i'm going to be using in this particular video right and that's sort of like this spotify's playhead and i thought it's an interesting thing and it's the same process and this is pretty much about it and with a few extra things and something of your own and a bit of color grading you're gonna achieve something like this all right that was a really long tutorial and i hope you guys stayed through and learned something new today and i'm so glad that i could make this and help you guys out a lot of you have been asking how how to integrate stuff because i know you guys are into it and um i hope this helped and if it did drop in a like say something on the comments you can ask question or or request a tutorial and i'll make it happen and if you're new here consider subscribing if not enjoy you can share the video to your friends and i will catch you guys in the next video until next time a small party [Music] [Applause]

Channel: SMAL

Views: 3,737

Keywords: 3d integration after effects, how to add 3d objects in after effects, 3d phone tutorial, eduard ov tutorial, ar tutorial after effects, after effects tutorial, hologram effect after effects tutorial, hologram screen effect - after effects tutorial, hologram after effects tutorial, tutorial hologram after effects, augmented reality tracking in after effects, after effects tutorial motion graphics, ar glitch after effects tutorial, fake 3d after effects tutorial, after effects

Id: 9D-YygITeNw

Length: 32min 11sec (1931 seconds)

Published: Sun Dec 13 2020