In today's tutorial we are going to see an add-on called GeoTracker. It is a geometry-based camera and object tracking system. and it is developed by Keentools, to whom I want to thank for having left me the licenses to show you how it works the Add-on Thanks to this tracking system we will be able to integrate into our scenes 3D elements and being able to do any type of special effects that we can think of. The best of all is that we can also use Facebuilder, which will allow us to generate a reference head based on real geometry or frames that we take from a video and texture everything from Blender. And what's the best of all? Which is free. Geotracker for Blender is in beta version and you can download for free until the final version is released. Today we are going to track a head, we are going to take a character and we're going to make that a three-dimensional reference head moves perfectly following the movement of our object. In this case a person. When we already have the estimation of our camera and all the movement of that head calculated, we will be able to integrate any type of object. What I have done is integrate a science fiction helmet. Well, then The first thing we will do is go to the Keentools page, keentools.io and from there we see how we have Geotracker for Blender. We download the free beta and in Blender we go to Preferences Addons and we will install the file we just downloaded. Once the addon is installed. We have to download all the additional files they ask us for and it would be ready. We go to the side panel, select Geotracker, and we are going to click on Create New Geo Tracker. We select the clip we want to track and press zero to enter the active camera and be able to view it. In camera options we also have the size, the sensor of our camera And if we want another hacker do the calculation of the focal length, I'm going to click on it And I'm going to select, re-analyze or analyze if it's the first time. I select the frame range and geotracker does its magic. You will analyze forward, backward and when you are done. should appear. The focal length with which the clip is recorded. We select Facebuilder, let's create the head which will help us do tracking. We click on New head and Facebuilder has generated a basic head for us. If we want to personalize it, we need images. We are going to take frames from our clip and for that we go to Geotracker And from the clip context menu we say Take snapshot. It is best that we take Snapshots at different moments of our clip so that our character's head can be seen from all possible angles. This will make it easier to create correct geometry. We click on Add Images, we add all the images we have created And they will appear listed here under views, with a camera that has been generated for each of them. I'm going to click on each one of them and I'm going to say Align Face Geotracker what will try to do, is to align the most important parts, such as eyes, eyebrows, nose, mouth with sample clip. Let's go to model and what we're going to do It is to activate the lower part of the neck because we don't need it. Now we have to repeat this same process per clip. If in any of them when you click Align Face you get an error, We can take that image directly from the context menu and delete it. As you have taken enough references, as long as it works for us an error, we take and delete that image. We will repeat. The Align face with all the views we have. And now what we have left to do is refine the position of that geometry. Each of these red dots are a kind of handles that will allow us to deform the mesh. We can create new points if we need them simply by clicking. now what we have to do is to adjust in a finer way using those points or creating new ones. And so we are going to make the geometry look as similar as possible to the shape of the model we have used. Let's repeat this step view by view. And when we are done we simply click on Exit Pin Mode. That generic head that hasn't stayed. Facebuilder has now been warped to look as similar as possible to our original model. From here is where you put the texture. What we are going to do is generate a texture. Which will be based on a projection of each of the images that we used. We can select which ones we want, click OK And feis builders generates this texture for us. To make tracking easier. What I'm going to do is turn off the top of the neck as well. We can now go to the Geotracker dialog and select the geometry with our head. We click on Start Pinmode. And we're going to have to reposition the head again, but this time there's no Align Face, So we have to do it by hand. But it's very simple. We simply have to click and drag. We will rotate the geometry until it matches the frame in which we are standing. From here, apparently, we have this Wireframe option, What it will allow us to do is make the mesh more transparent or not. To better see the video below. We finish adjusting and when it fits completely With our reference video, we can now start tracking. we will click on Track to end and it will start to stay from the point we are at towards the end. If the track, for whatever reason, has not been perfect and as you see here There have been some mistakes. I can move to a frame where there was an error And reposition your hand on your head so it fits perfectly again. Every time I make a movement by hand, a yellow keyframe is generated. That unlike the green ones that have generated Geotracker, these are the ones that the user has generated. When you have finished fixing all the trouble spots consider, what we are going to do is refine the tracking. Let's click on Refine all. And all that track information that Geotracker had generated It will be updated taking into account those adjustments that we have made. Yes, there are two frames that we have modified very close to each other. We can delete the interpolation between them to prevent them from having errors or strange movements in between. I am seeing that from this point on the tracking is not correct and what I'm going to do is delete all this information by clicking here And I will analyze from this point to the end. And we repeat the same dynamic. We look for points where the mesh could have moved, We position and when we have positioned, Refine all. This is the tracking result and it is already much better. I'm going to play it. to delete the same area as before, because those two points are very close. And by deleting those intermediate keyframes, the animation will be much more fluid. When I'm happy with the animation, I'll exit with Exit Pin mode And now the head perfectly follows the movement of our video. I'm going to take out the top part of the neck that we had hidden. And from the Scene menu we have the option of Geometry, Linked and Export. This will create an Empty that has exactly the same animation than our head. To this we can link the object that we want to introduce into our scene. In this case, what I am going to use is a helmet that I found on Sketchfab It is a free model and this is the creator. Victor Colpaert. Le damos a Download 3D model And since I had already prepared a separate scene with that model and its textures, I simply tell Append and the collection that contains my helmet. Now I have to match the position, rotation and the scale of my helmet With the head animation that Geotracker has generated for us For that you must use a free add-on that I have here at Tool. It's called Snap Object and with a single click it makes an object inherit the rotation, position and scale from another. I'm going to finish adjusting the helmet by hand, I'm going to reposition it, I'm going to rotate it a little if necessary. And with the head selected when rendering We have to mark Holdout and Shadow Catcher visibility. With Holdout, the head will act as a mask and the transparent one will be rendered. And with Shadow Catcher we will render only the shadows that you receive so that it is easier to compose later. Now what I have to do is link the movement of the hull with the empty that Geotracker has generated for me. I select my helmet and drag inside the empty pressing Shift so that both remain linked. For lighting and for the reflection map. What I want is to use an HDRI. From Shading I go to World, select background and with Ctrl+T I get the Environment Texture option. Remember that Ctrl+T is because I have the Node Wrangler add-on installed. And we will load our HDRI and now we can go to Layout again. And our scene would be ready to render. I'm going to render it with Cycles give quite a few samples and what I'm going to do is activate el Denoiser. And after compositing in After Effects, This is how my helmet turned out. bueno. I hope you liked the tutorial. I'm going to leave you in the comments the links to Keentools so you can download Geo Tracker and try it. And the sample material that I have used is also on the Keentools page. and I'm also going to leave you the link to the free add-on Snap Object, which is one of the ones I use in my tutorial. If you liked it, leave a like, subscribe. If you are not subscribed, activate the bell. This way you don't miss anything Of all the content that I'm going to go to periodically uploading about VFX and Motion Graphics. And if you want to help the channel a little more so that it continues to grow, you can buy me a coffee on my Kofi account The link is in the video description. and nothing, until the next one.
