How YOU can set up VIVE Mars Camtrack UE5 ICVFX Virtual Production with VP Toolkit

[Music] every day so first we're going to go over the connections  on the Mars cam track system first we have   power USB which will be used for any type of  firmware updates you have HDMI and DisplayPort   which are used for external monitors we have a  land Jack which is connected to our Network TCN   which is time code in this would be a reference  to your Productions time code today we are using   two Rovers which are our actual trackers these  are connected using the supplied Vive ethernet   cables and we're just using two of those today  but this unit supports three of them and then we   are running gen lock from a sync generator into  our live Mars so to power your unit on there's a   power switch above your power connector the unit  will take a little bit to start up foreign [Music] so this is the main UI of your Mars first  you have time code which if we had a Time   code supplier or what's called a tentacle system  connected to this you would see the time code of   your cameras or production you have gen lock  so this will display your frame rate of your   gen lock sync we have the Rovers which you can  see Rover one has a little icon next to it that   means that we have a lens encoder connected to  it we're using the low lead Indie Mark Mark II   you can see that we just have two Rovers  connected and then you have base stations   this will display how many base stations  are on your stage and visible or active here's an overhead diagram showing how  we have our base stations configured   we've set up three base stations that are  mounted to the overhead diffusion frame   we also have multiple base stations floating  around the set on stands when props get in   the way of a base station we power that  base station down using remote power and   then we recalibrate our system by  doing a recenter on the Vive Mars foreign so first we're going to go into our network  settings and we're going to go to Mars Network   so by default the Mars is set up to obtain  a IP address automatically that will use   your router or whatever is handing out IP  addresses on your network to determine the   Vive systems IP address or if you need  to do something manual and set your IP   address you can set your IP address here and  then apply settings you want to remember that   this is the IP address of the Vive Mars not  of the machine that you're sending to we're   going to obtain the IP address automatically  for our setup today and hit apply to power   off or restart your Vive you just hit the  power and then power off restart or cancel so before re-centering your Vive Mars you want  to be very specific about how you set your root   Point otherwise known as your zero point or your  tracking origin at the form stage we measured from   each side of the LED wall to determine the  center of the stage and then we measured the   distance from the center of the LED wall outward  5 meters and then labeled that using marking tape   so you can see here how we've set up our tape  and aligned our tracker before re-centering   so something also really to take into account  is the Vive tracker's root point where it's   zero point this is where the actual origin  of your tracking is going to be so it's very   important to keep track of this do all of your  measurements and calibration based on this point   here's a diagram you can see that the center  of the Vive tracker is actually underneath   the light at the bottom of the tracker to set  the zero point or the root of your tracking   you go to recenter and then select the tracker  that you'd like to use to set your zero point in this video we decided not to go over  the process of mapping the lens distortion   if you're doing any AR or virtual objects  in your foreground or compositing I would   recommend going through this process but  we felt that this is covered in other   videos and is not a hundred percent  necessary for in-camera VFX [Music]   if you've been following along with the in-camera  VFX tutorials you will have a base project already   set up which is what you're seeing here but if not  I'm going to show you how to bring in your Vive   Mars data and connect it to any Source in Unreal  Engine so if you go to your live link window mine   is over here if you need to find it you can go to  window and then virtual production and live link   go to source and then message bus source and  then you will see a Vive live link data here   depending upon how many Rovers you have connected  you should see them show up in your subjects   okay so you want to save your preset save as  preset and then you're going to want to label this something like five Mars live link to connect this to an actor in  your scene I'm going to connect this to   our frostum camera you can either if you're  following along with the VP toolkit plug-in   series you can just go to tracking and  then enable live link select your subject   so this would be whichever Rover is on your  camera and then select your live link preset now your camera should be live I'm also going to  go into project settings and go down to live link and select my live link preset from here and make  sure that you put your file path here as well or   it will not stick and then we're just going to  save and then now your camera is connected to   and display if you'd like to manually  connect something to a Tracker I will add a   little mesh here I'll show you that real  quick if you want to do that for your workflow   so here's a little live tracker  you just add a live link component live link component controller  and then select your tracker so now you can see if you move this  around it will update in real time [Music] so now that you have the basic setup of tracking  we're going to move into doing the lens tracking   offset that's going to be the relationship between  the tracker and the nodal point of your lens for   this I highly recommend going through your lenses  and finding the the nodal point or the pivot point   of your lens there's a couple of YouTube videos  online that you can use to to find it or in a   pinch you can just measure to the center of your  lens that's generally going to get you a fairly   accurate representation now with the Vive Mar  system that we're using if you go through the lens   calibration Distortion mapping it will actually  give you a correct nodal offset that you could   just manually input into your tracking so we're  going to go to tracking here and then if we're   going to manually offset our camera in relation to  the tracker we could add that here so if I type in   negative 12 that'll push the camera in relation  to the tracker down by 12 centimeters if I put   in X positive 12 it'll push the camera in relation  to that tracker if you're doing this manually you   want to measure from the tracker's zero point and  then measure down to the lens and either a forward   or right or left offset and then you would enter  that here for this stage we're going to use the   VP toolkit plugin to use a Vive Mars tracker to  automatically set our offset from our tracking to   our camera's Pivot Point so we're going to use the  Vive Mars system to automatically set the camera's   offset in relation to the tracker position this  is really important to make sure that the pivot   point of your virtual camera lines up with the  pivot point of your camera and lens combination   and then enable the use tracker you're going to  want to select your tracker that you're going to   use for your lens offset now this system is  compatible with optitrack and Vicon as well   along with the original Vive series it's just  you have to you have to understand where the zero   point of your object is your tracking object that  you're using to do this so once you enable that   you should actually see a little live tracker  show up no matter what tracking system you're   using that's just going to be the mesh and then  your calibration tracker will be represented as   a little tracker here with a axis mesh connected  to it so first you want to measure the distance   from the front of your lens to your nodo offset  or the front of your lens to the center of your   lens if you want to just rough this in and  get fairly close in our scenario we're going   to actually add the Vive tracker offset from the  Vive tracker 0.2 where the Vive tracker is going   to be connecting from the lens so our nodal offset  from the front of the lens to where the center of   the lens is or the nodal offset pivot point is  11 centimeters and what that does is it takes   your tracker and it sets your camera back from  it so it's very important to know what that is   or get it as accurately roughed in as possible  so once the tracker is there you want to make   sure there's nothing in the way of both of your  trackers so that they are getting correct data   and then just hit your set button and you can  see here that will automatically set the tracker   relationship to the lens or pivot point of your  virtual cinema camera or your frustum camera to   accurately match the physical offset from your  tracker to your camera and lens packages nodal   Offset you can now see your offset here so  if you have to make any changes to that you   can manually do that through the widget you  can also do that just for note if you want to   adjust this manually you can actually go to your  frostum camera and go to your camera component   and then adjust the transform of your camera  component so you want to just make sure that   visually that looks accurate as well if  you want more information on setting up   your tracking in end display with the VP toolkit  plugin please see my other video where I go over   setting the lens to tracker offset and  calibrating your entire tracking system

Channel: Vp Toolkit

Views: 11,368

Keywords: UE5, Virtual Production, Vp-Toolkit, Vp Toolkit, VIVE Mars, VIVE Mars Camtrack, Camtrack System, ICVFX, VIVE Basestation, #VIVEMarsCamtrack, #UE5, #ICVFXVirtualProduction, #VpToolkit, #CinematicSetup, #VirtualProductionTutorial, #ViveCamtrackSetup, #UE5ICVFX, #FilmmakingTech, #CinematicMagic, #VirtualProductionWorkflow, #VPToolkitMagic, #CinematicInnovation, #ViveCamtrackGuide, #UE5VirtualProduction, #ICVFXWorkflow, #VirtualSetDesign, #CinematicExcellence, #ViveCamtrackTutorial, #VpToolkitTutorial

Id: g_6_-htkIzU

Length: 12min 59sec (779 seconds)

Published: Fri Mar 03 2023