Turn Your iPhone into a Realtime Video Tracker for Cinema Cameras with Lightcraft Jetset

this is lightcraft jetset Unified virtual production working on an iPhone this is a cinity gear news video supported by B&H and CVP welcome everybody here from BSC Expo in London and I'm here at the lightcraft booth with Joshua how are you I'm good thank you nice to meet you nice to meet you too uh actually you guys just introduced a new app which supposedly is quite revolutionary I heard it's called jetset what is it uh yes it's called Jet Set and we're from lcraft um jetset is a revolutionary virtual production app that takes all of the Power of virtual production tracking and uh and 3D scenes and packed it all directly into an iPhone which you can mount on any camera and then do fullscale virtual production for Cinema for somebody like me who's not into you know like um post production or virtual production yet uh how can you explain it to a cinematographer right well I mean I've got the camera right here so I can just show you on here actually so what we have here is a zcam and a nice big cine lens but of course the rig has the one big difference of having an iPhone mounted directly to the top which is running the Jet Set app the Jet Set app has a 3D environment loaded into it and does all of the positional tracking and movement of the camera so all of that data can be saved and then trans ferred into post so if we wanted to operate this and uh pointed get a blue screen or green screen like we have behind us here then we would be able to uh have a full virtual production integration with our main cinema camera and it even calibrates as well with the cinema lenses so it's not just tracking the position of the phone itself it's tracking the position of the camera it calculates an offset between the iPhone lens and the cine lens so in no knows that it's working for this camera in particular and and it's not just some isolated iPhone on the top so you do get a preview with the iPhone camera right you you get a realtime preview but then it transfers that data also to the actual footage shot with the camera that's exactly right so on the phone we can see our preview of our 3D scene and uh we can also frame correctly uh we also have a monitor on the back for a clean feed from this zcam but for all intents and purposes we can use this as a monitor to see both our real and uh virtual seeing and then of course it does transfer perfectly into post and works with the footage from the zcam or any camera rather and the app will understand if I put a different lens on it because of course I mean this lens is very similar to the wide angle like the normal 24 mm lens of the iPhone right but if I let's say I put a 100 Mil on that what exactly so you would do all of your lens calibrations beforehand and uh so if it was a 29 a 50 a 35 whatever it is you put your lenses on calibrate with the Jet Set app and then when you're on set and change your lens you just change the calibration uh file from the app and it does the job what's up give me an example of a real world scenario where I would want to use that and how has it been done currently or up until now well up until now I mean there's a great many tracking options out there I mean name a few there's obviously cam track there's there's end cam but the point of this is to make it not just smaller but simpler because this is not just a tracking option it is also part of an ecosystem of other software for instance we have autoshot which is our software that actually takes your tracking data from the phone then uh syncs that automatically with your cinema camera takes and sends it out to the post- production packages that you use because we know people are picking about what they use they like to use after effects or they like to use nuke or whatever it is our app speaks in that language and sends it to that software Choice interesting and this works with the aun cie uh yeah we're using the CWS at the moment to help with our demo so we can get the zcam out to the monitor that we're using so you know if people are around to have a look but the main important piece from aun that we use is the Simo Pro so that gets the video signal from the main cinema camera and pipes it into an iOS device that's useful mainly for calibration purposes so when you're doing the lens calibration it calculates that offset by looking at the video from the phone and from the zcam and looks for a tracking points common points between the two and solves for X basically so I mean like last time I did something with tracking was long time ago when you actually had to put the markers everywhere you don't need to do that anymore right why would you it's it's automatically realizing everything it is it knows it knows the position of the camera and it can do all that tracking live on set and it's doing it with a piece of technology that most people have in their pocket so you might as well be mounting it onto your camera or using it as is because it does work on the iPhone on its own and you can record and do visual effect shots just with an iPhone or an iPad it's quite incredible Because the actual app at base level is free and can be downloaded for free on the App Store it's called light lightcraft Jet Set or just Jet Set and uh but it scales up to the size of the production you're trying to work on so if you want to work on something much larger and you have an AR 35 or whatever you're using iPhone on top and use Jet Set and it scales to a maximum of 80 a month for uh Cinema shooting okay amazing is it available already yeah it's available right now in the app store thank you so much Joshua and uh curious to see the results out of this um you know you might already have seen some shots that these guys did in the demo while we were talking um it's a bit hard to grasp the concept for me like because I'm not in that world but I understand what it does and it's just amazing how many Industries are actually revolutionized by the smartphone right now uh it's kind of scary but also inspiring at the same time and yeah uh good luck with jetset and thanks everybody for watching stay tuned to C for a lot more like this video and other interviews and reviews and don't forget to subscribe to our YouTube channel [Music] [Music] thanks

Channel: CineD

Views: 9,465

Keywords: CineD, cined, Jetset, Lightcraft, virtual production, iOS app, real-time tracking, iphone tracking, video tracking, tracking, tracking app, video tracking app, virtual production app

Id: 1tMqe0vxZDU

Length: 6min 53sec (413 seconds)

Published: Wed Feb 28 2024