Stream/Record Yourself in VR - No Green Screen Needed!

so you want to stream with a chroma key effect but maybe you lack the funds or the space for a full-blown green screen setup don't worry i've got you covered with a few different ways on how you can get around this hello i'm adam bombatti i create vr and live streaming tutorials i also occasionally cover vr games equipment and tech today i'm going to be showing you multiple tools that you can use to achieve that green screen effect without actually having a physical green screen although my audience is primarily vr and mixed reality creators some of these methods may actually work for those of you who stream desktop games as well i'll be sure to put timestamps in the description below so you can skip ahead to whatever ones seem the easiest or most interesting to you as a disclaimer i will say that these should be considered more beginner methods or stepping stones into eventually getting a full-blown green screen setup if you're a stickler for quality nothing beats having an actual green screen whether that's either sheets or full-blown walls in my case while there may not be really any physical setup involved with these methods do note that it may be more stressful on your pc due to all of the extra processing required to be able to separate you from your background these will vary between methods as you'll see shortly for best results on all of these and to avoid getting that kind of see-through or ghost limb look having bright even lighting as well as a minimal background such as a solid colored wall or avoiding clutter in the background will make it easier for the ai to be able to separate you from your background well let's get into it first let's go over an option from mixed reality creators and that is segmented which is already built into live all you literally have to do is head into the live app on steam and flip on that segment of key toggle for pcvr you can find the toggle under camera then edit for quest native capture you can find it as a toggle after you select your camera and pick your resolution or you can go back into the keying and cropping settings segmentive is a real-time segmentation ai in which the deep neural network or dnn analyzes the foreground which would be you and uses what it has learned around the edges of people in order to separate you from the background the developers for segmentif are always trying to teach and expose it to more scenarios and novelties so it's still a young growing technology similar to segmented is the nvidia broadcasting software which you can use outside of just mixed reality as well this should go without saying but in order to use it you must have an nvidia graphics card if you take a look at their website it lists the gpus that are compatible with the program to access the auto background removal tools flip over to the camera options select the camera you want to use the resolution if available then under effects select background removal you can stack multiple effects so if you want to be able to take advantage of nvidia's white noise removal for example you can do that as well but the more you add on the more taxing on your pc it'll be for normal desktop or non-mixed reality use all you have to do is open your broadcasting software click add source video capture device then name it whatever you want then select camera nvidia broadcast for mixed reality and running it through live launch the camera go to camera select a profile or create a new one and next to camera type select video camera then for device select camera nvidia broadcast select your resolution under argb or you won't get the transparency click save then calibrate as you normally would besides auto green screen removal tools it also has some other neat features such as their powerful noise removal video noise removal and other fun camera and video effects it's definitely one to check out now we have another very untraditional but still asked about a lot method using a connect not all connects will work it must be an xbox one connect or a connect azure make sure your lighthouses are also 2.0 as especially for vive pro headset users you might get a lot of interference between your kinect and your tracking if you only have the connect lying around it's not ready to go straight out of the box unfortunately you're gonna need to buy a pc adapter and i'll post the one that i used in the description below to connect your connect to a power source as well as a 3.0 usb port on your computer once you have everything plugged in now for the software fun first you're going to want to download both the connect for windows runtime as well as the sdk links will be below after extracting the runtime zip head over to this connect sensor file right click and click install next install the connect sdk then we're going to go back to the connect runtime x64 msi file which might look a little different depending on your system and install that as well if you're having troubles with error code 1920 when trying to install the sdk in your windows search bar type in vc redist click repair then run through all the previous steps again your connect should now be recognized by your computer and you can select it as a camera option in live if you want to use it without live you can actually get a plug-in for obs which i'll also link below it's super handy and before you ask no it does not work with streamlabs obs because sloms doesn't allow third-party plugins when actively capturing in a program the lights will be lit up like so finally there's another option worth mentioning and that is the live ios camera app you can only use it with ipads and iphones with a12 plus chips i'll post a link to all of the supported apple devices below you can find it by simply searching for live camera in the app store unfortunately the live camera is not available for android and it's not something the team is focusing on or prioritizing anymore so use it at your own discretion besides the virtual green screen mode the live camera app has a couple of different functions on the app itself such as adjusting the resolution fps or turning on or off autofocus to get this to work you need to make sure you have the latest version of itunes installed on your computer the best way is to connect your device via usb simply plug it into your computer make sure you select the option to trust this pc then in live select the live camera for ios as the camera type you can then select your resolution click save and calibrate as normal if you get no output try closing the app and reopening it and if it's looking a little glitchy try rotating your camera 180 degrees the other direction keep in mind this made my phone run very hot so i don't know how sustainable this method would be for long recording sessions and it drains the battery pretty quickly so while there is a wi-fi option i actually don't recommend it so how do the different options compare i played the same map and audio trip using all four methods mentioned in the exact same location with the exact same lighting and i'll let you decide for yourself [Music] keep your ears to the ground [Music] and there you have it different options for vr or mixed reality or in some cases desktop content whether live streaming or recording using absolutely no physical green screen at all which method works best for your setup and as we all know technology changes very fast so hopefully by the time you watch this video these methods won't be obsolete but as always keep on creating and never lose that drive to improve i'll see you on the next one

Channel: Atom Bomb Body

Views: 7,503

Keywords: mixed reality, no green screen, virtual reality, LIV, NVIDIA Broadcast, segmentive, kinect, LIV Camera app, tutorial, AI, auto background removal, free, cheap

Id: SPXh6zB8lTg

Length: 6min 50sec (410 seconds)

Published: Sat Feb 19 2022