The Mixed Reality Capture Tool allows you to place real-world objects in VR. Using a webcam, green screen and broadcasting software you can capture footage of yourself and superimpose it in the virtual world.
To set up the Mixed Reality Capture Tool:
From your PC, download the Mixed Reality Capture Tool.
Launch the app and click Get Started.
Review the terms and conditions and click Agree.
Click Quest to begin setup.
If you have an Oculus Rift S, follow the setup instructions in this article.
If this is your first time using mixed reality capture, install the Mixed Reality Capture app on your Quest 2 or Quest.
Launch the Mixed Reality Capture app in your Quest 2 or Quest and click Search for Device. If the IP address is different on your computer than the one shown on your Quest 2 or Quest, you can enter the IP address manually.
Once the device is found click Calibrate Your Camera.
Select your webcam from the Current Camera menu and then click Begin Calibration.
Follow the onscreen instructions to calibrate your controller and then click Save to Headset.
To use the Mixed Reality Capture Tool with Open Broadcaster Software, or OBS:
Follow the link from the capture tool to install the required OBS version.
Once OBS is installed, click the link in the capture tool to install Oculus Mixed Reality Capture OBS Plugin.
Click Generate OBS Scene Collection and launch OBS.
From the top of OBS, click Scene Collection Menu then click Import. Pick the OBS Scene Collection file you saved. Once it's imported, go back to the Scene Collection Menu and select your file from the dropdown.
From the Sources panel, click Video Capture in the device layer to make sure your camera is turned on.
Double click the Oculus Mixed Reality Capture layer in the Sources menu. A blue and green split screen will appear. Go to your Quest 2 or Quest and make sure you have a game running that's compatible with Mixed Reality Capture.
Note: If you're noticing that there is latency between your movements and the ones being captured, you may need to adjust the Render Delay in OBS. To adjust this, right click on your video capture device and click Filters. Click Render Delay and make adjustments until the latency from your movements decreases.