AR Passthrough

How difficult would it be to optionally use passthrough in place of the background/floor? Im using a Quest 3 and the passthrough quality is exceptional.

Being able to interact with an object while being a aware of your surroundings would make things a little more accessible.

I’m afraid this is not supported natively by OpenXR, so unlikely to be implemented in VTK.

Thanks Mathieu. Ah I see… (privacy & security concerns).

Looks like there is something in the form of extensions (XR_FB_passthrough and XR_HTC_passthrough), but still nothing native.