Light Fields are a subtle but critical element to making 3D video look “real”, and it has little to do with either resolution or field of view. Meta (formerly Facebook) provides a look at a prototype VR headset that provides light field passthrough video to the user for a more realistic view of their surroundings, and it uses a nifty lens and aperture combination to make it happen.
As humans move our eyes (or our heads, for that matter) to take in a scene, we see things from slightly different perspectives in the process. These differences are important cues for our brains to interpret our world. But when cameras capture a scene, they capture it as a flat plane, which is different in a number of important ways from the manner in which our eyes work. A big reason stereoscopic 3D video doesn’t actually look particularly real is because the information it presents lacks these subtleties.
How is this connected to VR headsets? The video passthrough feature of VR — where one sees the real world via external cameras — is increasingly understood to be an important feature, but has limitations. Visual distortions from software processing are one, but video passthrough also suffers from the same issues that 3D videos have: they just don’t look real, and they don’t actually look 3D. This is more than just a cosmetic problem; it gets in the way of interacting with the world. That includes not just handling items but also things like walking around without bumping into corners, or going down stairs rather faster than one intended.
This clever ..
Support the originator by clicking the read the rest link below.
