A mind-bending demonstration of augmented reality capabilities is showcased in a research project by New Reality Labs. - Road to VR
New Reality Labs Research Project Demonstrates Mind-bending AR Capabilities
A research project from Meta's XR division, Reality Labs, explores a method for interacting with the real world through augmented reality. The project, called Scene Responsiveness, allows real objects to be digitized and interacted with virtually, effectively blending the real and virtual worlds. The researchers have published their work and demonstrated how the illusion can be maintained and prevented from breaking. While the current method requires manual and scene-specific work, advancements in computer vision and artificial intelligence could make it more automatic and convincing. The researchers also envision practical applications, such as using the illusion for health purposes by morphing unhealthy food into less appealing objects. For more details, visit the source article on Road to VR.
Source: https://www.roadtovr.com/meta-reality-lab-ar-research-scene-responsiveness/