Researchers from Meta and ETH Zurich Announce Breakthrough in Transforming Any Surface Into a Keyboard - UploadVR
Meta & ETH Zurich Researchers Say They've Solved Turning Any Surface Into A Keyboard
Researchers from Meta and ETH Zurich have developed a software system called TouchInsight, aimed at transforming any surface into a virtual keyboard. This innovation addresses the current challenges of text input in VR and AR, which are slower and less convenient than on traditional devices due to lack of haptic feedback and the need for an external keyboard. TouchInsight enables input using just a Quest 3 headset without additional markers or hardware, achieving up to 70 words per minute with a low error rate. The system uses a neural network to detect touch events, finger contact, and location based on hand tracking. Besides typing, it could be used for other interactive applications in mixed reality. For further details, visit the full story at UploadVR.
Source: https://www.uploadvr.com/touchinsight-turn-any-surface-into-a-virtual-keyboard/