Handwriting provides a natural and intuitive way to input text in virtual reality. We explore different approaches on how sketched user input can be captured, here we use the Oculus Rift controller as a substitute for a real pen. The user “grabs” the virtual pen using the index finger and thumb on the controller, similar to an actual pen.
The sketched figures or text are exported and analyzed using machine learning models. This way we aim at recognizing text, shapes and 3D gestures in virtual reality.
