Abstract Detecting hand gestures can provide a useful non-contact interaction tool with machines and systems and it has been employed for a wide range of applications. Recently, smart glasses and Virtual Reality (VR) headsets become viable solutions for various training applications ranging from surgical training in medicine to operator training for heavy equipment. A major challenge in these systems is to interact with the training platform since user’s view is blocked. In this paper, we present hand gesture detection using deep learning as a means of interaction with the VR system. Real world images are streamed by a camera mounted on the VR headset. User’s hand gestures are detected and blended into the virtual images providing more immersive and interactive user experience.
Hand Gesture Detection and Its Application to Virtual Reality Systems
10th International Conference on Robotics, Vision, Signal Processing and Power Applications ; 10 ; 499-504
Lecture Notes in Electrical Engineering ; 547 , 10
2019-01-01
6 pages
Article/Chapter (Book)
Electronic Resource
English
Hand Gesture Controlled Video Player Application
IEEE | 2023
|Virtual Steering with Gesture Control Using 3D Hand Modeling
TIBKAT | 2023
|Hand Gesture Controlled Wheelchair
IEEE | 2024
|Study of Vision-Based Hand Gesture Recognition System for Astronaut Virtual Training
Trans Tech Publications | 2014
|