This article focuses on the design and implementation of smart wearable robot glasses for human visual augmentation, which take a role to provide the refined visual recognition result to users of wearing the proposed system. The proposed system consists of a glass-type wearable device with a front looking camera, an eye looking camera, and an earphone, and signal processing units. The scene-analyzing process on the input image acquired by the front view camera is supported by an eye view camera of monitoring the eye position of user for efficient in formation processing, which is used to catch the user's visual intention and attention in given situations. The recognized results are transformed into the audio information for the user friendly information service without obstructing the users' own visual information gathering and processing, and then the result is transferred into the user earphone finally. This device can be used for the augmentation of human visual capability in various areas, museum, conference, meetings, etc. For the proposed device's feasibility, a series of experiments are performed, and the evaluation results are discussed in detail.
Smart wearable robot glasses for human visual augmentation based on human intention and scene understanding
01.10.2010
1037943 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
GazeEMD : detecting visual intention in gaze-based human-robot interaction
BASE | 2021
|Multimodal Emotion Recognition and Intention Understanding in Human-Robot Interaction
Springer Verlag | 2021
|Visual intention classification by deep learning for gaze-based human-robot interaction
BASE | 2020
|Accessing your navigation plans! Human-Robot Intention Transfer using Eye-Tracking Glasses
BASE | 2018
|Vision-Based Holistic Scene Understanding for Context-Aware Human-Robot Interaction
BASE | 2022
|