Virtual Reality (VR) has advanced significantly in the recent years. VR allows users to explore novel environments (both real and imaginary), play games, and engage with media in a way that is unprecedentedly immersive. However, compared to physical reality, sharing these experiences is difficult because the user's face is not easily observable from the outside and is partly occluded by the VR headset. Mixed Reality (MR) is a medium that alleviates some of this disconnect by sharing the virtual context of a VR user in a flat video format that can be consumed by an audience to get a feel for the user's experience. Our project aims to present a solution to address this problem by virtually removing the headset and revealing the face underneath it using a combination of 3D vision, machine learning and graphics techniques for images. We are now able to "remove" headsets and show a person's identity, focus and full face in virtual reality. The solution to this problem helps in enhancing communication through videos and video conferencing and in health care treatments for mental disorders.
Realistic face rendering for 3-D mixed reality experience
2019-07-01
Theses
Electronic Resource
English
DDC: | 629 |
IEEE | 1994
|British Library Conference Proceedings | 1994
|