Virtual Reality (VR) has advanced significantly in the recent years. VR allows users to explore novel environments (both real and imaginary), play games, and engage with media in a way that is unprecedentedly immersive. However, compared to physical reality, sharing these experiences is difficult because the user's face is not easily observable from the outside and is partly occluded by the VR headset. Mixed Reality (MR) is a medium that alleviates some of this disconnect by sharing the virtual context of a VR user in a flat video format that can be consumed by an audience to get a feel for the user's experience. Our project aims to present a solution to address this problem by virtually removing the headset and revealing the face underneath it using a combination of 3D vision, machine learning and graphics techniques for images. We are now able to "remove" headsets and show a person's identity, focus and full face in virtual reality. The solution to this problem helps in enhancing communication through videos and video conferencing and in health care treatments for mental disorders.


    Access

    Download


    Export, share and cite



    Realistic range rendering

    Flynn, | IEEE | 1994


    Realistic Range Rendering

    Flynn, P. J. / Institute of Electrical and Electronics Engineers; Computer Society | British Library Conference Proceedings | 1994


    MIXED REALITY-BASED EXPERIENCE SIMULATOR

    KIM SEUNG JUN / KIM GWANG BIN / YEO DO HYEON et al. | European Patent Office | 2021

    Free access

    Mixed reality-based experience simulator

    KIM SEUNG JUN / KIM GWANG BIN / YEO DO HYEON et al. | European Patent Office | 2023

    Free access

    A SYSTEM FOR REALISTIC THREE-DIMENSIONAL RENDERING

    N BALASUBRAMANIYAN / B KARTHIKEYAN / THANGAMANI ARUNVEL | European Patent Office | 2020

    Free access