Virtual Reality (VR) has advanced significantly in the recent years. VR allows users to explore novel environments (both real and imaginary), play games, and engage with media in a way that is unprecedentedly immersive. However, compared to physical reality, sharing these experiences is difficult because the user's face is not easily observable from the outside and is partly occluded by the VR headset. Mixed Reality (MR) is a medium that alleviates some of this disconnect by sharing the virtual context of a VR user in a flat video format that can be consumed by an audience to get a feel for the user's experience. Our project aims to present a solution to address this problem by virtually removing the headset and revealing the face underneath it using a combination of 3D vision, machine learning and graphics techniques for images. We are now able to "remove" headsets and show a person's identity, focus and full face in virtual reality. The solution to this problem helps in enhancing communication through videos and video conferencing and in health care treatments for mental disorders.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Realistic Range Rendering

    Flynn, P. J. / Institute of Electrical and Electronics Engineers; Computer Society | British Library Conference Proceedings | 1994


    Realistic range rendering

    Flynn, | IEEE | 1994


    MIXED REALITY-BASED EXPERIENCE SIMULATOR

    KIM SEUNG JUN / KIM GWANG BIN / YEO DO HYEON et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Mixed reality-based experience simulator

    KIM SEUNG JUN / KIM GWANG BIN / YEO DO HYEON et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    A SYSTEM FOR REALISTIC THREE-DIMENSIONAL RENDERING

    N BALASUBRAMANIYAN / B KARTHIKEYAN / THANGAMANI ARUNVEL | Europäisches Patentamt | 2020

    Freier Zugriff