By leveraging multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a prominent technique in the realm of 3D object reconstruction. However, the input images of NeRF transmitted through high-interference wireless environment (HIWE) leads to negatively impact the accuracy of 3D reconstruction, thereby limiting its scalability. Fortunately, semantic communication has been proved a effective method to solve the above problem. In this paper, we propose a novel NeRF based 3D semantic communication (NeRF-3DSC) system, which offers robust 3D reconstruction in HIWE. Within NeRF-3DSC, semantic encoder and decoder are employed to extract and recover core semantic features of task-specific specific object (TSO) from the collected images, channel encoder and decoder ensure robust transmission of compressed semantic information in HIWE, lightweight renderer based on NeRF is employed for fast and efficient 3D reconstruction. Moreover, a semantic control unit (SCU) is introduced to guide above components, thereby enhancing the efficiency of reconstruction. Demonstrative experiments demonstrate that the proposed NeRF-3DSC enables robust object reconstruction in HIWE, surpassing the performance of state-of-the-art (SOTA) methods in terms of reconstruction quality.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Leveraging Neural Radiance Field and Semantic Communication for Robust 3D Reconstruction


    Contributors:
    Xu, Rui (author) / Li, Gaolei (author) / Lin, Xi (author) / Liu, Yuchen (author) / Chen, Mingzhe (author) / Li, Jianhua (author)


    Publication date :

    2024-10-07


    Size :

    2160678 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English






    Neural Radiance Field zur Synthetisierung eines Verkehrsbereichs

    SCHMIDT JULIAN / RIST CHRISTOPH BERND / RUPPRECHT JAN et al. | European Patent Office | 2025

    Free access

    Knowledge-Aided Semantic Communication Leveraging Probabilistic Graphical Modeling

    Wan, Haowen / Yang, Qianqian / Tang, Jiancheng et al. | IEEE | 2024