Accurate 3D human pose estimation (3D HPE) is crucial for enabling autonomous vehicles (AVs) to make informed decisions and respond proactively in critical road scenarios. Promising results of 3D HPE have been gained in several domains such as human-computer interaction, robotics, sports and medical analytics, often based on data collected in well-controlled laboratory environments. Nevertheless, the transfer of 3D HPE methods to AVs has received limited research attention, due to the challenges posed by obtaining accurate 3D pose annotations and the limited suitability of data from other domains.We present a simple yet efficient weakly supervised approach for 3D HPE in the AV context by employing a high-level sensor fusion between camera and LiDAR data. The weakly supervised setting enables training on the target datasets without any 2D / 3D keypoint labels by using an off-the-shelf 2D joint extractor and pseudo labels generated from LiDAR to image projections. Our approach outperforms state-of-the-art results by up to ~ 13% on the Waymo Open Dataset in the weakly supervised setting and achieves state-of-the-art results in the supervised setting.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Weakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Driving


    Beteiligte:
    Bauer, Peter (Autor:in) / Bouazizi, Arij (Autor:in) / Kressel, Ulrich (Autor:in) / Flohr, Fabian B. (Autor:in)


    Erscheinungsdatum :

    04.06.2023


    Format / Umfang :

    3007507 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Semi- and weakly-supervised human pose estimation

    Ukita, Norimichi / Uematsu, Yusuke | British Library Online Contents | 2018



    Evaluating multi-modal trajectory predictions for autonomous driving

    ETTINGER SCOTT MORGAN / ANGUELOV DRAGOMIR | Europäisches Patentamt | 2025

    Freier Zugriff

    EVALUATING MULTI-MODAL TRAJECTORY PREDICTIONS FOR AUTONOMOUS DRIVING

    ETTINGER SCOTT MORGAN / ANGUELOV DRAGOMIR | Europäisches Patentamt | 2022

    Freier Zugriff

    Multi-modal Guidance for 3D Driver Pose Estimation with Diffusion

    Wang, Rui / Yu, Xiaoyang / Huang, Huihui et al. | IEEE | 2024