As autonomous driving technologies advance, occupants are expected to be free from driving, diversifying interaction scenarios with vehicles. Despite the growing importance of in-vehicle occupant monitoring systems, most existing systems focus on the face or head tracking of occupants, and only a few studies have attempted to detect their poses. In this paper, we present the first in-vehicle environment-specialized framework for the joint estimation of 3D human pose and shape from a single image. To this end, we introduce a new dataset called Human In VEhicles (HIVE), which contains a large collection of synthesized humans with different shapes and poses in vehicle images. HIVE provides RGB and NIR in-vehicle image pairs with ground-truth 2D and 3D pose and shape annotations, respectively. In addition, to exploit the different characteristics of humans in vehicles and unconstrained environments, we present a new pose prior penalizing poses that deviate from in-vehicle poses. The pose prior is derived using a variational autoencoder trained with in-vehicle human pose data. By using the proposed HIVE dataset and pose prior along with an elaborately designed two-stage training procedure, our method exhibits significantly improved pose and shape estimation performance compared with state-of-the-art methods for real-world test images captured in vehicles under different conditions.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Pose and Shape Estimation of Humans in Vehicles


    Beteiligte:
    Ko, Kwang-Lim (Autor:in) / Yoo, Jun-Sang (Autor:in) / Han, Chang-Woo (Autor:in) / Kim, Jungyeop (Autor:in) / Jung, Seung-Won (Autor:in)


    Erscheinungsdatum :

    01.01.2024


    Format / Umfang :

    4487365 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    6D POSE AND SHAPE ESTIMATION METHOD

    MEIER SVEN / KOBORI NORIMASA / MINCIULLO LUCA et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Pedestrian Pose Estimation for Campus Unmanned Delivery Vehicles

    Jiang, Yuzhu / Li, Ying / Yang, Chao et al. | IEEE | 2023


    Simultaneous Segmentation and Pose Estimation of Humans Using Dynamic Graph Cuts

    Kohli, P. / Rihan, J. / Bray, M. et al. | British Library Online Contents | 2008


    Model-free non-rigid head pose tracking by joint shape and pose estimation

    Cristina, S. / Camilleri, K. P. | British Library Online Contents | 2016


    Vision based Real-Time Pose Estimation for Intelligent Vehicles

    Yang, M. / Yu, Q. / Wang, H. et al. | British Library Conference Proceedings | 2004