Reconstructing 4D vehicular activity (3D space and time) from cameras is useful for autonomous vehicles, commuters and local authorities to plan for smarter and safer cities. Traffic is inherently repetitious over long periods, yet current deep learning-based 3D reconstruction methods have not considered such repetitions and have difficulty generalizing to new intersection-installed cameras. We present a novel approach exploiting longitudinal (long-term) repetitious motion as self-supervision to reconstruct 3D vehicular activity from a video captured by a single fixed camera. Starting from off-the-shelf 2D keypoint detections, our algorithm optimizes 3D vehicle shapes and poses, and then clusters their trajectories in 3D space. The 2D keypoints and trajectory clusters accumulated over long-term are later used to improve the 2D and 3D keypoints via self-supervision without any human annotation. Our method improves reconstruction accuracy over state of the art on scenes with a significant visual difference from the keypoint detector's training data, and has many applications including velocity estimation, anomaly detection and vehicle counting. We demonstrate results on traffic videos captured at multiple city intersections, collected using our smartphones, YouTube, and other public datasets.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Traffic4D: Single View Reconstruction of Repetitious Activity Using Longitudinal Self-Supervision


    Beteiligte:
    Li, Fangyu (Autor:in) / Reddy, N. Dinesh (Autor:in) / Chen, Xudong (Autor:in) / Narasimhan, Srinivasa G. (Autor:in)


    Erscheinungsdatum :

    11.07.2021


    Format / Umfang :

    1597498 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Systematic variability in repetitious travel

    Hanson, Susan / Huff, O. James | Online Contents | 1988


    Research on Repetitious Damage Effectiveness of Trajectory Correction Rocket

    Song, Xie En ;Song, Wei Dong ;Zhao, Cheng Wang | Trans Tech Publications | 2014



    3D Road Reconstruction from a Single View

    Guiducci, A. | British Library Online Contents | 1998


    Longitudinal and lateral control and supervision of autonomous intelligent vehicles

    Holzmann, H. / Halfmann, C. / Germann, S. et al. | British Library Conference Proceedings | 1997