Considerable progress has been made in semantic scene understanding of road scenes with monocular cameras. It is, however, mainly focused on certain specific classes such as cars, bicyclists and pedestrians. This work investigates traffic cones, an object category crucial for traffic control in the context of autonomous vehicles. 3D object detection using images from a monocular camera is intrinsically an ill-posed problem. In this work, we exploit the unique structure of traffic cones and propose a pipelined approach to solve this problem. Specifically, we first detect cones in images by a modified 2D object detector. Following which the keypoints on a traffic cone are recognized with the help of our deep structural regression network, here, the fact that the cross-ratio is projection invariant is leveraged for network regularization. Finally, the 3D position of cones is recovered via the classical Perspective n-Point algorithm using correspondences obtained from the keypoint regression. Extensive experiments show that our approach can accurately detect traffic cones and estimate their position in the 3D world in real time. The proposed method is also deployed on a real-time, autonomous system. It runs efficiently on the low-power Jetson TX2, providing accurate 3D position estimates, allowing a race-car to map and drive autonomously on an unseen track indicated by traffic cones. With the help of robust and accurate perception, our race-car won both Formula Student Competitions held in Italy and Germany in 2018, cruising at a top speed of 54 km/h on our driverless platform “gotthard driverless” https://youtu. be/HegmIXASKow?t==11694. Visualization of the complete pipeline, mapping and navigation can be found on our project page http://people.ee.ethz.ch/=tracczucrich/Trnfflcf.lonc/.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Real-time 3D Traffic Cone Detection for Autonomous Driving


    Beteiligte:
    Dhall, Ankit (Autor:in) / Dai, Dengxin (Autor:in) / Van Gool, Luc (Autor:in)


    Erscheinungsdatum :

    01.06.2019


    Format / Umfang :

    2550541 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    REAL-TIME 3D TRAFFIC CONE DETECTION FOR AUTONOMOUS DRIVING

    Dhall, Ankit / Dai, Dengxin / Van Gool, Luc | British Library Conference Proceedings | 2019


    Real‐time traffic cone detection for autonomous driving based on YOLOv4

    Su, Qinghua / Wang, Haodong / Xie, Min et al. | Wiley | 2022

    Freier Zugriff

    Real‐time traffic cone detection for autonomous driving based on YOLOv4

    Qinghua Su / Haodong Wang / Min Xie et al. | DOAJ | 2022

    Freier Zugriff

    Real-time traffic cone detection for autonomous vehicle

    Yong, Huang / Jianru, Xue | IEEE | 2015


    Autonomous Automated Driving in Real Traffic

    Ulmer, B. | British Library Conference Proceedings | 1994