Deep learning-based object detection is a critical technology for autonomous driving, as it enables vehicles to perceive and react to the environment. However, most models are heavily dependent on annotated data, which can limit their ability to detect rare or unusual objects, also known as corner cases. In this paper, we apply a state-of-the-art text-prompted object detection model to handle this problem. This model leverages a text-image multimodal cross-attention mechanism to incorporate semantic information from natural language. Therefore, it can detect objects under limited data and has strong open-set detection and zero-shot generalization capabilities. We generated text prompts based on the prior distribution of objects and performed joint detection with images. Our experimental results on the CODA dataset demonstrate that our proposed approach significantly outperforms baseline models in terms of mean average precision (mAP) and mean average recall (mAR) scores. Our work presents a new detection approach that can contribute to the development of safer and more intelligent autonomous driving systems.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Text Prompt-Based Approach for Zero-Shot Corner Case Object Detection in Autonomous Driving


    Beteiligte:
    Liu, Tianqi (Autor:in) / Zhang, Shanghang (Autor:in) / Qin, Yanjun (Autor:in) / Tao, Xiaoming (Autor:in)


    Erscheinungsdatum :

    24.09.2023


    Format / Umfang :

    978327 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Towards Corner Case Detection for Autonomous Driving

    Bolte, Jan-Aike / Bar, Andreas / Lipinski, Daniel et al. | IEEE | 2019


    TOWARDS CORNER CASE DETECTION FOR AUTONOMOUS DRIVING

    Bolte, Jan-Aike / Bar, Andreas / Lipinski, Daniel et al. | British Library Conference Proceedings | 2019



    Free space detection - a corner stone of autonomous driving

    Neumann, L. / Vanholme, B. / Gressmann, M. et al. | British Library Conference Proceedings | 2015


    Autonomous Driving Object Detection Platform

    Carabulea, Laurentiu / Pozna, Claudiu / Antonya, Csaba et al. | Springer Verlag | 2024