Solving the driving scene perception problem for driver-assistance systems and autonomous vehicles requires accurate and robust performance in both regularly-occurring driving scenarios (termed “common cases”) and rare outlier scenarios (termed “edge cases”). We propose an automated method for clustering common cases and detecting edge cases based on the visual characteristics of the external scene using deep learning. We apply this approach to develop a large-scale real-world video driving scene dataset of edge cases and common cases. This dataset consists of 1,156,592 10-second video clips, including 450 clusters of common cases, and 5,601 edge cases. We assign human-interpretable metadata labels (e.g., weather, lighting conditions) to the clusters through manual annotation. We further propose two automated methods for large-scale evaluation of scene segmentation models on naturalistic driving datasets that can capture potential system failures without human inspection. Video illustrations of select clusters will be made available to help with future research.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MIT-AVT Clustered Driving Scene Dataset: Evaluating Perception Systems in Real-World Naturalistic Driving Scenarios


    Contributors:
    Ding, Li (author) / Glazer, Michael (author) / Wang, Meng (author) / Mehler, Bruce (author) / Reimer, Bryan (author) / Fridman, Lex (author)


    Publication date :

    2020-10-19


    Size :

    2490284 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    SceNDD: A Scenario-based Naturalistic Driving Dataset

    Prabu, Avinash / Ranjan, Nitya / Li, Lingxi et al. | IEEE | 2022


    Naturalistic Driving Study

    Raphael Grzebieta | DOAJ | 2015

    Free access

    Naturalistic Driving Behavior Analysis under Typical Normal Cut-In Scenarios

    Ma, Xuehan / Ma, Zhixiong / Zhu, Xichan et al. | British Library Conference Proceedings | 2019



    Naturalistic Driving Behavior Analysis under Typical Normal Cut-In Scenarios

    Yu, Feng / Cao, Jianyong / Zhu, Xichan et al. | SAE | 2019