Pedestrian detection is a critical feature of autonomous vehicle or advanced driver assistance system. This paper presents a novel instrument for pedestrian detection by combining stereo vision cameras with a thermal camera. A new dataset for vehicle applications is built from the test vehicle recorded data when driving on city roads. Data received from multiple cameras are aligned using trifocal tensor with pre-calibrated parameters. Candidates are generated from each image frame using sliding windows across multiple scales. A reconfigurable detector framework is proposed, in which feature extraction and classification are two separate stages. The input to the detector can be the color image, disparity map, thermal data, or any of their combinations. When applying to convolutional channel features, feature extraction utilizes the first three convolutional layers of a pre-trained convolutional neural network cascaded with an AdaBoost classifier. The evaluation results show that it significantly outperforms the traditional histogram of oriented gradients features. The proposed pedestrian detector with multi-spectral cameras can achieve 9% log-average miss rate. The experimental dataset is made available at http://computing.wpi.edu/dataset.html.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Pedestrian Detection for Autonomous Vehicle Using Multi-Spectral Cameras


    Contributors:

    Published in:

    Publication date :

    2019-06-01


    Size :

    2896520 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Autonomous pedestrian detection

    Nkosi, M P / Hancke, G P / dos Santos, R M A | IEEE | 2015


    Pedestrian detection algorithm for on-board cameras of multi view angles

    Kamijo, S / Fujimura, K / Shibayama, Y | IEEE | 2010


    Multi spectral pedestrian detection and localization

    Bauer, G. / Homm, F. / Walchshäusl, L. et al. | Tema Archive | 2008


    VISION-BASED PEDESTRIAN DETECTION FOR REAR-VIEW CAMERAS

    Silberstein, S. / Levi, D. / Kogan, V. et al. | British Library Conference Proceedings | 2014