Accurately predicting the actions of vulnerable road users (VRUs) is crucial for improving traffic flow and enhancing VRU safety. The unpredictable nature of VRU trajectories poses a significant challenge. To address this, we introduce the Probabilistic Multimodal Trajectory Prediction Network (PMTPN), which effectively forecasts multimodal trajectories and their corresponding probabilities by utilizing a multitask learning framework that integrates trajectory and probability predictions. The network processes diverse input modalities, including bounding boxes, pedestrian pose, and ego-vehicle motion information. We enhance prediction performance by employing specialized encoders to extract distinct features from these inputs and a fusion module to integrate the data efficiently. To manage the variability in pedestrian actions, our model incorporates learnable motion queries that serve as reference points for predicting various potential outcomes. These queries are iteratively refined through attention operations with historical context in a multi-layer decoder. Additionally, a multi-gate mixture-of-experts (MMoE) module within the decoder helps mitigate the challenges of multitask learning. Our method significantly enhances trajectory prediction accuracy and provides probabilities for each predicted trajectory, demonstrating state-of-the-art results on the JAAD and PIE datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Probabilistic Trajectory Prediction of Vulnerable Road User Using Multimodal Inputs


    Contributors:
    Hu, Chuan (author) / Niu, Ruochen (author) / Lin, Yiwei (author) / Yang, Biao (author) / Chen, Hao (author) / Zhao, Baixuan (author) / Zhang, Xi (author)


    Publication date :

    2025-02-01


    Size :

    2274326 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    RECURRENT NEURAL NETWORK ARCHITECTURES FOR VULNERABLE ROAD USER TRAJECTORY PREDICTION

    Xiong, Hui / Flohr, Fabian B. / Wang, Sijia et al. | British Library Conference Proceedings | 2019


    Recurrent Neural Network Architectures for Vulnerable Road User Trajectory Prediction

    Xiong, Hui / Flohr, Fabian B. / Wang, Sijia et al. | IEEE | 2019



    Egocentric Vulnerable Road Users Trajectory Prediction With Incomplete Observation

    Liu, Hui / Liu, Chunsheng / Chang, Faliang et al. | IEEE | 2024