Autonomous racing has attracted extensive interest due to its great potential in self-driving at the extreme limits. Model-based and learning-based methods are widely used in autonomous racing. Out of which, model-based methods cannot cope with complex environments when only local perception is available. This limit can be overcome by the Proximal policy optimization (PPO), a typical learning-based method, which does not excessively rely on global perception. However, existing PPO faces challenges with low training efficiency in long sequences. To solve this issue, this paper develops an improved PPO by introducing a curiosity mechanism, a balanced reward function, and an image-efficient actor-critic network. The curiosity mechanism focuses on training on key segments, facilitating efficient short-term learning of the PPO. The balanced reward function adjusts rewards based on the complexity of racetracks, promoting efficient exploration of the control strategy during training. The image-efficient actor-critic network enhances the PPO to fast process the perceived information. Simulation results on a physical engine demonstrate that the proposed algorithm outperforms benchmark algorithms in achieving less number of collisions, higher peak reward with less training time, and shorter laptime among multiple testing racetracks.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Efficient and Balanced Exploration-Driven Decision Making for Autonomous Racing Using Local Information


    Beteiligte:
    Tian, Zhen (Autor:in) / Zhao, Dezong (Autor:in) / Lin, Zhihao (Autor:in) / Zhao, Wenjing (Autor:in) / Flynn, David (Autor:in) / Jiang, Yuande (Autor:in) / Tian, Daxin (Autor:in) / Zhang, Yuanjian (Autor:in) / Sun, Yao (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.03.2025


    Format / Umfang :

    7765034 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Robust and Data-Driven Control for Autonomous Racing

    Wischnewski, Alexander | TIBKAT | 2023

    Freier Zugriff

    Intelligent information extraction to aid science decision making in autonomous space exploration

    Merényi, Erzsébet / Tasdemir, Kadim / Farrand, William H. | SPIE | 2008



    OVERTAKING ORCHESTRATION SYSTEM FOR AUTONOMOUS RACING

    FILIPENKO MAKSIM / SHIMCHIK ILYA / PROTASOV STANISLAV et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Competition-Aware Decision-Making Approach for Mobile Robots in Racing Scenarios

    Ji, Kyoungtae / Bae, Sangjae / Li, Nan et al. | IEEE | 2024