The lack of trust in algorithms is usually an issue when using Reinforcement Learning (RL) agents for control in real-world domains such as production plants, autonomous vehicles, or traffic-related infrastructure, partly due to the lack of verifiability of the model itself. In such scenarios, Petri nets (PNs) are often available for flowcharts or process steps, as they are versatile and standardized. In order to facilitate integration of RL models and as a step towards increasing AI trustworthiness, we propose an approach that uses PNs with three main advantages over typical RL approaches: Firstly, the agent can now easily be modeled with a combined state including both external environmental observations and agent-specific state information from a given PN. Secondly, we can enforce constraints for state-dependent actions through the inherent PN model. And lastly, we can increase trustworthiness by verifying PN properties through techniques such as model checking. We test our approach on a typical four-way intersection traffic light control setting and present our results, beating cycle-based baselines.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Using Petri Nets as an Integrated Constraint Mechanism for Reinforcement Learning Tasks


    Beteiligte:
    Sachweh, Timon (Autor:in) / Haritz, Pierre (Autor:in) / Liebig, Thomas (Autor:in)


    Erscheinungsdatum :

    02.06.2024


    Format / Umfang :

    2454150 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Controller Design of DES Petri Nets with Mixed Constraint

    Tao, Z. / Xie, L.-y. / Liang, D. | British Library Online Contents | 2005


    Constraint analysis of schedulability and schedulable intervals of time constraint Petri nets

    Wu, Y.-l. / Zeng, J.-c. / Wei, J.-h. et al. | British Library Online Contents | 2002


    Operating rules description using Petri nets

    Lahlou, O. / Bon, P. / Allain, L. | Tema Archiv | 2007


    Airport Traffic Simulation Using Petri Nets

    Skorupski, Jacek | Springer Verlag | 2013


    Airport Traffic Simulation Using Petri Nets

    Skorupski, J. | British Library Conference Proceedings | 2013