Container terminals face tremendous pressure to improve their throughput due to the expanding global shipping market. As a key for throughput, handling capacity requires effective coordination between various automated facilities. Observed from the operational practice of Tianjin port, a world-leading smart port, four critical facilities, namely quay cranes, lock stations, intersections, and yard cranes, are identified as bottlenecks that impact handling efficiency. Congestion at these facilities, in particular, pose significant challenges to terminal managers. To address these issues, we investigate an integrated terminal scheduling problem and formulate this novel problem as a mixed-integer linear program, from which we derive two efficient lower bounds. To tackle practical-sized problems, we propose a reinforcement learning (RL)-based algorithm with two modules. The offline module uses RL to learn from abundant historical data. When actual instance information is available, the online module enhances offline decisions using a rollout mechanism and mathematical programming. The proposed algorithm employs a pre-trained offline policy to handle extensive computations before actual decision-making and an online phase that provides a streamlined and stable method to enhance the solution. Extensive experiments validate the effectiveness of the proposed algorithm, demonstrating an 18.22% reduction in makespan compared to the rule-based heuristic used in actual port operations.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Integrated Scheduling Optimization for Automated Container Terminal: A Reinforcement Learning-Based Approach


    Contributors:
    Wang, Qi (author) / Tong, Xialiang (author) / Li, Yantong (author) / Wang, Chong (author) / Zhang, Canrong (author)


    Publication date :

    2025-07-01


    Size :

    2520480 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Integrated Scheduling Optimization of Handling Operations in Container Terminal

    Qian, Ji Feng ;Zhu, Xiao Ning ;Liu, Zhan Dong | Trans Tech Publications | 2013



    Integrated Scheduling of Quay Cranes and Automated Lifting Vehicles in Automated Container Terminal with Unlimited Buffer Space

    Sadeghian, Seyed Hamidreza / Ariffin, Mohd Khairol Anuar bin Mohd / Hong, Tang Sai et al. | Springer Verlag | 2014


    Automatic container terminal AGV charging scheduling optimization method

    YANG WEI / ZUO HAOYU / YANG SIYAO | European Patent Office | 2024

    Free access