Vehicular networks have stringent quality of service (QoS) requirements in terms of reliability, throughput, and latency. With the emergence of diverse services for autonomous driving, the resource contention in vehicle-to-vehicle communication can cause unavoidable packet loss and, therefore, must be handled for safety. Moreover, different levels of QoS should be defined for each service and task; however, existing solutions can neither provide a resource allocation scheme for any level of QoS requirement nor serve new stringent services without configuration or modification. We propose a distributed hierarchical deep Q-network (DH-DQN) to handle resource contention specifically. Thus, an intelligence resource management (I-RM) scheme is designed to serve on-demand QoSs. We first formulate the problem to address multiple QoS requirements, which extends the coverage of resource management tasks for on-demand stringent services. From the perspective of transmission pattern, we designed a hierarchical DQN structure that deals with resource block contention in a fully distributed manner and a state-action framework that enables a numerically defined service demand. In addition, a target $\epsilon $ -greedy is proposed to accelerate convergence, and a modified transfer learning algorithm is used to enhance learning performance for various levels of service. Through extensive simulations, we demonstrated that the proposed DH-DQN can learn successful transmission patterns to meet different levels of multiple QoS requirements.
Multiple QoS Enabled Intelligent Resource Management in Vehicle-to-Vehicle Communication
IEEE Transactions on Intelligent Transportation Systems ; 25 , 9 ; 12081-12094
2024-09-01
4740841 byte
Article (Journal)
Electronic Resource
English
MESSAGE TRANSMISSION FOR VEHICLE-TO-VEHICLE COMMUNICATION ENABLED DEVICES
European Patent Office | 2019
|Message transmission for vehicle-to-vehicle communication enabled devices
European Patent Office | 2017
|European Patent Office | 2020
|Intelligent vehicle management system and intelligent vehicle management method
European Patent Office | 2015
|