Sensors · 2024 · 18 citations · 34 references
ComputingComputer SystemsMarkov Decision ProcessesSchedulingWireless CommunicationsReal-time SchedulingReinforcement LearningWireless NetworksDeep Reinforcement LearningNetwork SchedulingReal-time NetworkingReal-time Wireless CommunicationReinforcement Learning For SchedulingTime-sensitive NetworkingWireless Communication ChannelsWireless Communication Systems
Time-sensitive networking (TSN) technologies have garnered attention for supporting time-sensitive communication services, with recent interest extending to the wireless domain. However, adapting TSN to wireless areas faces challenges due to the competitive channel utilization in IEEE 802.11, necessitating exclusive channels for low-latency services. Additionally, traditional TSN scheduling algorithms may cause significant transmission delays due to dynamic wireless characteristics, which must be addressed. This paper proposes a wireless TSN model of IEEE 802.11 networks for the exclusive channel access and a novel time-sensitive traffic scheduler, named the wireless intelligent scheduler (WISE), based on deep reinforcement learning. We designed a deep reinforcement learning (DRL) framework to learn the repetitive transmission patterns of time-sensitive traffic and address potential latency issues from changing wireless conditions. Within this framework, we identified the most suitable DRL model, presenting the WISE algorithm with the best performance. Experimental results indicate that the proposed mechanisms meet up to 99.9% under the various wireless communication scenarios. In addition, they show that the processing delay is successfully limited within the specific time requirements and the scalability of TSN streams is guaranteed by the proposed mechanisms.
34
Deep Reinforcement Learning: A Brief Survey
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage et al. · IEEE Signal Processing Magazine · 2017 · 4.3K citations
Stable-Baselines3: Reliable Reinforcement Learning Implementations
Antonin Raffin, Ashley Hill, Adam Gleave et al. · elib (German Aerospace Center) · 2021 · 1K citations
Francesco Gringoli, Matthias Schulz, Jakob Link et al. · 2019 · 318 citations
Engineering, Electrical Engineering, Microwave Engineering +16