IEEE Journal on Selected Areas in Communications · 2024 · 50 citations · 59 references
EngineeringAerospace EngineeringElectrical EngineeringAntennasOptimizationWireless CommunicationsNetwork OptimizationPower OptimizationRoutingSatellite Constellation ArchitectureSmart AntennasTerahertz Photonics6G Mobile Networks6G NetworksJoint OptimizationMulti-agent OptimizationProximal Policy OptimizationSatellite ConstellationsSignal TransmissionTerahertz Communications
Satellite systems face a significant challenge in effectively utilizing limited communication resources to meet the demands of ground network traffic, characterized by asymmetrical spatial distribution and time-varying characteristics. Moreover, the coverage range and signal transmission distance of low Earth orbit (LEO) satellites are restricted by notable propagation attenuation, molecular absorption, and space losses in sub-terahertz (THz) frequencies. This paper introduces a novel approach to maximize LEO satellite coverage by leveraging reconfigurable intelligent surface (RIS) within 6G sub-THz networks. Optimization objectives include improving end-to-end (E2E) data rate, optimizing satellite-remote user equipment (RUE) associations, data packet routing within satellite constellations, RIS phase shift, and ground base station (GBS) transmit power (i.e., active beamforming). The formulated joint optimization problem poses significant challenges because of its time-varying environment, non-convex characteristics, and NP-hard complexity. To address these challenges, we propose a block coordinate descent (BCD) algorithm that integrates balanced K-means clustering, multi-agent proximal policy optimization (MAPPO) deep reinforcement learning (DRL), and whale optimization algorithm (WOA) techniques. The performance of the proposed approach is demonstrated through comprehensive simulation results, demonstrating its superiority over existing baseline methods in the literature.
59
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
The Whale Optimization Algorithm
Seyedali Mirjalili, Andrew Lewis · Advances in Engineering Software · 2016 · 14K citations