IEEE Wireless Communications Letters · 2023 · 32 citations · 14 references
ComputingComputer ScienceComputer VisionMachine LearningVisual AttentionAttention NetworksPattern RecognitionRepresentation LearningSpatial AttentionSpatial AutocorrelationTime Series PredictionAttentionSpatial Attention NetworksSpectral Forecasting
In this letter, we develop an Autoformer with a series channel-spatial attention module (CSAM) (Autoformer-CSA) for long-term spectrum prediction. More specifically, the CSAM ingeniously replaces 2-dimensional (2D) convolution in image attention (including channel attention and spatial attention) with 1-dimensional (1D) convolution. The CSAM replaces Autoformer’s feed-forward network. It is used to assign different concentrations to features mapped to the high-dimensional space, improving the learning ability of the Autoformer. We follow the series decomposition block and auto-correlation mechanism of the Autoformer. Experiments on a real-world dataset show that the Autoformer-CSA is superior to the state-of-the-art benchmarks.
14
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Norbert Wiener · Acta Mathematica · 1930 · 1.8K citations · Full text