The Journal of Engineering · 2020 · 13 citations · 12 references
ComputingComputer ScienceElectrical EngineeringForecastingMachine LearningTime Series AnalysisDeep LearningEnergy Demand ForecastingShort-term MemoryTime Series ForecastingTime Series ModelingTime Series PredictionAttentionDeep Learning-based ForecastingElectricity Consumption ForecastingEnergy ConsumptionEnergy PredictionEnergy Prediction ModelsLong Short-term Memory NetworksPrediction Models
With the advent of various electronic products, the household electric energy consumption is continuously increasing, and therefore it becomes very important to predict the household electric energy consumption accurately. Energy prediction models also have been developed for decades with advanced machine learning technologies. Meanwhile, the deep learning models are still actively under study, and many newer models show the state‐of‐the‐art performance. Therefore, it would be meaningful to conduct the same experiment with these new models. Here, the authors predict the household electric energy consumption using deep learning models, known to be suitable for dealing with time‐series data. Specifically, vanilla long short‐term memory (LSTM), sequence to sequence, and sequence to sequence with attention mechanism are used to predict the electric energy consumption in the household. As a result, the vanilla LSTM shows the best performance on the root‐mean‐square error metric. However, from a graphical point of view, it seems that the sequence‐to‐sequence model predicts the energy consumption patterns best and the vanilla LSTM does not follow the pattern well. Also, to achieve the best performance of each deep learning model, vanilla LSTM, sequence to sequence, and sequence to sequence with attention mechanism should observe past 72, 72, and 24 h, respectively.
12
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
Automatic differentiation in PyTorch
Adam Paszke, Sam Gross, Soumith Chintala et al. · 2017 · 11.1K citations