Computer Systems Science and Engineering · 2021 · 19 citations · 28 references
ComputingComputer ScienceInformation TechnologyComputer SecurityMachine LearningNatural Language ProcessingAnomaly DetectionAnomaly Detection In Time SeriesDeep LearningFault DetectionGenerative ModelingLog AnalysisAnomaly Detection In LogsConvolutional Neural NetworksDeep Learning-based Anomaly DetectionEncoder-decoder ArchitecturesGenerative Adversarial NetworksLong Short-term Memory NetworksMachine Learning For Log AnalysisPrecision
Detecting anomaly logs is a great significance step for guarding system faults. Due to the uncertainty of abnormal log types, lack of real anomaly logs and accurately labeled log datasets. Existing technologies cannot be enough for detecting complex and various log point anomalies by using human-defined rules. We propose a log anomaly detection method based on Generative Adversarial Networks (GAN). This method uses the Encoder-Decoder framework based on Long Short-Term Memory (LSTM) network as the generator, takes the log keywords as the input of the encoder, and the decoder outputs the generated log template. The discriminator uses the Convolutional Neural Networks (CNN) to identify the difference between the generated log template and the real log template. The model parameters are optimized automatically by iteration. In the stage of anomaly detection, the probability of anomaly is calculated by the Euclidean distance. Experiments on real data show that this method can detect log point anomalies with an average precision of 95%. Besides, it outperforms other existing log-based anomaly detection methods.
28
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Generative Adversarial Networks
arXiv (Cornell University) · 2014 · 4.6K citations · Full text
Min Du, Li Fei-Fei, Guineng Zheng et al. · 2017 · 1.6K citations