Neural Information Processing Systems · 2017 · 213 citations · 22 references
ComputingComputer ScienceMachine LearningPredictive AnalyticsStochastic ProcessesGenerative ModelingNeural NetworksState-space ModelingTime Series ForecastingTime Series ModelingTime Series PredictionContinuous-time ModelsEvent TypesHidden-state ModelsMissing DataMultivariate Point PatternsMultivariate Point ProcessesPredictive PerformanceRecurrent Neural Networks
Events in the world can be stochastically excited or inhibited by patterns in the sequence of prior events. The study aims to discover such patterns to predict which event type will occur next and when. The authors introduce a neurally self‑modulating multivariate point process in which event intensities evolve via a continuous‑time LSTM that conditions future intensities on the recurrent network’s hidden state. The model shows desirable qualitative behavior and achieves competitive likelihood and predictive accuracy on real and synthetic datasets, even under missing‑data conditions.
Many events occur in the world. Some event types are stochastically excited or inhibitedߞin the sense of having their probabilities elevated or decreasedߞby patterns in the sequence of previous events. Discovering such patterns can help us predict which type of event will happen next and when. We model streams of discrete events in continuous time, by constructing a neurally self-modulating multivariate point process in which the intensities of multiple event types evolve according to a novel continuous-time LSTM. This generative model allows past events to influence the future in complex and realistic ways, by conditioning future event intensities on the hidden state of a recurrent neural network that has consumed the stream of past events. Our model has desirable qualitative properties. It achieves competitive likelihood and predictive accuracy on real and synthetic datasets, including under missing-data conditions.
22
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
{SNAP Datasets}: {Stanford} Large Network Dataset Collection
Jure Leskovec, Andrej Krevl · 2014 · 2.8K citations
Causal inference in statistics: An overview
Judea Pearl · Statistics Surveys · 2009 · 2.3K citations · Full text
Spectra of some self-exciting and mutually exciting point processes
Alan G. Hawkes · Biometrika · 1971 · 2.2K citations
LSTM neural networks for language modeling
Martin Sundermeyer, Ralf Schlüter, Hermann Ney · 2012 · 2K citations
Computing, Computer Science, French +14