2009 · 102 citations · 30 references
ComputingComputer ScienceSystems EngineeringArtificial IntelligenceMachine LearningSensor FusionContext-aware FusionDecision-level FusionDeep LearningFeature-level FusionLate FusionMultimodal InteractionClassifier FusionMultimodal Communication SystemsMultimodal FusionMultimodal Input FusionSoftware Frameworks
Fusion engines are fundamental components of multimodal inter-active systems, to interpret input streams whose meaning can vary according to the context, task, user and time. Other surveys have considered multimodal interactive systems; we focus more closely on the design, specification, construction and evaluation of fusion engines. We first introduce some terminology and set out the major challenges that fusion engines propose to solve. A history of past work in the field of fusion engines is then presented using the BRETAM model. These approaches to fusion are then classified. The classification considers the types of application, the fusion principles and the temporal aspects. Finally, the challenges for future work in the field of fusion engines are set out. These include software frameworks, quantitative evaluation, machine learning and adaptation.
30
Maintaining knowledge about temporal intervals
James F. Allen · Communications of the ACM · 1983 · 7.5K citations · Full text
Richard A. Bolt · 1980 · 1.4K citations · Full text
Frank Vetere, Martin Gibbs, Jesper Kjeldskov et al. · 2005 · 1.1K citations
Richard A. Bolt · ACM SIGGRAPH Computer Graphics · 1980 · 904 citations