QuEST for Information Fusion in Multimedia Reports

Abstract

Qualia-based Exploitation of Sensing Technology (QuEST) is an approach to create a cognitive exoskeleton to improve human-machine decision quality. In this paper, the authors present QuEST-motivated man-machine information fusion with an example for multimedia narratives. User-based situation awareness includes both elements of external sensory perception and internal cognitive explanation. The authors outline QuEST elements and tenets towards a reasoning approach that achieves human intelligence amplification (IA) in relation to data aggregation from machine artificial intelligence (AI). In a use case example for multimedia exploitation, they showcase the need for enhanced understanding of the man (mind-body cognition) and the machine (sensor-based reasoning) for establishing a cohesive narrative of situational activities. QuEST tenets of structurally coherent, situated conceptualization, and simulated experience are utilized in organizing multimedia reports of Video Event Segmentation by Text (VEST).