Challenges in multimodal data fusion

Dana Lahat, Christian Jutten

2016 · 27 citations · 11 references

Full text

Open access

Concepts

Abstract

In various disciplines, information about the same phe-nomenon can be acquired from different types of detectors, at different conditions, different observations times, in multiple experiments or subjects, etc. We use the term “modality ” to denote each such type of acquisition framework. Due to the rich characteristics of natural phenomena, as well as of the en-vironments in which they occur, it is rare that a single modal-ity can provide complete knowledge of the phenomenon of interest. The increasing availability of several modalities at once introduces new degrees of freedom, which raise ques-tions beyond those related to exploiting each modality sepa-rately. It is the aim of this paper to evoke and promote various challenges in multimodal data fusion at the conceptual level, without focusing on any specific model, method or applica-tion. Index Terms — Data fusion, multimodality 1.

References

11