IEEE Transactions on Automation Science and Engineering · 2019 · 23 citations · 39 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceMachine LearningRoboticsActive PerceptionDeep LearningMultimodal InteractionMultisensory IntegrationMulti-modal Sensor FusionMultimodal FusionMultimodal Machine LearningMultimodal SensingMultimodal Sensor FusionNeural Network Fusion ArchitecturesScalable Sensor FusionSensor Data Integration
The fusion of sensor data is an essential requirement for active perception in autonomous robots in order to accurately perceive an environment, make appropriate adjustments that improve the understanding of the environment and generate actionable insights. Despite a large body of literature in this domain, only a handful of research focuses on unsupervised machine learning, which is increasingly important in unlabeled, unknown environments. This paper proposes a scalable self-organizing neural architecture for environmental perception based on multimodal fusion using unsupervised machine learning. Inspired by the biological counterpart, the neural architecture consists of topographic maps across each modality and incorporates a novel scalable self-organization process that handles high volume, high-velocity sensor data. The co-occurrence relationships across modalities are captured in cross-modal connections and the reverse Hebbian projection is used for multimodal representation. This proposed unsupervised machine learning-based scalable fusion technique was implemented on Apache Hadoop and Apache Spark. It was validated using an extensive multimodal human activity sensor dataset to demonstrate efficient representation and multimodal fusion for active perception.
39
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Measures of the Amount of Ecologic Association Between Species
Lee R. Dice · Ecology · 1945 · 11.9K citations
Teuvo Kohonen · Proceedings of the IEEE · 1990 · 8.2K citations
Hearing lips and seeing voices
Harry McGurk, John MacDonald · Nature · 1976 · 6.1K citations