Advanced Functional Materials · 2021 · 249 citations · 60 references
EngineeringMaterials EngineeringSensor FusionSensorsVisual PerceptionMemristive MaterialsMultisensory IntegrationSensor MaterialsSensory IntegrationSensory SystemsHumidityNeuromorphic DevicesNeuromorphic HardwareOxide Memristive MaterialsOxygen VacanciesRelative Humidity InfluenceResistive SwitchingResistive Switching Materials
In‑sensor computing, where sensors directly process data, has been proposed to boost AI efficiency, yet current work focuses on single modalities while human perception integrates multiple senses and is affected by environmental factors such as extreme humidity. The authors design a multi‑modal MXene‑ZnO memristor that integrates visual sensing, humidity sensing, and preprocessing to emulate the human eye’s adaptive behavior. Its resistive switching is controlled by photon‑ and proton‑induced oxygen‑vacancy filament formation. The device was shown to perform in‑sensor computing by filtering and updating weights with humidity adaptability, demonstrating that multimodal sensing can reduce circuit complexity and advance device‑level intelligence.
Abstract Recently, in‐sensor computing with individual sensors or multiple connected sensors directly processing information has been proposed to improve energy, area, and time efficiency of artificial intelligence systems. Current investigations mainly focus on a single sensory processing such as auditory, visual, tactile, olfactory, and so on. However, a human perception system can sense and process different types of information with a complex environment and small perceptive field simultaneously. For example, the recognition accuracy of human eyes is highly affected by the environment such as extremely low or high relative humidity (RH). Here, a multi‐modal MXene‐ZnO memristor that combines visual data sensing, RH sensing, and pre‐processing functions to emulate the unique environmental adaptive behavior of the human eye is designed and constructed. The multi‐field controlled resistive switching of the MXene‐ZnO memristor is originated from the photon‐/protons‐regulated formation of oxygen vacancies filaments. Finally, in‐sensor computing with a MXene‐ZnO memristor functioning as both filter to preprocess the information and synapse to implement a weight updating process with different humidity adaptability has been demonstrated. Multimodal in‐sensor computing provides the potential to reduce the underlying circuitry complexity of the traditional neuromorphic visual system and contributes to the development of intelligence in device‐level implementations.
60
Alexey Lipatov, Mohamed Alhabeb, Maria R. Lukatskaya et al. · Advanced Electronic Materials · 2016 · 1.7K citations · Full text
A bioinspired flexible organic artificial afferent nerve
Yeongin Kim, Alex Chortos, Wentao Xu et al. · Science · 2018 · 1.4K citations
Optoelectronic resistive random access memory for neuromorphic vision sensors
Feichi Zhou, Zheng Zhou, Jiewei Chen et al. · Nature Nanotechnology · 2019 · 1.3K citations