IEEE Transactions on Artificial Intelligence · 2024 · 13 citations · 29 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNeural EngineeringDendritic ComputationNeural ModelingNeural NetworksDendritic ArchitectureFeature ClassificationNeural Network Classification
The addition of dendritic inhibition has been shown to significantly enhance the computational and representational capabilities of neurons. However, this inhibitory mechanism is mostly ignored in the existing artificial neural networks (ANNs). In this article, we propose the alternating excitatory and inhibitory mechanisms and use them to construct an ANN-based dendritic neuron, the alternating excitation–inhibition dendritic neuron model (ADNM). Subsequently, a comprehensive multilayer neural system named the alternating excitation–inhibition dendritic neuron system (ADNS) is constructed by networking multiple ADNMs. To evaluate the performance of ADNS, a series of extensive experiments are implemented to compare it with other state-of-the-art networks on a diverse set consisting of 47 feature-based classification datasets and two image-based classification datasets. The experimental results demonstrate that ADNS outperforms its competitors in classification tasks. In addition, the impact of different hyperparameters on the performance of the neural model is analyzed and discussed. In summary, the study provides a novel dendritic neuron model (DNM) with better performance and interpretability for practical classification tasks.
29
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Inhibition dominates sensory responses in the awake cortex
Bilal Haider, Michael Häusser, Matteo Carandini · Nature · 2012 · 587 citations
R-Drop: Regularized Dropout for Neural Networks
Xiaobo Liang, Lijun Wu, Juntao Li et al. · arXiv (Cornell University) · 2021 · 306 citations · Full text