2009 · 91 citations · 15 references
ComputingComputer ScienceHigh-performance ComputingCluster ComputingNeural EngineeringParallel ComputingGraphics Processing Unit ArchitectureGraphics Processing Unit ComputingGraphics Processing UnitsLarge-scale Brain SimulationParallel ArchitecturesSpiking Neural NetworksHigh-performance Computing SystemsNetwork RepresentationNeural Network ModelingParallel Neural SimulationParallelism ExtractionScientific Computing On GpusSpiking Neural Network ModelsSpiking Neuron Models
Neural network simulators that take into account the spiking behavior of neurons are useful for studying brain mechanisms and for engineering applications. Spiking neural network (SNN) simulators have been traditionally simulated on large-scale clusters, super-computers, or on dedicated hardware architectures. Alternatively, graphics processing units (GPUs) can provide a low-cost, programmable, and high-performance computing platform for simulation of SNNs. In this paper we demonstrate an efficient, Izhikevich neuron based large-scale SNN simulator that runs on a single GPU. The GPU-SNN model (running on an NVIDIA GTX-280 with 1 GB of memory), is up to 26 times faster than a CPU version for the simulation of 100 K neurons with 50 million synaptic connections, firing at an average rate of 7 Hz. For simulation of 100 K neurons with 10 million synaptic connections, the GPU-SNN model is only 1.5 times slower than real-time. Further, we present a collection of new techniques related to parallelism extraction, mapping of irregular communication, and compact network representation for effective simulation of SNNs on GPUs. The fidelity of the simulation results were validated against CPU simulations using firing rate, synaptic weight distribution, and inter-spike interval analysis. We intend to make our simulator available to the modeling community so that researchers will have easy access to large-scale SNN simulations.
15
Simple model of spiking neurons
Eugene M. Izhikevich · IEEE Transactions on Neural Networks · 2003 · 4.8K citations
Polychronization: Computation with Spikes
Eugene M. Izhikevich · Neural Computation · 2005 · 1.1K citations
Cortical Development and Remapping through Spike Timing-Dependent Plasticity
Sen Song, L. F. Abbott · Neuron · 2001 · 484 citations · Full text