Efficient simulation of large-scale spiking neural networks using CUDA graphics processors
Center for Embedded Systems, Bren School of Information and Computer Science, University of California, Irvine, USA 92697
In IJCNN’09: Proceedings of the 2009 international joint conference on Neural Networks (2009), pp. 3201-3208.
@conference{nageswaran2009efficient,
title={Efficient simulation of large-scale spiking neural networks using CUDA graphics processors},
author={Nageswaran, J.M. and Dutt, N. and Krichmar, J.L. and Nicolau, A. and Veidenbaum, A.},
booktitle={Neural Networks, 2009. IJCNN 2009. International Joint Conference on},
pages={2145–2152},
issn={1098-7576},
year={2009},
organization={IEEE}
}
Neural network simulators that take into account the spiking behavior of neurons are useful for studying brain mechanisms and for engineering applications. Spiking Neural Network (SNN) simulators have been traditionally simulated on large-scale clusters, super-computers, or on dedicated hardware architectures. Alternatively, Graphics Processing Units (GP Us) can provide a low-cost, programmable, and high-performance computing platform for simulation of SNNs. In thi s paper we demonstrate an efficient, Izhikevich neuron based large-scale SNN simulator that runs on a single GPU. The GPU-SNN model (running on an NVIDIA GTX-280 with 1GB of memory), is up to 26 times faster than a CPU version for the simulation of 100K neurons with 50 Million synaptic connections, firing at an average rate of 7Hz. For simulation of 100K neurons with 10 Million synaptic connections, the GPUSNN model is only 1.5 times slower than real-time. Further, we present a collection of new techniques related to parallelism extraction, mapping of irregular communication, and compact network representation for effective simulation of SNNs on GPUs. The fidelity of the simulation results were validated against CPU simulations using firing rate, synaptic weight distribution, and inter-spike interval analysis. We intend to make our simulator available to the modeling community so that researchers will have easy access to large-scale SNN simulations.
November 6, 2010 by hgpu
