KIP publications

year 2020
author(s) Johannes Weis, Philipp Spilger, Sebastian Billaudelle, Yannik Stradmann, Arne Emmel, Eric Müller, Oliver Breitwieser, Andreas Grübl, Joscha Ilmberger, Vitali Karasenko, Mitja Kleider, Christian Mauch, Korbinian Schreiber, Johannes Schemmel
title Inference with Artificial Neural Networks on Analog Neuromorphic Hardware
KIP-Nummer HD-KIP 20-104
KIP-Gruppe(n) F9
document type Paper
Keywords Analog Accelerator, Neural Network Processor, Neuromorphic Hardware, Convolutional Neural Networks, Machine Learning, In-memory Computing, MNIST
source Communications in Computer and Information Science, vol 1325 (2020), pp 201-212
doi https://doi.org/10.1007/978-3-030-66770-2_15
Abstract (en)

The neuromorphic BrainScaleS-2 ASIC comprises mixed-signal neurons and synapse circuits as well as two versatile digital microprocessors. Primarily designed to emulate spiking neural networks, the system can also operate in a vector-matrix multiplication and accumulation mode for artificial neural networks. Analog multiplication is carried out in the synapse circuits, while the results are accumulated on the neurons' membrane capacitors. Designed as an analog, in-memory computing device, it promises high energy efficiency. Fixed-pattern noise and trial-to-trial variations, however, require the implemented networks to cope with a certain level of perturbations. Further limitations are imposed by the digital resolution of the input values (5 bit), matrix weights (6 bit) and resulting neuron activations (8 bit). In this paper, we discuss BrainScaleS-2 as an analog inference accelerator and present calibration as well as optimization strategies, highlighting the advantages of training with hardware in the loop. Among other benchmarks, we classify the MNIST handwritten digits dataset using a two-dimensional convolution and two dense layers. We reach 98.0% test accuracy, closely matching the performance of the same network evaluated in software.

bibtex
@inproceedings{weis2020inference,
  author   = {Weis, Johannes and Spilger, Philipp and Billaudelle, Sebastian and Stradmann, Yannik and Emmel, Arne and M{\"u}ller, Eric and Breitwieser, Oliver and Gr{\"u}bl, Andreas and Ilmberger, Joscha and Karasenko, Vitali and Kleider, Mitja and Mauch, Christian and Schreiber, Korbinian and Schemmel, Johannes},
  title    = {Inference with Artificial Neural Networks on Analog Neuromorphic Hardware},
  booktitle = {IoT Streams for Data-Driven Predictive Maintenance and IoT, Edge, and Mobile for Embedded Machine Learning},
  year     = {2020},
  volume   = {1325},
  pages    = {201--212},
  publisher = {Springer International Publishing}
}
URL Springer Link
URL arXiv
KIP - Bibliothek
Im Neuenheimer Feld 227
Raum 3.402
69120 Heidelberg