Table of Contents

A Reward-Modulated Hebbian Learning Rule Can Explain Experimentally Observed Network Reorganization in a Brain Control Task

  1. Wolfgang Maass1
  1. 1Institute for Theoretical Computer Science, Graz University of Technology, 8010 Graz, Austria,
  2. 2Department of Neurobiology, University of Pittsburgh, Pittsburgh, Pennsylvania 15213,
  3. 3Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, and
  4. 4Department of Statistics, Carnegie Mellon University, Pittsburgh, PA 15213
  1. Correspondence should be addressed to Robert Legenstein, Institute for Theoretical Computer Science, Graz University of Technology, Inffeldgasse 16b, 8010 Graz, Austria. legi{at}igi.tugraz.at

Abstract

It has recently been shown in a brain–computer interface experiment that motor cortical neurons change their tuning properties selectively to compensate for errors induced by displaced decoding parameters. In particular, it was shown that the three-dimensional tuning curves of neurons whose decoding parameters were reassigned changed more than those of neurons whose decoding parameters had not been reassigned. In this article, we propose a simple learning rule that can reproduce this effect. Our learning rule uses Hebbian weight updates driven by a global reward signal and neuronal noise. In contrast to most previously proposed learning rules, this approach does not require extrinsic information to separate noise from signal. The learning rule is able to optimize the performance of a model system within biologically realistic periods of time under high noise levels. Furthermore, when the model parameters are matched to data recorded during the brain–computer interface learning experiments described above, the model produces learning effects strikingly similar to those found in the experiments.