Where is the error? Hierarchical predictive coding through dendritic error computation

Mammals adapt to a rapidly changing world because of the sophisticated cognitive functions that are supported by the neocortex. The neocortex, which forms almost 80% of the human brain, seems to have arisen from repeated duplication of a stereotypical microcircuit template with subtle specializations for different brain regions and species. The quest to unravel the blueprint of this template started more than a century ago and has revealed an immensely intricate design. The largest obstacle is the daunting variety of inhibitory interneurons that are found in the circuit. This review focuses on the organizing principles that govern the diversity of inhibitory interneurons and their circuits.

We describe a model of visual processing in which feedback connections from a higher- to a lower-order visual cortical area carry predictions of lower-level neural activities, whereas the feedforward connections carry the residual errors between the predictions and the actual lower-level activities. When exposed to natural images, a hierarchical network of model neurons implementing such a model developed simple-cell-like receptive fields. A subset of neurons responsible for carrying the residual errors showed endstopping and other extra-classical receptive-field effects. These results suggest that rather than being exclusively feedforward phenomena, nonclassical surround effects in the visual cortex may also result from cortico-cortical feedback as a consequence of the visual system using an efficient hierarchical strategy for encoding natural images.

We explore the extent to which neocortical circuits generalize, i.e., to what extent can neocortical neurons and the circuits they form be considered as canonical? We find that, as has long been suspected by cortical neuroanatomists, the same basic laminar and tangential organization of the excitatory neurons of the neocortex is evident wherever it has been sought. Similarly, the inhibitory neurons show characteristic morphology and patterns of connections throughout the neocortex. We offer a simple model of cortical processing that is consistent with the major features of cortical circuits: The superficial layer neurons within local patches of cortex, and within areas, cooperate to explore all possible interpretations of different cortical input and cooperatively select an interpretation consistent with their various cortical and subcortical inputs.