The limits on maximum information that can be transferred by single neurons may help us to understand how sensory and other information is being processed in the brain. According to the efficient-coding hypothesis (Barlow, Sensory Comunication, MIT press, Cambridge, 1961), neurons are adapted to the statistical properties of the signals to which they are exposed. In this paper we employ methods of information theory to calculate, both exactly (numerically) and approximately, the ultimate limits on reliable information transmission for an empirical neuronal model. We couple information transfer with the metabolic cost of neuronal activity and determine the optimal information-to-metabolic cost ratios. We find that the optimal input distribution is discrete with only six points of support, both with and without a metabolic constraint. However, we also find that many different input distributions achieve mutual information close to capacity, which implies that the precise structure of the capacity-achieving input is of lesser importance than the value of capacity.

Institute of Physiology AS CR v v i 1083 Prague 4 Videnska 14220 Czech Republic

References provided by Crossref.org

Shared input and recurrency in neural networks for metabolically efficient information transmission

The effect of inhibition on rate code efficiency indicators

Moth olfactory receptor neurons adjust their encoding efficiency to temporal statistics of pheromone fluctuations

Coding accuracy on the psychophysical scale