It is known that the probability of decoding error has a phase transition at information rate equal to the channel capacity. The corresponding thermodynamic limit requires infinite coding dimension, hence making the actual decoding practically impossible. In this Rapid Communication we analyze finite-size effects that occur in limited neural populations. We report that the achievable rate approaches the asymptote in a remarkably nonlinear manner with the population size. Qualitatively, our findings do not seem to depend on the details of the model.

Institute of Physiology of the Czech Academy of Sciences Videnska 1083 14220 Prague 4 Czech Republic

Principles of Informatics Research Division National Institute of Informatics 2 1 2 Hitotsubashi Chiyoda ku Tokyo Japan

Citace poskytuje Crossref.org

Shared input and recurrency in neural networks for metabolically efficient information transmission

The effect of inhibition on rate code efficiency indicators