Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

MIT researchers show randomly wired networks can self-organize learning machinery

AI summary

In a paper published Oct. 9 in PNAS, researchers at MIT's McGovern Institute for Brain Research and the K. Lisa Yang Integrative Computational Neuroscience (ICoN) Center describe a network of randomly interconnected, neuron-like units that, governed by shared local plasticity rules such as "neurons that fire together wire together," assembled its own learning motifs and learned pattern recognition and image classification. The team reports that its self-organizing network performed at a similar level to the backpropagation-trained networks it compared against. The authors argue that a network's ability to organize its own learning machinery, without a developer designing it, should be a key measure of biological plausibility, while cautioning that the result does not show the brain actually uses this mechanism.

In-depth insight

The authors propose self-organization as a core metric for a network's biological plausibility and report performance comparable to backpropagation-trained networks on the tested tasks, while stressing this is not evidence that backpropagation can be replaced in large-scale models.

As artificial intelligence becomes more and more powerful, its ability to handle human-like tasks is undeniable. Artificial neural networks can learn to recognize images, use language, or write computer code. Like the brain’s circuits, they reorganize themselves as they learn, adjusting the strengths of their connections to improve their performance.

The question for many neuroscientists is: What can these machine systems teach them about how the brain learns? And what kinds of models are likely to be the most informative?

In a paper published Oct. 9 in the journal PNAS, scientists at MIT’s McGovern Institute for Brain Research and K. Lisa Yang Integrative Computational Neuroscience (ICoN) Center argue that a crucial metric for the biological plausibility of an artificial neural network’s approach to learning is the network’s ability to organize itself, without the guiding hand of a developer. They show that it is possible for an artificial neural network to build its own learning machinery. With some simple instructions about how and when connections should change, a group of randomly connected units can reshape itself into an effective information-processing network, learning from the data it is trained on.

#MIT#McGovern Institute for Brain Research#K. Lisa Yang ICoN Center#PNAS#Tomaso Poggio#Mark Harnett#Qianli Liao#Liu Ziyin

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.