创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

MIT研究:神经网络可自组织搭建学习机制

AI 总结

麻省理工学院麦戈文脑研究所与K. Lisa Yang整合计算神经科学中心(ICoN)的研究人员于10月9日在《PNAS》发表论文,描述了一种由随机互连的类神经元单元构成的自组织网络:在「同时激活的神经元会强化连接」等统一局部可塑性规则下,网络自行组装出学习基元,并学会模式识别与图像分类。研究团队称,在所做对比中,该自组织网络的性能与采用反向传播式梯度下降训练的网络相当。作者主张,一个网络能否在没有开发者设计的情况下自行组织出学习机制,应成为衡量其生物学合理性的关键指标;但他们也明确提醒,这并不证明大脑实际使用该机制。

深度见解

作者提出自组织能力应作为评判神经网络生物学合理性的核心指标,并报告其模型在测试任务上与反向传播训练的网络表现相近,同时强调这不代表大模型中反向传播可被替代。

As artificial intelligence becomes more and more powerful, its ability to handle human-like tasks is undeniable. Artificial neural networks can learn to recognize images, use language, or write computer code. Like the brain’s circuits, they reorganize themselves as they learn, adjusting the strengths of their connections to improve their performance.

The question for many neuroscientists is: What can these machine systems teach them about how the brain learns? And what kinds of models are likely to be the most informative?

In a paper published Oct. 9 in the journal PNAS, scientists at MIT’s McGovern Institute for Brain Research and K. Lisa Yang Integrative Computational Neuroscience (ICoN) Center argue that a crucial metric for the biological plausibility of an artificial neural network’s approach to learning is the network’s ability to organize itself, without the guiding hand of a developer. They show that it is possible for an artificial neural network to build its own learning machinery. With some simple instructions about how and when connections should change, a group of randomly connected units can reshape itself into an effective information-processing network, learning from the data it is trained on.

#MIT#McGovern Institute for Brain Research#K. Lisa Yang ICoN Center#PNAS#Tomaso Poggio#Mark Harnett#Qianli Liao#Liu Ziyin

原文约 4 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。