创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Double DQN学习笔记发布,附交互式训练环境

AI 总结

作者East-Muffin-6472宣布在neatrl发布《Double DQN From Scratch》网页版学习笔记。材料介绍了Double DQN与经典DQN的差异,将其描述为一种离策略、无模型、价值学习方法。作者将经典DQN的Q值高估偏差归因于目标Q网络中的最大值算子,并讨论了Double DQN引入的优化变化。笔记还包括理论、概念、代码、所需数学知识以及用于训练智能体的交互式环境。

深度见解

此次发布将Double DQN的动机与实现说明同交互式智能体训练环境结合起来,使学习者能够在浏览器中探索该方法。

Web-based version of my short notes on Double DQN from Scratch is out on neatrl! Continuing my series on releasing notes on RL From Scratch - here, I have answered questions around the what, the why and the how of Double DQNs over DQNs! It is an off-policy, model-free and value-based method, the same family as DQNs but with a subtle difference for optimization purposes! Well, with the previous DQN, a problem that it did not addressed, is that of overestimation of Q values from the Target Q Network, which leads to an overestimation bias Now this is bad because then there could many false positives for action selection via max operator since it cannot be known if the action is over the maximum value of Q or not (as it is still learning and slow every k steps) This upward bias is caused by the max operator in the Target Q Network! More on the - theory, - concepts, - code and required math and a - playground to train live agent on my web version of the notes! All of it to understand the basics and get the intuition Do check it out and let me know your feedbacks on it! submitted by /u/East-Muffin-6472 [link] [comments]

#Double DQN#DQN#neatrl

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。