本文探讨了强化学习中的关键概念，包括Monte-Carlo与Temporal Difference方法、Q-learning算法、SARSA及其与Q-learning的区别。此外，还讨论了on-policy与off-policy两种策略的区别及其应用场景。
模型无关学习
Monte-Carlo & Temporal Difference; Q-learning
探索与利用
on-policy 和 off-policy
SARSA
Expected value SARSA
SARSA和Q-Learning对比
on-policy和off-policy对比
| on-policy | off-policy |
|---|---|
| Agent 可以选择动作 | Agent 不能 选择动作 |
| Most obvious setup | Learning with exploration,playing without exploration |
| Agent always follows his own policy | Learning from expert(expert is imperfect) |
| Learning from sessions(recorded data) | |
| can’t learn from off-policy | can learn from on-policy |
| SARSA | Q-learning |
| more… | Expected Value SARSA |
经验回放
略
扫一扫
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
