Markov Decision Processes and Reinforcement Learning

Markov Decision Processes and Reinforcement Learning book cover

Markov Decision Processes and Reinforcement Learning

Author(s): Martin L. Puterman (Author), Timothy C. Y. Chan (Author)

  • Publisher Finelybook 出版社: Cambridge University Press
  • Publication Date 出版日期: December 10, 2026
  • Language 语言: English
  • Print length 页数: 500 pages
  • ISBN-10: 1009098411
  • ISBN-13: 9781009098410

Book Description

This book offers a comprehensive introduction to Markov decision process and reinforcement learning fundamentals using common mathematical notation and language. Its goal is to provide a solid foundation that enables readers to engage meaningfully with these rapidly evolving fields. Topics covered include finite and infinite horizon models, partially observable models, value function approximation, simulation-based methods, Monte Carlo methods, and Q-learning. Rigorous mathematical concepts and algorithmic developments are supported by numerous worked examples. As an up-to-date successor to Martin L. Puterman’s influential 1994 textbook, this volume assumes familiarity with probability, mathematical notation, and proof techniques. It is ideally suited for students, researchers, and professionals in operations research, computer science, engineering, and economics.

Editorial Reviews

About the Author

Martin L. Puterman is Professor Emeritus at the Sauder School of Business, University of British Columbia. He received the INFORMS Lanchester Prize for his widely cited 1994 book Markov Decision Processes. He is an INFORMS Fellow and has received the CORS Award of Merit, the CORS Practice Prize and the INFORMS Case Competition Award.

Timothy C. Y. Chan is Associate Vice-President and Vice-Provost, Strategic Initiatives and Professor of Industrial Engineering at the University of Toronto. He is an award-winning teacher, having been recognized with the INFORMS Prize for Teaching of OR/MS Practice, the INFORMS Case Competition Award, and the University of Toronto President’s Teaching Award.

View on Amazon

下载地址

PDF | 11 MB | 2026-11-19
下载地址 Download请完成验证以访问链接!
打赏
未经允许不得转载:finelybook » Markov Decision Processes and Reinforcement Learning

评论 抢沙发

觉得文章有用就打赏一下文章作者

您的打赏,我们将继续给力更多优质内容

支付宝扫一扫

微信扫一扫