This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decision-makers (or players) try to optimize their own objective function. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science, among ...
Read More
This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decision-makers (or players) try to optimize their own objective function. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science, among other areas.An extensive, self-contained, up-to-date analysis of basic optimality criteria (such as discounted and average reward), and advanced optimality criteria (e.g., bias, overtaking, sensitive discount, and Blackwell optimality) is presented. A particular emphasis is made on the application of the results herein: algorithmic and computational issues are discussed, and applications to population models and epidemic processes are shown.This book is addressed to students and researchers in the fields of stochastic control and stochastic games. Moreover, it could be of interest also to undergraduate and beginning graduate students because the reader is not supposed to have a high mathematical background: a working knowledge of calculus, linear algebra, probability, and continuous-time Markov chains should suffice to understand the contents of the book.
Read Less
Add this copy of Selected Topics on Continuous-Time Controlled Markov to cart. $21.25, very good condition, Sold by Suffolk Books rated 5.0 out of 5 stars, ships from center moriches, NY, UNITED STATES, published 2012 by Imperial College Press.
Add this copy of Selected Topics on Continuous-Time Controlled Markov to cart. $22.99, good condition, Sold by Big River Books rated 5.0 out of 5 stars, ships from Powder Springs, GA, UNITED STATES, published 2012 by Imperial College Press.
Choose your shipping method in Checkout. Costs may vary based on destination.
Seller's Description:
This book is in good condition. The cover has minor creases or bends. The binding is tight and pages are intact. Some pages may have writing or highlighting.
Add this copy of Selected Topics on Continuous-Time Controlled Markov to cart. $50.26, good condition, Sold by Bonita rated 4.0 out of 5 stars, ships from Santa Clarita, CA, UNITED STATES, published 2012 by Imperial College Press.
Add this copy of Selected Topics on Continuous-Time Controlled Markov to cart. $67.57, like new condition, Sold by Bedlam Books & Music rated 5.0 out of 5 stars, ships from Leominster, HEREFORDSHIRE, UNITED KINGDOM, published 2012 by Imperial College Press.
Choose your shipping method in Checkout. Costs may vary based on destination.
Seller's Description:
Fine. Slight rubbing to edges otherwise in excellent condition. Appears unread. Next day dispatch by Royal Mail in sturdy, recyclable packaging. 1000's of satisfied customers! Please contact us with any enquiries.
Add this copy of Selected Topics on Continuous-Time Controlled Markov to cart. $98.29, new condition, Sold by discount_scientific_books rated 5.0 out of 5 stars, ships from Sterling Heights, MI, UNITED STATES, published 2012 by Imperial College Press.
Add this copy of Selected Topics on Continuous-Time Controlled Markov to cart. $100.72, new condition, Sold by Media Smart rated 4.0 out of 5 stars, ships from Hawthorne, CA, UNITED STATES, published 2012 by Imperial College Press.
Add this copy of Selected Topics on Continuous-Time Controlled Markov to cart. $159.69, new condition, Sold by Bonita rated 4.0 out of 5 stars, ships from Santa Clarita, CA, UNITED STATES, published 2012 by Imperial College Press.
