Put together by two top researchers in the Far East, this text examines Markov Decision Processes - also called stochastic dynamic programming - and their applications in the optimal control of discrete event systems, optimal replacement, and optimal allocations in sequential online auctions. This dynamic new book offers fresh applications of MDPs in areas such as the control of discrete event systems and the optimal allocations in sequential online auctions.

Von der hinteren Coverseite

Markov decision processes (MDPs), also called stochastic dynamic programming, were first studied in the 1960s. MDPs can be used to model and solve dynamic decision-making problems that are multi-period and occur in stochastic circumstances. There are three basic branches in MDPs: discrete-time MDPs, continuous-time MDPs and semi-Markov decision processes. Starting from these three branches, many generalized MDPs models have been applied to various practical problems. These models include partially observable MDPs, adaptive MDPs, MDPs in stochastic environments, and MDPs with multiple objectives, constraints or imprecise parameters.

Markov Decision Processes With Their Applications examines MDPs and their applications in the optimal control of discrete event systems (DESs), optimal replacement, and optimal allocations in sequential online auctions. The book presents four main topics that are used to study optimal control problems:

*a new methodology for MDPs with discounted total reward criterion;

*transformation of continuous-time MDPs and semi-Markov decision processes into a discrete-time MDPs model, thereby simplifying the application of MDPs;

*MDPs in stochastic environments, which greatly extends the area where MDPs can be applied;

*applications of MDPs in optimal control of discrete event systems, optimal replacement, and optimal allocation in sequential online auctions.

This book is intended for researchers, mathematicians, advanced graduate students, and engineers who are interested in optimal control, operation research, communications, manufacturing, economics, and electronic commerce.

��ber diesen Titel� kann sich auf eine andere Ausgabe dieses Titels beziehen.

Anbieterinformationen

ThriftBooks is a fully independent seller of used books, having sold more than 160 million used and new books since we started in 2003. Each quality used book is sorted, graded, shelved and shipped by hand by our team of dedicated employees in our seven warehouses across the US. We have the best selection of books, in the right condition and format, at everyday low prices. We also have a dedicated, US-based Customer Service team, ranked in the top three by Newsweek for Best Customer Service in 2018 and 2019, so you can shop with confidence. We support and invest in our employees, appreciate and value our customers, and truly believe in the power of the written word to educate, energize, and engage readers of all ages and interests.

Zur Homepage des Verk�ufers

Unternehmensdaten des Verk�ufers

Thrift Books Global LLC
18300 Cascade Ave S, Seattle, WA, 98188, U.S.A.

Gesch�ftsbedingungen und Versandinformationen

Verkaufsbedingungen

We guarantee each book that we send you. If you have any problems, please contact
our dedicated customer service department. They will do everything possible to
ensure you are happy with your order.

Versandbedingungen

All domestic Standard and Expedited shipments are distributed from our warehouses by OSM, then handed off to the USPS for final delivery.

2-Day Shipping is delivered by FedEx, which does not deliver to PO boxes.

International shipments are tendered to the local postal service in the destination country for final delivery – we do not use courier services for international deliveries.