Discrete-time Markov control processes basic optimality criteria Onésimo Hernández-Lerma, Jean Bernard Lasserre. Applications of mathematics 30.

Onesimo Hernandez-Lerma; Jean Bernard Lasserre

ISBN 10: 0387945792 / ISBN 13: 9780387945798

Verlag: New York, Springer [1996]., 1996

Beschreibung

Ex-library with stamp and library-signature. GOOD condition, some traces of use. Ancien Exemplaire de bibliothèque avec signature et cachet. BON état, quelques traces d'usure. Ehem. Bibliotheksexemplar mit Signatur und Stempel. GUTER Zustand, ein paar Gebrauchsspuren. 93 HER 9780387945798 Sprache: Englisch Gewicht in Gramm: 550.

Bestandsnummer des Verkäufers 2508985

Bibliografische Details

• Titel: Discrete-time Markov control processes basic optimality criteria Onésimo Hernández-Lerma, Jean Bernard Lasserre. Applications of mathematics 30.
• Verlag: New York, Springer [1996].
• Erscheinungsjahr: 1996
• Sprache: Englisch
• ISBN-10: 0387945792
• ISBN-13: 9780387945798
• Einband: Hardcover
• Verkäuferkataloge:
  • SA MATHEMATIK

Über diesen Titel

Inhaltsangabe

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro­ grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re­ source management, (control of) epidemics, etc. However, most of the lit­ erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys­ tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.

Von der hinteren Coverseite

This book provides a unified, comprehensive treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MPCs with Borel state and control spaces, and possibly unbounded costs and noncompact control constraint sets. The control model studied is sufficiently general to include virtually all of the usual discrete-time stochastic control models that appear in applications to engineering, economics, mathematical population processes, operations research, and management science. Much of the material appears for the first time in book form.