Home
Resource
Process-based risk measures and risk-averse control of observable and partially observable discrete-time systems
PDF
PDF format is widely accepted and good for printing.
Plug-in required
PDF-1(696.04 kb)
Citation & Export
View Usage Statistics
Staff View

Citation & Export
Hide

Simple citation

Fan, Jingnan. Process-based risk measures and risk-averse control of observable and partially observable discrete-time systems. Retrieved from https://doi.org/doi:10.7282/T3PC35KX

Export

Click here for information about Citation Management Tools at Rutgers.

Statistics
Hide

Description

TitleProcess-based risk measures and risk-averse control of observable and partially observable discrete-time systems
NameFan, Jingnan (author); Ruszczynski, Andrzej (chair); Boros, Endre (internal member); Eckstein, Jonathan (internal member); Katehakis, Michael (internal member); Collado, Ricardo (outside member); Rutgers University; School of Graduate Studies
Date Created2018
Other Date2018-01 (degree)
SubjectOperations Research, Risk management
Extent1 online resource (vii, 73 p. : ill.)
DescriptionIn this thesis, we develop theoretical foundations of the theory of dynamic risk measures for controlled stochastic processes, and we apply our theory to Markov decision processes (MDP) and partially observable Markov decision processes (POMDP). We consider a new class of dynamic risk measures for controlled discrete-time stochastic processes, which we call process-based. By introducing a new concept of stochastic conditional time consistency, we derive the structure of process-based risk measures enjoying this property. It is shown that such risk measures can be equivalently represented by a collection of static law-invariant risk measures on the space of functions of the state of the base process. The results are first specialized to Markov decision problems (MDP), in which we use process-based dynamic risk measures to evaluate control policies. We derive the refined structure of risk measures for this kind of problems, along with the associated dynamic programming equations. We then specialize our theory to partially observable Markov decision problems (POMDP). Compared to MDP, in POMDP we can only observe part of the state, and we need to infer the rest of the state conditional on our observations. We derive that the stochastically conditionally time-consistent dynamic risk measures can be represented by a sequence of law-invariant risk measures on the space of function of the observable part of the state. The corresponding dynamic programming equations are also derived. Finally, as an application to our theory on POMDP, we study a model for machine deterioration problem.
NotePh.D.
NoteIncludes bibliographical references
Noteby Jingnan Fan
Genretheses, ETD doctoral
Persistent URLhttps://doi.org/doi:10.7282/T3PC35KX
Languageeng
CollectionSchool of Graduate Studies Electronic Theses and Dissertations
Organization NameRutgers, The State University of New Jersey
RightsThe author owns the copyright to this work.
Version 8.5.5
Rutgers University Libraries - Copyright ©2024