Academic Journals Database
Disseminating quality controlled scientific knowledge

Conditional Value-at-Risk for Random Immediate Reward Variables in Markov Decision Processes

Author(s): Masayuki Kageyama | Takayuki Fujii | Koji Kanefuji | Hiroe Tsubaki

Journal: American Journal of Computational Mathematics
ISSN 2161-1203

Volume: 01;
Issue: 03;
Start page: 183;
Date: 2011;
Original page

Keywords: Markov Decision Processes | Conditional Value-at-Risk | Risk Optimal Policy | Inventory Model

We consider risk minimization problems for Markov decision processes. From a standpoint of making the risk of random reward variable at each time as small as possible, a risk measure is introduced using conditional value-at-risk for random immediate reward variables in Markov decision processes, under whose risk measure criteria the risk-optimal policies are characterized by the optimality equations for the discounted or average case. As an application, the inventory models are considered.

Tango Rapperswil
Tango Rapperswil

     Affiliate Program