Publications-Periodical Articles

Article View/Open

Publication Export

Google ScholarTM

NCCU Library

Citation Infomation

Related Publications in TAIR

題名 非均質馬可夫決策過程在演算法上的一些數學性質
其他題名 Reviewing Some Mathematical Properties of Algorithms in Npnhomogeneous Markov Decision Processes
作者 劉任昌
Liou,Chen-Chang
陸行
Luh,Hsing
貢獻者 應數系
關鍵詞 非均質馬可夫決策過程;預測期数;動態規劃;縮收函數;超平面行数函数
Nonhomogeneous Markov Decision Processes;Forecast Horizon;Dynamic Programming;Contraction Mapping;Affine Mapping
日期 1999-11
上傳時間 24-Dec-2008 13:31:40 (UTC+8)
摘要 Hopp, Bean and Duenyas (1992) formulated a mixed integer program (MIP) to determine whether a finite time horizon is a forecast horizon in a nonhomogeneous Markov decision process (NMDP). Their formula is provided by complex Bender`s decomposition techniques. In this paper, we investigate in details of the contraction property and affine mapping property of NMDP, By these properties, Hopp et al.`s formula is relicvcd of the complex MIP formula and Bender`s decomposition algorithm. We only need to check a finite number of vertices at a polyhedral set shaped by the solution of the NMDP. The analysis gives insight into the NMDP and facilitates the process in detcnnining the forecast horizon. Furthermore, this NMDP formulation is presented in the form of a simple dynamic function which is different from the linear program presented by Hopp et al.
關聯 工業工程學刊,16(6),711-724
資料類型 article
dc.contributor 應數系-
dc.creator (作者) 劉任昌zh_TW
dc.creator (作者) Liou,Chen-Chang-
dc.creator (作者) 陸行zh_TW
dc.creator (作者) Luh,Hsingen_US
dc.date (日期) 1999-11en_US
dc.date.accessioned 24-Dec-2008 13:31:40 (UTC+8)-
dc.date.available 24-Dec-2008 13:31:40 (UTC+8)-
dc.date.issued (上傳時間) 24-Dec-2008 13:31:40 (UTC+8)-
dc.identifier.uri (URI) https://nccur.lib.nccu.edu.tw/handle/140.119/18726-
dc.description.abstract (摘要) Hopp, Bean and Duenyas (1992) formulated a mixed integer program (MIP) to determine whether a finite time horizon is a forecast horizon in a nonhomogeneous Markov decision process (NMDP). Their formula is provided by complex Bender`s decomposition techniques. In this paper, we investigate in details of the contraction property and affine mapping property of NMDP, By these properties, Hopp et al.`s formula is relicvcd of the complex MIP formula and Bender`s decomposition algorithm. We only need to check a finite number of vertices at a polyhedral set shaped by the solution of the NMDP. The analysis gives insight into the NMDP and facilitates the process in detcnnining the forecast horizon. Furthermore, this NMDP formulation is presented in the form of a simple dynamic function which is different from the linear program presented by Hopp et al.-
dc.format application/en_US
dc.language zh-TWen_US
dc.language en-USen_US
dc.language.iso en_US-
dc.relation (關聯) 工業工程學刊,16(6),711-724en_US
dc.subject (關鍵詞) 非均質馬可夫決策過程;預測期数;動態規劃;縮收函數;超平面行数函数-
dc.subject (關鍵詞) Nonhomogeneous Markov Decision Processes;Forecast Horizon;Dynamic Programming;Contraction Mapping;Affine Mapping-
dc.title (題名) 非均質馬可夫決策過程在演算法上的一些數學性質zh_TW
dc.title.alternative (其他題名) Reviewing Some Mathematical Properties of Algorithms in Npnhomogeneous Markov Decision Processes-
dc.type (資料類型) articleen