The focus of this study is the optimal decision making problem for an age-dependent deteriorating system in which the deterioration unfolds as a non-stationary Markov process. The true deterioration state of the system cannot be known directly and is assumed to be observed incompletely by a monitor that provides information related to the true deterioration state stochastically. The optimal decision making problem is formulated as a partially observable Markov decision process. The optimal maintenance policy is investigated and the structural properties of the resulting optimal expected cost function are obtained. These structural properties establish the existence of an optimal control limit policy with respect to both the deterioration information vector and the age of the system under intuitively meaningful assumptions. The monotonic property of the control limits is also clarified.
DermanC. On optimal replacement rules when changes of state are Markovian. In: BellmanR (ed.) Mathematical optimization techniques. New York: University of California Press, 1963, pp. 201–210.
2.
LamCTYehRH. Optimal maintenance-policies for deteriorating systems under various maintenance strategies. IEEE Trans Reliab1994; 43: 423–430.
3.
MoustafaMSMaksoudEY. Optimal maintenance/replacement-policy for deteriorating systems under two-phase maintenance strategy. Econ Qual Control2008; 23: 39–54.
4.
DouerNYechialiU. Optimal repair and replacement in Markovian systems. Stoch Models1994; 10: 253–270.
5.
KurtMKharoufehJP. Monotone optimal replacement policies for a Markovian deteriorating system in a controllable environment. Oper Res Lett2010; 38: 273–279.
6.
ElwanyAHGebraeelNZMaillartLM. Structured replacement policies for components with complex degradation processes and dedicated sensors. Oper Res2011; 59: 684–695.
7.
MonahanGE. A survey of partially observable Markov decision processes: Theory, models, and algorithms. Manage Sci1982; 28: 1–16.
8.
SmallwoodRDSondikEJ. The optimal control of partially observable Markov processes over a finite horizon. Oper Res1973; 21: 1071–1088.
9.
Grosfeld-NirA. Control limits for two-state partially observable Markov decision processes. Eur J Oper Res2007; 182: 300–304.
10.
OhnishiMKawaiHMineH. An optimal inspection and replacement policy under incomplete state information. Eur J Oper Res1986; 27: 117–128.
11.
LovejoyWS. Some monotonicity results for partially observed Markov decision processes. Oper Res1987; 35: 736–743.
12.
MaillartLM. Maintenance policies for systems with condition monitoring and obvious failures. IIE Trans2006; 38: 463–475.
13.
MaeharaHSuzukiK. An optimal policy for condition monitoring maintenance with uncertain repair. J Reliab Eng Assoc Jpn2005; 27: 219–230 (in Japanese).
14.
JinLSuzukiKKumagaiK. Necessary and sufficient condition for control limit policy for partially observable Markov decision process. J Jpn Soc Qual Control2011; 41: 238–249.
15.
ZouchMYeungTCastanierB. Optimal resurfacing decisions for road maintenance: A POMDP perspective. In: Annual reliability and maintainability symposium, Lake Buena Vista, FL, USA, 24–27 January 2011, pp.1–6. New Jersey: IEEE press.
16.
AbeygunawardaneSKJirutitijaroenPXuH. Adaptive maintenance policies for aging devices using a Markov decision process. IEEE Trans Power Syst2013; 28: 3194–3203.
17.
ChenC. Dynamic preventive maintenance strategy for an aging and deteriorating production system. Expert Syst Appl2011; 38: 6287–6293.
18.
ChhatwalJAlagozOBurnsideES. Optimal breast biopsy decision-making based on mammography features and demographic factors. Oper Res2010; 58: 1577–1591.
KarlinS. Total positivityStanford: Stanford University Press, 1968.
21.
Ministry of Land, Infrastructure, Transport and Tourism. Usage manual of bridge inspection database system in Japan (in Japanese). Report, MLIT, Japan, June, 2014.
22.
LiuCHammadAItohY. Maintenance strategy optimization of bridge decks using genetic algorithm. J Transp Eng1997; 123: 91–100.
23.
HegazyTElbeltagiEElbehairyH. Bridge deck management system with integrated life cycle cost optimization. Transp Res Rec2004; 1866: 44–50.
24.
BrodskyGMuzykinRBrodskaiaES. Analysis of parameters of structure deterioration models within the Moscow bridge management system. Struct Infrastruct Eng2006; 2: 13–21.
25.
DogakiMFurutaHTsukiyamaI. Optimal maintenance planning of reinforced concrete decks on highway network. In: US–Japan workshop on life-cycle cost analysis and design of civil infrastructure systems, Honolulu, USA, 2000, pp.107–119. Reston, VA: ASCE.
26.
O’ConnorDSHymanWA. Federal Highway Administration. Bridge management systems. Report, US Department of Transportation, USA, October, 1989.
27.
IEEE C57.104-2008. Guide for the interpretation of gases generated in oil-immersed transformers.
28.
ZijuanLAbeygunawardaneSKJirutitijaroenP. Smart asset management of aging devices in energy systems: A case study of transformers. In: 2nd IEEE PES international conference and exhibition on innovative smart grid technologies, Manchester, UK, 5–7 December 2011, pp.1–6. New Jersey: IEEE Press.
29.
American Cancer Society. Breast cancer facts and figures 2013–2014. Atlanta, GA: American Cancer Society, 2013.
