Research Papers

Markov-Based Maintenance Planning Considering Repair Time and Periodic Inspection

[+] Author and Article Information
Seungchul Lee

Department of Mechanical Engineering,
University of Michigan,
1035 H. H. Dow, 2350 Hayward Street, Ann Arbor, MI 48109
e-mail: seunglee@umich.edu

Lin Li

Department of Mechanical and Industrial Engineering,
University of Illinois at Chicago,
3057 ERF, 842 W. Taylor Street, Chicago, IL 60607
e-mail: linli@uic.edu

Jun Ni

Department of Mechanical Engineering,
University of Michigan,
1023 H. H. Dow, 2350 Hayward Street, Ann Arbor, MI 48109
e-mail: junni@umich.edu

1Corresponding author.

Contributed by the Manufacturing Engineering Division of ASME for publication in the Journal of Manufacturing Science and Engineering. Manuscript received November 25, 2009; final manuscript received March 19, 2013; published online May 27, 2013. Assoc. Editor: Steven J. Skerlos.

J. Manuf. Sci. Eng 135(3), 031013 (May 27, 2013) (12 pages) Paper No: MANU-09-1339; doi: 10.1115/1.4024152 History: Received November 25, 2009; Revised March 19, 2013

The equipment degradation and various maintenance decision processes with unreliable machines have been studied extensively. The traditional degradation modeling using Markov process only focuses on single machine system and ignores maintenance or repair duration. This paper is devoted to analytical and numerical study of production lines within the Markov process framework considering repair time and periodic inspection. Nonexponential holding time distributions in Markov chain are approximated by inserting multiple intermediate states based on a phase-type distribution. Overall system availability is calculated by recursively solving the balance equations of the Markov process. The results show that the optimal inspection intervals for two repairable-machine systems can be achieved by means of the proposed method. By having an adequate model representing both deterioration and maintenance processes, it is also possible to obtain different optimal maintenance policies to maximize the availability or productivity for different configurations of components.

Copyright © 2013 by ASME
Your Session has timed out. Please sign back in to continue.


Pierskalla, W. P., and Voelker, J. A., 1976, “A Survey of Maintenance Models: The Control and Surveillance of Deteriorating Systems,” Nav. Res. Logistics Quart., 23(3), pp. 353–388. [CrossRef]
Valdez-Flores, C., and Feldman, R. M., 1989, “A Survey of Preventive Maintenance Models for Stochastically Deteriorating Single-Unit Systems,” Naval Res. Logistics, 36(4), pp. 419–446. [CrossRef]
Scarf, P. A., 1997, “On the Application of Mathematical Models in Maintenance,” Eur. J. Oper. Res., 99(3), pp. 493–506. [CrossRef]
Dekker, R., 1996, “Applications of Maintenance Optimization Models: A Review and Analysis,” Reliab. Eng. Syst. Saf., 51(3), pp. 229–240. [CrossRef]
Chan, G. K., and Asgarpoor, S., 2006, “Optimum Maintenance Policy With Markov Processes,” Electr. Power Syst. Res., 76(6–7), pp. 452–456. [CrossRef]
Chen, D., and Trivedi, K. S., 2002, “Closed-Form Analytical Results for Condition-Based Maintenance,” Reliab. Eng. Syst. Saf., 76(1), pp. 43–51. [CrossRef]
Maillart, L. M., 2006, “Maintenance Policies for Systems With Condition Monitoring and Obvious Failures,” IIE Trans., 38(6), pp. 463–475. [CrossRef]
Das, T. K., Gosavi, A., Mahadevan, S., and Marchalleck, N., 1999, “Solving Semi-Markov Decision Problems Using Average Reward Reinforcement Learning,” Manage. Sci., 45(4), pp. 560–574. [CrossRef]
Berenguer, C., Chu, C. B., and Grall, A., 1997, “Inspection and Maintenance Planning: An Application of Semi-Markov Decision Processes,” J. Intell. Manuf., 8(5), pp. 467–476. [CrossRef]
Chen, D., and Trivedi, K. S., 2005, “Optimization for Condition-Based Maintenance With Semi-Markov Decision Process,” Reliab. Eng. Syst. Saf., 90(1), pp. 25–29. [CrossRef]
Sim, S. H., and Endrenyi, J., 1988, “Optimal Preventive Maintenance With Repair,” IEEE Trans. Reliab., 37(1), pp. 92–96. [CrossRef]
Sim, S. H., and Endrenyi, J., 1993, “A Failure-Repair Model With Minimal and Major Maintenance,” IEEE Trans. Reliab., 42(1), pp. 134–140. [CrossRef]
Cho, D. I., and Parlar, M., 1991, “A Survey of Maintenance Models for Multiunit Systems,” Eur. J. Oper. Res., 51(1), pp. 1–23. [CrossRef]
Wang, W., and Christer, A. H., 2003, “Solution Algorithms for a Nonhomogeneous Multi-Component Inspection Model,” Comput. Oper. Res., 30(1), pp. 19–34. [CrossRef]
Sherif, Y. S., and Smith, M. L., 1981, “Optimal Maintenance Models for Systems Subject to Failure—A Review,” Naval Res. Logistics Quart., 28(1), pp. 47–74. [CrossRef]
Assaf, D., and Shanthikumar, J. G., 1987, “Optimal Group Maintenance Policies With Continuous and Periodic Inspections,” Manage. Sci., 33(11), pp. 1440–1452. [CrossRef]
Das, K., Lashkari, R. S., and Sengupta, S., 2007, “Machine Reliability and Preventive Maintenance Planning for Cellular Manufacturing Systems,” Eur. J. Oper. Res., 183(1), pp. 162–180. [CrossRef]
Osogami, T., and Harchol-Balter, M., 2006, “Closed Form Solutions for Mapping General Distributions to Quasi-Minimal PH Distributions,” Perform. Eval., 63(6), pp. 524–552. [CrossRef]
David, A., and Larry, S., 1987, “The Least Variable Phase Type Distribution is Erlang,” Stoch. Models, 3(3), pp. 467–473. [CrossRef]
Ruiz-Castro, J. E., Fernandez-Villodre, G., and Perez-Ocon, R., 2009, “A Level-Dependent General Discrete System Involving Phase-Type Distributions,” IIE Trans., 41(1), pp. 45–56. [CrossRef]
Ross, S. M., 1996, Stochastic Processes, Probability and Statistics, John Wiley & Sons, Inc., New York.
Meerkov, S. M., and Zhang, L., 2008, “Transient Behavior of Serial Production Lines With Bernoulli Machines,” IIE Trans., 40(3), pp. 297–312. [CrossRef]
Rabiner, L. R., 1989, “A Tutorial on Hidden Markov-Models and Selected Applications in Speech Recognition,” Proc. IEEE, 77(2), pp. 257–286. [CrossRef]


Grahic Jump Location
Fig. 1

A state transition diagram and its transition rate matrix

Grahic Jump Location
Fig. 2

Simulation results for single unit deterioration process

Grahic Jump Location
Fig. 3

Markov chain for Erlang process

Grahic Jump Location
Fig. 4

Simulation result from Erlang process with 200 intermediate states

Grahic Jump Location
Fig. 5

Illustration of maintenance policy

Grahic Jump Location
Fig. 6

Markov process for the abovementioned maintenance policy

Grahic Jump Location
Fig. 7

State probabilities for the abovementioned maintenance policy

Grahic Jump Location
Fig. 8

Sample path for the abovementioned maintenance policy

Grahic Jump Location
Fig. 9

Availability with different inspection intervals

Grahic Jump Location
Fig. 10

Maintenance policy comparison

Grahic Jump Location
Fig. 11

Two Markov models and their simulation results

Grahic Jump Location
Fig. 12

Markov degradation model for a two-unit system without maintenance

Grahic Jump Location
Fig. 13

Parallel (a) and serial (b) configurations

Grahic Jump Location
Fig. 14

Maintenance policy in parallel configuration

Grahic Jump Location
Fig. 15

Maintenance Markov model for a two-unit parallel system

Grahic Jump Location
Fig. 16

Maintenance in serial configuration

Grahic Jump Location
Fig. 17

Maintenance Markov model for a two-unit serial system

Grahic Jump Location
Fig. 18

Optimal intervals for PM with different connections

Grahic Jump Location
Fig. 19

Optima PM interval to maximize productivity of system

Grahic Jump Location
Fig. 20

Five-state Markov chain with the corresponding transition probability matrix P

Grahic Jump Location
Fig. 21

State probabilities and reliability distribution

Grahic Jump Location
Fig. 22

Historical inspection intervals from the real Fab data



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In