Research Papers

A Comparative Study on Machine Learning Algorithms for Smart Manufacturing: Tool Wear Prediction Using Random Forests

[+] Author and Article Information
Dazhong Wu

Department of Industrial and
Manufacturing Engineering,
National Science Foundation
Center for e-Design,
Pennsylvania State University,
University Park, PA 16802
e-mail: dxw279@psu.edu

Connor Jennings

Department of Industrial and
Manufacturing Engineering,
National Science Foundation
Center for e-Design,
Pennsylvania State University,
University Park, PA 16802
e-mail: connor@psu.edu

Janis Terpenny

Department of Industrial and
Manufacturing Engineering,
National Science Foundation
Center for e-Design,
Pennsylvania State University,
University Park, PA 16802
e-mail: jpt5311@psu.edu

Robert X. Gao

Department of Mechanical and
Aerospace Engineering,
Case Western Reserve University,
Cleveland, OH 44106
e-mail: robert.gao@case.edu

Soundar Kumara

Department of Industrial and
Manufacturing Engineering,
Pennsylvania State University,
University Park, PA 16802
e-mail: skumara@psu.edu

1Corresponding author.

Manuscript received October 25, 2016; final manuscript received March 13, 2017; published online April 18, 2017. Assoc. Editor: Laine Mears.

J. Manuf. Sci. Eng 139(7), 071018 (Apr 18, 2017) (9 pages) Paper No: MANU-16-1567; doi: 10.1115/1.4036350 History: Received October 25, 2016; Revised March 13, 2017

Manufacturers have faced an increasing need for the development of predictive models that predict mechanical failures and the remaining useful life (RUL) of manufacturing systems or components. Classical model-based or physics-based prognostics often require an in-depth physical understanding of the system of interest to develop closed-form mathematical models. However, prior knowledge of system behavior is not always available, especially for complex manufacturing systems and processes. To complement model-based prognostics, data-driven methods have been increasingly applied to machinery prognostics and maintenance management, transforming legacy manufacturing systems into smart manufacturing systems with artificial intelligence. While previous research has demonstrated the effectiveness of data-driven methods, most of these prognostic methods are based on classical machine learning techniques, such as artificial neural networks (ANNs) and support vector regression (SVR). With the rapid advancement in artificial intelligence, various machine learning algorithms have been developed and widely applied in many engineering fields. The objective of this research is to introduce a random forests (RFs)-based prognostic method for tool wear prediction as well as compare the performance of RFs with feed-forward back propagation (FFBP) ANNs and SVR. Specifically, the performance of FFBP ANNs, SVR, and RFs are compared using an experimental data collected from 315 milling tests. Experimental results have shown that RFs can generate more accurate predictions than FFBP ANNs with a single hidden layer and SVR.

Copyright © 2017 by ASME
Your Session has timed out. Please sign back in to continue.


Swanson, L. , 2001, “ Linking Maintenance Strategies to Performance,” Int. J. Prod. Econ., 70(3), pp. 237–244. [CrossRef]
Valdez-Flores, C. , and Feldman, R. M. , 1989, “ A Survey of Preventive Maintenance Models for Stochastically Deteriorating Single-Unit Systems,” Nav. Res. Logist., 36(4), pp. 419–446. [CrossRef]
Wu, D. , Terpenny, J. , Zhang, L. , Gao, R. , and Kurfess, T. , 2016, “ Fog-Enabled Architecture for Data-Driven Cyber-Manufacturing Systems,” ASME Paper No. MSEC2016-8559.
Lee, J. , 1995, “ Machine Performance Monitoring and Proactive Maintenance in Computer-Integrated Manufacturing: Review and Perspective,” Int. J. Comput. Integr. Manuf., 8(5), pp. 370–380. [CrossRef]
Bevilacqua, M. , and Braglia, M. , 2000, “ The Analytic Hierarchy Process Applied to Maintenance Strategy Selection,” Reliab. Eng. Syst. Saf., 70(1), pp. 71–83. [CrossRef]
Suh, J. H. , Kumara, S. R. , and Mysore, S. P. , 1999, “ Machinery Fault Diagnosis and Prognosis: Application of Advanced Signal Processing Techniques,” CIRP Ann.-Manuf. Technol., 48(1), pp. 317–320. [CrossRef]
Hu, C. , Youn, B. D. , and Kim, T. , 2012, “ Semi-Supervised Learning With Co-Training for Data-Driven Prognostics,” IEEE Conference on Prognostics and Health Management (PHM), Denver, CO, June 18–21, pp. 1–10.
Schwabacher, M. , 2005, “ A Survey of Data-Driven Prognostics,” AIAA Paper No. 2005-7002.
Byrne, G. , Dornfeld, D. , Inasaki, I. , Ketteler, G. , König, W. , and Teti, R. , 1995, “ Tool Condition Monitoring (TCM)—The Status of Research and Industrial Application,” CIRP Ann.-Manuf. Technol., 44(2), pp. 541–567. [CrossRef]
Teti, R. , Jemielniak, K. , O'Donnell, G. , and Dornfeld, D. , 2010, “ Advanced Monitoring of Machining Operations,” CIRP Ann.-Manuf. Technol., 59(2), pp. 717–739. [CrossRef]
Gao, R. , Wang, L. , Teti, R. , Dornfeld, D. , Kumara, S. , Mori, M. , and Helu, M. , 2015, “ Cloud-Enabled Prognosis for Manufacturing,” CIRP Ann.-Manuf. Technol., 64(2), pp. 749–772. [CrossRef]
Daigle, M. J. , and Goebel, K. , 2013, “ Model-Based Prognostics With Concurrent Damage Progression Processes,” IEEE Trans. Syst. Man Cybernetics: Syst., 43(3), pp. 535–546. [CrossRef]
Si, X.-S. , Wang, W. , Hu, C.-H. , Chen, M.-Y. , and Zhou, D.-H. , 2013, “ A Wiener-Process-Based Degradation Model With a Recursive Filter Algorithm for Remaining Useful Life Estimation,” Mech. Syst. Signal Process., 35(1), pp. 219–237. [CrossRef]
Dong, M. , and He, D. , 2007, “ Hidden Semi-Markov Model-Based Methodology for Multi-Sensor Equipment Health Diagnosis and Prognosis,” Eur. J. Oper. Res., 178(3), pp. 858–878. [CrossRef]
Saha, B. , Goebel, K. , and Christophersen, J. , 2009, “ Comparison of Prognostic Algorithms for Estimating Remaining Useful Life of Batteries,” Trans. Inst. Meas. Control, 31(3–4), pp. 293–308. [CrossRef]
Niaki, F. A. , Michel, M. , and Mears, L. , 2016, “ State of Health Monitoring in Machining: Extended Kalman Filter for Tool Wear Assessment in Turning of IN718 Hard-to-Machine Alloy,” J. Manuf. Processes, 24(Part 2), pp. 361–369. [CrossRef]
Orchard, M. E. , and Vachtsevanos, G. J. , 2009, “ A Particle-Filtering Approach for On-Line Fault Diagnosis and Failure Prognosis,” Trans. Inst. Meas. Control, 31(3–4), pp. 221–246. [CrossRef]
Wang, P. , and Gao, R. X. , 2015, “ Adaptive Resampling-Based Particle Filtering for Tool Life Prediction,” J. Manuf. Syst., 37(Part 2), pp. 528–534. [CrossRef]
Niaki, F. A. , Ulutan, D. , and Mears, L. , 2015, “ Stochastic Tool Wear Assessment in Milling Difficult to Machine Alloys,” Int. J. Mechatronics Manuf. Syst., 8(3–4), pp. 134–159.
Wang, P. , and Gao, R. X. , 2016, “ Stochastic Tool Wear Prediction for Sustainable Manufacturing,” Proc. CIRP, 48, pp. 236–241. [CrossRef]
Sick, B. , 2002, “ On-Line and Indirect Tool Wear Monitoring in Turning With Artificial Neural Networks: A Review of More Than a Decade of Research,” Mech. Syst. Signal Process., 16(4), pp. 487–546. [CrossRef]
Breiman, L. , 2001, “ Random Forests,” Mach. Learn., 45(1), pp. 5–32. [CrossRef]
Biau, G. , 2012, “ Analysis of a Random Forests Model,” J. Mach. Learn. Res., 13, pp. 1063–1095.
Verikas, A. , Gelzinis, A. , and Bacauskiene, M. , 2011, “ Mining Data With Random Forests: A Survey and Results of New Tests,” Pattern Recognit., 44(2), pp. 330–349. [CrossRef]
Kamarthi, S. , Kumara, S. , and Cohen, P. , 2000, “ Flank Wear Estimation in Turning Through Wavelet Representation of Acoustic Emission Signals,” ASME J. Manuf. Sci. Eng., 122(1), pp. 12–19. [CrossRef]
Liang, S. , and Dornfeld, D. , 1989, “ Tool Wear Detection Using Time Series Analysis of Acoustic Emission,” J. Eng. Ind., 111(3), pp. 199–205. [CrossRef]
Huang, Y. , and Liang, S. Y. , 2004, “ Modeling of CBN Tool Flank Wear Progression in Finish Hard Turning,” ASME J. Manuf. Sci. Eng., 126(1), pp. 98–106. [CrossRef]
Taylor, F. W. , 1907, On the Art of Cutting Metals, ASME, New York.
Schwabacher, M. , and Goebel, K. , 2007, “ A Survey of Artificial Intelligence for Prognostics,” AAAI Fall Symposium, Arlington, VA, Nov. 9–11, pp. 107–114.
Bukkapatnam, S. T. , Lakhtakia, A. , and Kumara, S. R. , 1995, “ Analysis of Sensor Signals Shows Turning on a Lathe Exhibits Low-Dimensional Chaos,” Phys. Rev. E, 52(3), p. 2375. [CrossRef]
Bukkapatnam, S. T. , Kumara, S. R. , and Lakhtakia, A. , 2000, “ Fractal Estimation of Flank Wear in Turning,” ASME J. Dyn. Syst. Meas. Control, 122(1), pp. 89–94. [CrossRef]
Bukkapatnam, S. , Kumara, S. , and Lakhtakia, A. , 1999, “ Analysis of Acoustic Emission Signals in Machining,” ASME J. Manuf. Sci. Eng., 121(4), pp. 568–576. [CrossRef]
Özel, T. , and Karpat, Y. , 2005, “ Predictive Modeling of Surface Roughness and Tool Wear in Hard Turning Using Regression and Neural Networks,” Int. J. Mach. Tools Manuf., 45(4), pp. 467–479. [CrossRef]
Palanisamy, P. , Rajendran, I. , and Shanmugasundaram, S. , 2008, “ Prediction of Tool Wear Using Regression and ANN Models in End-Milling Operation,” Int. J. Adv. Manuf. Technol., 37(1–2), pp. 29–41. [CrossRef]
Sanjay, C. , Neema, M. , and Chin, C. , 2005, “ Modeling of Tool Wear in Drilling by Statistical Analysis and Artificial Neural Network,” J. Mater. Process. Technol., 170(3), pp. 494–500. [CrossRef]
Chungchoo, C. , and Saini, D. , 2002, “ On-Line Tool Wear Estimation in CNC Turning Operations Using Fuzzy Neural Network Model,” Int. J. Mach. Tools Manuf., 42(1), pp. 29–40. [CrossRef]
Chen, J. C. , and Chen, J. C. , 2005, “ An Artificial-Neural-Networks-Based In-Process Tool Wear Prediction System in Milling Operations,” Int. J. Adv. Manuf. Technol., 25(5–6), pp. 427–434. [CrossRef]
Paul, P. S. , and Varadarajan, A. , 2012, “ A Multi-Sensor Fusion Model Based on Artificial Neural Network to Predict Tool Wear During Hard Turning,” Proc. Inst. Mech. Eng., Part B, 226(5), pp. 853–860. [CrossRef]
Karayel, D. , 2009, “ Prediction and Control of Surface Roughness in CNC Lathe Using Artificial Neural Network,” J. Mater. Process. Technol., 209(7), pp. 3125–3137. [CrossRef]
Cho, S. , Asfour, S. , Onar, A. , and Kaundinya, N. , 2005, “ Tool Breakage Detection Using Support Vector Machine Learning in a Milling Process,” Int. J. Mach. Tools Manuf., 45(3), pp. 241–249. [CrossRef]
Benkedjouh, T. , Medjaher, K. , Zerhouni, N. , and Rechak, S. , 2015, “ Health Assessment and Life Prediction of Cutting Tools Based on Support Vector Regression,” J. Intell. Manuf., 26(2), pp. 213–223. [CrossRef]
Shi, D. , and Gindy, N. N. , 2007, “ Tool Wear Predictive Model Based on Least Squares Support Vector Machines,” Mech. Syst. Signal Process., 21(4), pp. 1799–1814. [CrossRef]
Jiaa, C. L. , and Dornfeld, D. A. , 1998, “ A Self-Organizing Approach to the Prediction and Detection of Tool Wear,” ISA Trans., 37(4), pp. 239–255. [CrossRef]
Elangovan, M. , Devasenapati, S. B. , Sakthivel, N. , and Ramachandran, K. , 2011, “ Evaluation of Expert System for Condition Monitoring of a Single Point Cutting Tool Using Principle Component Analysis and Decision Tree Algorithm,” Expert Syst. Appl., 38(4), pp. 4450–4459. [CrossRef]
Arisoy, Y. M. , and Özel, T. , 2015, “ Machine Learning Based Predictive Modeling of Machining Induced Microhardness and Grain Size in Ti–6Al–4V Alloy,” Mater. Manuf. Process., 30(4), pp. 425–433. [CrossRef]
Cortes, C. , and Vapnik, V. , 1995, “ Support-Vector Networks,” Mach. Learn., 20(3), pp. 273–297.
Drucker, H. , Burges, C. J. , Kaufman, L. , Smola, A. , and Vapnik, V. , 1997, “ Support Vector Regression Machines,” Advances in Neural Information Processing Systems, Vol. 9, pp. 155–161.
Liaw, A. , and Wiener, M. , 2002, “ Classification and Regression by Random Forest,” R News, 2(3), pp. 18–22.
Friedman, J. , Hastie, T. , and Tibshirani, R. , 2001, The Elements of Statistical Learning, Springer Series in Statistics, Springer, Berlin.
Li, X. , Lim, B. , Zhou, J. , Huang, S. , Phua, S. , Shaw, K. , and Er, M. , 2009, “ Fuzzy Neural Network Modelling for Tool Wear Estimation in Dry Milling Operation,” Annual Conference of the Prognostics and Health Management Society (PHM), San Diego, CA, Sept. 27–Oct. 1, pp. 1–11.


Grahic Jump Location
Fig. 1

Tool wear prediction using a feed-forward back-propagation (FFBP) ANN

Grahic Jump Location
Fig. 2

Tool wear prediction using SVR

Grahic Jump Location
Fig. 3

Tool wear prediction using an RF

Grahic Jump Location
Fig. 4

Binary regression tree growing process

Grahic Jump Location
Fig. 5

Experimental setup

Grahic Jump Location
Fig. 6

Comparison of observed and predicted tool wear using an ANN with 16 neurons in the hidden layer (termination criterion: tolerance is equal to 1.0 × 10−4)

Grahic Jump Location
Fig. 7

Comparison of observed and predicted tool wear using SVR (termination criterion: slack variable or tolerance ξ is equal to 0.001)

Grahic Jump Location
Fig. 8

Comparison of observed and predicted tool wear using RFs (termination criterion: minimum number of samples in each node is equal to 5)

Grahic Jump Location
Fig. 9

Tool wear against time (cut) using RFs

Grahic Jump Location
Fig. 10

Comparison of training times

Grahic Jump Location
Fig. 11

Comparison of MSEs

Grahic Jump Location
Fig. 12

Comparison of R-squared errors




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In