A Comparison of Residual-based Methods on Fault Detection
Chi-Ching Hsu Gaetan Frusque Olga Fink
An important initial step in fault detection for complex industrial systems
is gaining an understanding of their health condition. Subsequently, continuous
monitoring of this health condition becomes crucial to observe its evolution,
track changes over time, and isolate faults. As faults are typically rare
occurrences, it is essential to perform this monitoring in an unsupervised
manner. Various approaches have been proposed not only to detect faults in an
unsupervised manner but also to distinguish between different potential fault
types. In this study, we perform a comprehensive comparison between two
residual-based approaches: autoencoders, and the input-output models that
establish a mapping between operating conditions and sensor readings. We
explore the sensor-wise residuals and aggregated residuals for the entire
system in both methods. The performance evaluation focuses on three tasks:
health indicator construction, fault detection, and health indicator
interpretation. To perform the comparison, we utilize the Commercial Modular
Aero-Propulsion System Simulation (C-MAPSS) dynamical model, specifically a
subset of the turbofan engine dataset containing three different fault types.
All models are trained exclusively on healthy data. Fault detection is achieved
by applying a threshold that is determined based on the healthy condition. The
detection results reveal that both models are capable of detecting faults with
an average delay of around 20 cycles and maintain a low false positive rate.
While the fault detection performance is similar for both models, the
input-output model provides better interpretability regarding potential fault
types and the possible faulty components.