A Self-Learning Diagnosis Algorithm Based on Data Clustering

The article describes an approach to building a self-learning diagnostic algorithm. The self-learning algorithm creates models of the object under consideration. The models are formed periodically through a certain time period. The model includes a set of functions that can describe whole object, or a part of the object, or a specified functionality of the object. Thus, information about fault location can be obtained. During operation of the object the algorithm collects data received from sensors. Then the algorithm creates samples related to steady state operation. Clustering of those samples is used for the functions definition. Values of the functions in the centers of clusters are stored in the computer’s memory. To illustrate the considered approach, its application to the diagnosis of turbomachines is described.


Introduction
The described in the article algorithm and methods can be used for diagnosing a technical object, especially in cases when information about the object is limited.The desired result of the diagnosis is determining the probability of failure and evaluation of changes in the technical condition of the object.The proposed approach was tested by author on various technical objects including turbomachines.
A typical method of diagnosis of a technical object is the clustering and classification of its possible states.The samples corresponding to the states of the diagnosed object can be divided into a set of clusters, if there is relevant database.For example, in [1] clustering of temperatures measured by various thermocouples located downstream of the gas turbine is described.Each of the clusters can be defined as a cluster without a fault or as a cluster having a specific fault.
Method of separation of object's states can be chosen after analyzing the features of available data.In [1] fuzzy clustering is used.In [2] a modified method of k-means is considered for clustering and fault diagnosis.Usage of Kohonen self-organizing maps for clustering is described in [3].
In practical application of technical objects a description of its unique fault sometimes is not possible [4].A diagnostic algorithm may face a new unknown type of fault.At least, a developed diagnostic algorithm should select states of a technical object without faults.
For fault detection signals received from the diagnosed object can be compared with the corresponding values calculated by the object's model.If the difference between the measured and calculated values (residual) exceeds a predetermined threshold, a fault may occur.
In [5] for estimation of the residuals a Kalman filter is applied.Measurement of distance is used to measure similarity between a new occurred fault and a fault registered in the database.The fault which has the largest belief function according to the Dempster-Shafer evidence theory is the most possible fault.The paper [6] presents usage of extended state observer that can be proposed for fault diagnosis without exact knowledge of the diagnosed object model.
For an object that can be considered as a flat system an approach described in [7] can be used.For the flat system the input signal can be estimated by output signals and their derivatives.In particular, the input signal can be represented as a polynomial function of the output signal and a finite number of its derivatives.For fault diagnosis the gap between the calculated and the measured input value at each time point is estimated.
In [8] an algorithm to detect faults in the sensor is developed.It is assumed that a value of the sensor's signal transforms from one level to another smoothly and it is caused by a rational reason, such as changing regime of operation.Other behavior of the system may indicate a fault.
Observers can be designed such that they are not sensitive to certain faults while sensitive to other faults in the diagnosed object.This approach is described in [9].Using a bank of well-designed observers, faults can be detected and isolated simply with the help of the generated residuals.
It is problem to use a set of all possible samples for learning the diagnostics algorithm.In the practical operation of technical objects there are often unforeseen circumstances.The diagnostic algorithm has to use the signals coming from sensors for self-learning.In [10] the learning methods based on association are used for generating new rules from incoming data.
The flow chart of the algorithm discussed in this article is shown in Figure 1.Required information from the object is sent to the diagnostic algorithm.Command signals from controllers, signals from temperature, pressure, vibration and other sensors, position of attenuators, etc. can be used as the information from the object.
Usage of this diagnosis algorithm is restricted to objects that operate at steady state mode during a considerable part of their life cycle.For example, it can be applied to turbomachines in power plants or gas compressor stations, for which the condition usually is determined at steady state operation.The preprocessor selects parameters related to the steady state operation.In addition, from the received signals it calculates some characteristics, such as polytrophic efficiency of the compressor.The self-learning algorithm creates models of diagnosed objects.The models are generated periodically after a specified period of time.For the model identification index n is used in the article.
The object model is a set of functions.A function can describe a whole object or part of the object, or a particular process in the diagnosed object.Comparison of results calculated by different functions with the corresponding measurements can provide the fault location.For the function identification index m is used in the article.
The processes occurring in the object can be essentially nonlinear.Additionally the processes in the object can have phase transitions.For example, acoustic waves in the combustion system of the gas turbine can be caused by loss of flame stability and phase transition to the unstable combustion.Thus, many functions in a set cannot be described by means of algebraic functions.Therefore, all experimental samples received in the operation of the object are divided into clusters.Then, all functions are defined by their values in the centers of the received clusters.Index k is used in the article for identification of the clusters.
Two approaches to diagnostics are realized in this self-training algorithm.For detection of a fault with relatively sharp development the difference between the value calculated by model and the measured value is used.Continuous exploitation of technical object causes its deterioration with relatively smooth development.Comparison of two models created at the beginning of operation and at the time of diagnostics is used for estimation of the deteriorations.
As an example, usage of this algorithm for turbomachines is described.

Model of a Diagnosed Object
The model n is formed in a time point M n t and stored in the computer memory.The model consists of a set of statistical functions.can have different number of members.Basically, for forming the set of the statistical functions relatively in-depth knowledge about the object is needed.It is assumed that the input vector for each statistical function is known.Usually, in the case of diagnosis of a technical object the structures of the required functions are known from theory.Otherwise, further study of correlations between the parameters of the object being diagnosed is needed.The study of such correlations is beyond the scope of this article.
It is preferable to form input vector and output variables directly from measured signals that run from sensors.Also in the statistical functions can be used values that are calculated from the measured signals, for example, polytropic efficiency of compressor.In some models, the same value can be an output variable for one of the statistical functions and an input variable for another function.
It is assumed that the diagnosis of the object is performed only for time periods when all the transients are finished and the object is in a stable condition.A group of parameters, which characterize stability of operation of the object, has to be selected.For example, in case of diagnosis of a gas turbine the temperatures along the gas path can be selected.
If within a predetermined period of time the parameters of this group are within the specified range, this time period are considered as one experimental sample indicated by index j.
For this experimental sample the self-learning algorithm forms the input vectors and the output values for all statistical functions that are included in the model.The input vectors

Learning Process
To start diagnosis of the object, the algorithm needs a model of the object.The initial formation of the desired model can be implemented in various ways.The preferred option is the use of a database containing records of signals related to previous work of the analyzed object.If this option is not possible, the self-learning algorithm is able to passively observe the analyzed object until the required set of data samples

x
. For the distance the Euclidean determination is used.Then where V m N is the number of input variables in the statistical function m.Thus, the experimental point is located far from the center of the cluster has less influence than the experimental point, which is located closer.
The second coefficient depends on the period of time between the recording of the experimental point and carrying out clustering: where M n t is the time when the model is created and clustering take place.Thus, the last measurement has a greater influence than measurements in previous time period.The coefficients m α and m β are used for the algorithm tuning.
After repair or upgrade of the diagnosed object, the coefficients m α and m β can be temporarily increased for an accelerated training the algorithm.The value of the output variable at the center of the cluster is calculated by polynomial regression function.In particular, the linear regression function can be tested for use., , ,   , , , , , 1 The value of the coefficients in the regression function is estimated by the method of least squares taking into account the influence coefficients.
Thus, the coefficients , , , i k m n a can be found from the following equation: N is number of samples that is used for forming the model n.Then the output variables at the center of the clusters are calculated.For the center of the cluster its characteristic time is estimated by the recording times of all experimental points that belong to this set: , , is stored in the computer's memory.Information about the used set of the experimental samples is not stored.When the self-learning algorithm make a diagnosis of the object new experimental samples are collected in the computer's memory.The current set of the cluster's centers , , , , , , , , has to be added to the set of new experimental samples , , , , j m n j m n j n y t as additional samples.Then, the procedure of clustering is repeated and the new information about the centers of the clusters , , 1 , , , , is stored in the memory.
On Figure 2 a flow chart of the learning process of the algorithm is shown.The preprocessing module generates experimental samples from the continuously incoming signals from the diagnosed object.When the number of samples in the set reaches a predetermined number, the training process begins.
The generated set of the experimental samples is added to the information of the model with index n.The clustering is curried out and coordinates of new cluster centers 1 n + is stored in memory of the computer.In Figure 3 the example of retraining of algorithm is shown.The algorithm was used for permanent monitoring a gas compressor unit.One of the parts of the gas compressor unit was a centrifugal supercharger.For diagnosis of faults in the centrifugal supercharger several statistical functions were used.One of them was function of pressure drop on an entrance converging cone from the rotational speed of a shaft, inlet temperature, inlet and outlet pressure.Thus, the centers of clusters have been located in 4-dimensional space.
In Figure 3 its 2-dimensional projection is shown, where 2 x is inlet temperature and 3 x is inlet pressure.All values in Figure 3

Diagnosis
Fault diagnosis can be started after the formation of the model of the diagnosed object consisting of sets of cluster centers.First, the influence coefficients are estimated.The centers of clusters, which located closer to a new measured sample, and were created later have a greater influence, than the centers of clusters located further and were created earlier.
The equations are similar to the previous ones.
, , , , , , N is number of clusters that used for description of function m f .Finally, the output value of the function m f is calculated for the new received sample: In certain cases for fault diagnosis it is rational to use complex criterion, which is formed from various m y ∆ calculated for various functions m f .These complex criteria are estimated in the post-processing module in Figure 4.For diagnostics of the gas turbine the functions which count a difference of temperatures measured by various thermocouples located downstream from the turbine were used.T + are temperatures measured by adjacent thermocouples, T is the average temperature after the turbine.
The input parameters of this function are the average temperature after the turbine and the rotation speed of the turbine shaft.
The value T K was used as a criterion of fault detection in the combustion system of the gas turbines.
( ) where TC N -number of the thermocouples located after the turbine.Change of criterion of T K is shown in the top part of Figure 5.During long time before the process shown in Figure 5, the gas turbine worked without problem and the criterion T K was relatively low.Then the crite- rion T K has dramatically increased, and the diagnosed gas turbine has been stopped after a while.Survey of the stopped gas turbine has shown that the nozzles of the combustors have been destroyed.Obviously, the abnormal shift of a flame from the normal combustion zone upstream into nozzles has led to their burnout.
For comparison, change of one more criterion of V K is shown in the lower part of Figure 5.This criterion is based on a function which calculates the root-mean-square vibration of the turbine.The root-mean-square vibration has been described as a function of the rotation speed of the turbine shaft and its output power.
In addition, the algorithm can be used for estimation of change of technical condition of the diagnosed object caused by its degradation and reduction of its resource.For this estimation several suitable functions have to be chosen.For example, for estimation of degradation of the centrifugal supercharger its polytropic efficiency can be calculated.
One or several sets of constant input parameters for these functions are established.Output values have to be calculated by two models created in different time points.
For example, the first model has to be created at the beginning of operation of the centrifugal supercharger.The polytropic efficiency can be calculated by this model from the established value of rotational speed of the shaft, inlet gas flow and inlet gas temperature.The next model can be created in several months.The polytropic

Conclusion
General information about the diagnosed object is necessary for the proposed algorithm.Numerical parameters of the diagnosed object can be defined at self-learning.The algorithm can be used for diagnosis of significantly non-linear objects.Difference between calculated by the algorithm values and corresponding measured values detects faults.The choice of the suitable functions included in the object model can help with definition of the place of fault.Comparison of the models created in different time points estimates the deterioration in a condition of object caused by long operation.

Figure 1 .
Figure 1.Flow-chart of the diagnosis algorithm under consideration.
Generally, these functions may not have analytical expression.In practice, for diagnosis of turbomachines this model can include several dozen those statistical functions.Choose of the output variables , m n y depend on method of diagnosis that is planned to use for the object analy-

+
at the cluster centers.Finally, the information of new model with index

3 .
are given in the normalized form.The previous clusters centers are marked with markers in the form of a ring (1).Then the monitored gas compressor unit work during long period of time.Coordinates related to this work are marked by points (2).All coordinates related to this work are located in a limited area indicated by the dashed line in the upper left corner of Figure The same area is displayed separately in larger scale in the bottom right corner on Figure 3. Then positions of the new centers of clusters were calculated by the technique described earlier.Positions of the new centers of clusters are marked with markers in the form of a cross (3).The algorithm changed the positions of the centers of the clusters only in the area where the work of gas compressor unit took place.The centers located far from this area have not changed their position.

Figure 2 .
Figure 2. Flow-chart of the learning process.

Figure 3 .
Figure 3.An example of forming a new set of the cluster centers.
measured value exceeds a determined threshold, then a fault can take place.The flow chart of the described algorithm of fault diagnosis is shown in Figure4.

Figure 4 .
Figure 4. Flow-chart of the fault diagnosis process.

Figure 5 .
Figure 5. Criteria related to temperature distribution after turbine and vibration of gas turbine.efficiency has to be calculated by the next model from the same established values.Reduction of calculated value of polytropic efficiency characterizes deterioration in technical condition of the diagnosed centrifugal supercharger.