Application of Improved Deep Auto-Encoder Network in Rolling Bearing Fault Diagnosis

Since the effectiveness of extracting fault features is not high under traditional bearing fault diagnosis method, a bearing fault diagnosis method based on Deep Auto-encoder Network (DAEN) optimized by Cloud Adaptive Particle Swarm Optimization (CAPSO) was proposed. On the basis of analyzing CAPSO and DAEN, the CAPSO-DAEN fault diagnosis model is built. The model uses the randomness and stability of CAPSO algorithm to optimize the connection weight of DAEN, to reduce the constraints on the weights and extract fault features adaptively. Finally, efficient and accurate fault diagnosis can be implemented with the Softmax classifier. The results of test show that the proposed method has higher diagnostic accuracy and more stable diagnosis results than those based on the DAEN, Support Vector Machine (SVM) and the Back Propagation algorithm (BP) under appropriate parameters.


Introduction
With the wide application of rolling bearings in various mechanical equipment, the problem of mechanical equipment damage caused by faults has become increasingly prominent, which affects the safety of equipment and personnel seriously [1].Therefore, research on the fault diagnosis of rolling bearings is crucial for the stable operation of mechanical equipment.Vibration analysis is the most widely used method for detecting the health of mechanical equipment [2].
At present, there have been many studies on the diagnosis methods of bearing faults [3] [4] [5].The analysis methods based on vibration signals mainly include noise method, oil sample analysis method, and vibration method.Hao et al. [6] proposed a multi-layer over-limit learning machine method to learn the fault vibration time domain signal and diagnose the fault of the rolling bearing.Liu et al. [7] proposed a method for extracting fault characteristics of rolling bearings based on fault characteristic trend line template.According to the fault characteristic trend line, the method finds the bearing fault characteristics and avoids the shortcomings in the order tracking process.A rolling bearing fault feature extraction method based on adaptive noise-based complete empirical mode decomposition (CEEMDAN) combined with IMF sample entropy is used to adaptively decompose the vibration signal [8].In order to extract the fault characteristics of rolling bearings accurately and stably, Liu et al. [9] proposed a feature extraction method based on variational mode decomposition and singular value decomposition.However, the K value in this method needs to be given in advance, and the determination or range of other parameters is still lack of theoretical basis.The most critical part of the data-driven fault diagnosis method is the extraction of bearing fault characteristics [10].Due to the increasing number of bearing equipment, the frequency of collecting samples is getting higher and higher, which makes bearing faults fall into massive data problems.The method adopted above requires a large amount of prior knowledge, rich theoretical knowledge of signal processing and practical experience as a support in the process of feature extraction.Moreover, the number of samples selected by the fault feature is small, which cannot adequately reflect the potential information of the bearing fault data, and reduces the accuracy of fault diagnosis.Therefore, it is especially important to choose a suitable method for fault diagnosis of rolling bearings.
In 2006, Professor Hinton proposed the idea of deep learning, which opened up a wave of deep learning in academia and industry [11].At present, deep learning has also been applied in the field of mechanical failure.The advantage of this method lies in the ability to mine representative information and sensitive features from raw data.The convolutional neural network (CNN) is used to learn the characteristics from the frequency data of the vibration signal [12], and test the different performances of the feature learning from the original data, the spectrum and the time-frequency domain combined data.The method can adaptively learn features from frequency data and has higher diagnostic accuracy, but it is easy to fall into the local optimal solution.In order to combine the power transformer online monitoring of dissolved gas analysis (DGA) data in oil, Shi et al. [13] proposed a transformer fault diagnosis method based on CDAEN, and compared with the traditional method, the deep self-encoding algorithm can more vividly describe the potential of input data.Information and effective extraction of fault characteristics, but this method is poorly stable.Deep Auto-Encoder Network (DAEN) is a deep learning model and is widely used in various fields [14] [15].In this paper, cloud adaptive particle swarm optimization (CAPSO) algorithm is used to optimize the depth self-encoding network, and CAPSO-DAEN based fault diagnosis method for rolling bearings is proposed.This method is based on the powerful computing of DAEN and combines the adaptive and stability of CAPSO algorithm search.It can optimize the connection weight of DAEN, reduce the constraint on the weight, and extract the fault characteristics automatically.The results show that the proposed method has higher accuracy and stable diagnosis results relatively.

The Basic Theory of DAEN
Deep Auto-Encoder Network (DAEN) is a neural network consisting of a multi-layer auto-encoder AE [16].The output of the hidden layer of the above-mentioned AE is used as the input of the next level, layer by layer training.The feature representation in the original space is transformed into another feature space, and the potential information between the data is depicted, which can be applied to multi-layer network training and solve multi-classification problems.The training of the entire deep self-encoding network is divided into two stages: pre-training and fine-tuning [17].

Pre-Training
Auto-Encoder (AE) is a three-layer neural network model [18], which is composed of two parts: encoder and decoder.Its structure is shown in Figure 1.

Given the training samples
, ,.., ).The output vector set of the hidden layer is , ,..., ( ) ( ) where x and h are D-dimensional vectors, The decoder is the inverse of the encoder, the original input vector is reconstructed using the hidden layer output vector obtained by the encoder.Output , ,..., ) by decoders as follows where z is a D-dimensional vector.The goal of AE training is to optimal set of parameters , so that the error between the output data and the input data is as small as possible [20].AE usually uses MSE as the loss function of the standard autoencoder, the loss function expression is as follows

Fine-Tuning
It

Bearing Fault Diagnosis Model Based on CAPSO-DAEN
The input layer of the AE has the same number of nodes as the output layer.The process of encoding and decoding can be regarded as compressing the input data, and representing the high-dimensional original data with a low-dimensional vector, so that the compressed low-dimensional vector can be retained.

CAPSO-DAEN Training Algorithm
In this paper, the CAPSO algorithm is used to optimize the connection weight between each hidden layer and output layer in DAEN.It can find the optimal solution adaptively, reduce the dependence on the weight and improve the convergence speed of the algorithm.The input data for this model is the original time domain signal of the bearing vibration signal.
The hidden layer and the output layer of the AE are connected by weights, and the influence of the output vector of the hidden layer in the network on the output layer vector is different.The connection weight between each hidden Journal of Computer and Communications layer and output layer in DAEN is mapped into the particles in the CAPSO algorithm, the speed and position of the particle are adjusted continuously, the fitness value is updated, and the global optimal solution is finally output.According to the expression of the loss function in Equation ( 4), the training error function E in the automatic encoder is the fitness function in the CAPSO algorithm, and the expression is as follows: where i x is the ith training sample of the AE encoder; i z is the ith output vector of the AE encoder.
The specific steps for optimizing the weight between the hidden layer and the output layer in DAEN with CAPSO are as follows, as shown in Figure 2.
Step 1: Determining the network topology of the DAEN, determining the number of cells in each layer in the automatic encoder and initializing related parameters.Step 2: Initialize the population in the CAPSO algorithm, Set the parameter vector X = {ω, θ} of DAEN as the position k i x of particle i in the kth iteration.
Initialize the control coefficients 1 α , 2 α in the CAPSO, the total number N of particle groups, the maximum number of iterations, and the initial value of the convergence angle min γ .
Step 3: The weights between the hidden layer and the output layer in the DAEN are mapped into particle groups in the CAPSO, the position and velocity of the particle group are initialized.Then, the initialized samples are input into the DAEN for adaptive training learning.According to the mode, the fitness function in the middle, constantly updating the fitness value f of the particle iteration position.
Step 4: The particle individual optimal solution and the global optimal solution are updated to determine whether the end condition of the loop is satisfied.
If the current number of iterations is the maximum number of iterations or the current error is the minimum error.The optimal network connection weight, is output.If the condition is not met, re-update the position and speed of the particle and execute Step3.

Fault Diagnosis Model for Rolling Bearings
The intelligent fault diagnosis model of rolling bearing based on CAPSO-DAEN is divided into the following steps, as shown in Figure 3, the steps are as follows: Step 1: This model uses the original vibration time domain signal of the bearing as input data.
Step 2: The input data of the model is preprocessed.The vibration time domain

Experimental Data
Sample model of data should endeavor to include all bearing fault characteristics.Vibration signal contains complicated bearing information, thus time domain data of vibration signal are the inputs of network.The experimental data is based on the rolling bearing fault vibration data released by the Case Data Center of Case Western Reserve University.The CAPSO-DAEN method is used to learn the time domain signal of the rolling bearing vibration.In experiment, different degrees of single point damage were produced in the bearing outer ring, rolling body and inner ring by EDM technology.
In the experiment, the acceleration is used to collect the vibration signal, and the sensor is placed on the motor housing by using a magnetic base.The acceleration sensors are respectively placed at the drive end of the motor housing at 12 o'clock.The vibration signal was acquired by a 16-channel DAT recorder.The simulated experimental environment was MATLAB R2016a.The sampling frequency of the digital signal is 12,000 Hz, and the drive end bearing fault data is Journal of Computer and Communications simultaneously collected at a sampling rate of 48,000 Hz.
In order to test the validity and accuracy of the algorithm, the sample set is divided into training samples and test samples, and 150 sample sets are randomly selected to test the CAPSO-DAEN algorithm, and the remaining sample set is used to train the CAPSO-DAEN algorithm.

Analysis of Result
From Table 2 and Table 3 4.According to the table, the average diagnostic accuracy of the CAPSO-DAEN method was the highest, 94.46%, higher

( ) 2 W 2 b
is a weight matrix that connects the hidden layer to the output layer.( )   is the offset matrix between the hidden layer and the input layer, can be known from the above pre-training process that when training the AE parameters of each layer, the other layer parameters are fixed and remain unchanged.Therefore, if you want better results, you can use the tagged data set to adjust all layer parameters of the entire depth self-encoding network to achieve global optimality by BP algorithm after the pre-training is completed.This process becomes fine-tuned.The fine-tuning after the pre-training is completed will directly use the BP algorithm to train the effect on the initial weight of the randomization, because the latter tends to fall into the local optimum[21].

1 )Figure 5 . 2 )
Figure 5. 2) Research on fault diagnosis results under different methods.The fault diagnosis situation of training set is 300, 500, 700, 900, respectively.The results of CAPSO-DAEN and DAEN are shown in Table 2. Compared with
further verify the effectiveness of the CAPSO-DAEN algorithm, we compare it with traditional algorithms such as SVM and BP.The initial values of these parameters are determined through extensive experiments.SVM uses the most widely used radial basis kernel (RBF), in which the two most important parameters are the penalty factor and the radius of the kernel function, which are set to 20 and 0.082 respectively.The initial learning rate of BP algorithm is 0.1, and the maximum training iteration number is 500.The above 2 methods use the same vibration signal for training and testing, and the accuracy of the fault diagnosis is shown in Table , we can see that the rolling bearing fault diagnosis method based on CAPSO-DAEN has higher fault diagnosis accuracy than the other 3 methods.In the test stage, the fault diagnosis method of rolling bearing based on CAPSO-DAEN and DAEN algorithm increases with the increase of training samples, but the accuracy rate of fault diagnosis is increasing, but CAPSO-DAEN has high accuracy.The fault diagnosis method of rolling bearing fault diagnosis based on BP and SVM algorithm increases with the increase of training samples and the accuracy rate of fault diagnosis.It is also increasing.However, when the training sample is 250, the growth rate is slow, and it is only suitable for small sample training.When the training sample set is 350, the four methods of CAPSO-DAEN, DAEN, BP and SVM are tested, respectively, of which the number of AE layers in the CAPSO-DAEN method and the DAEN method is 4, and the statistical diagnosis results are shown in Table

Table 2 .
Compared with

Table 1 .
Status coding of rolling bearings.

Table 2 .
Fault diagnosis results for different training sets.With the increasing number of training samples, the average accuracy of the two methods of CAPSO-DAEN and DAEN is also increasing.However, the average diagnostic accuracy of DAEN is significantly lower than that of CAPSO-DAEN, and the diagnostic accuracy of CAPSO-DAEN is higher.When the training set reaches 900, the average diagnostic accuracy of CAPSO-DAEN is 96.01%, and the effect is better.Therefore, determining the number of training samples plays a key role in improving the accuracy of fault