A Study on Prediction of Weld Geometry in Laser Overlap Welding of Low Carbon Galvanized Steel Using ANN-Based Models

Predictive modelling for quality analysis becomes one of the most critical requirements for a continuous improvement of reliability, efficiency and safety of laser welding process. Accurate and effective model to perform non-destructive quality estimation is an essential part of this assessment. This paper presents a structured approach developed to design an effective artificial neural network based model for predicting the weld bead dimensional characteristic in laser overlap welding of low carbon galvanized steel. The modelling approach is based on the analysis of direct and interaction effects of laser welding parameters such as laser power, welding speed, laser beam diameter and gap on weld bead dimensional characteristics such as depth of penetration, width at top surface and width at interface. The data used in this analysis was derived from structured experimental investigations according to Taguchi method and exhaustive FEM based 3D modelling and simulation efforts. Using a factorial design, different neural network based prediction models were developed, implemented and evaluated. The models were trained and tested using experimental data, supported with the data generated by the 3D simulation. Hold-out test and k-fold cross validation combined to various statistical tools were used to evaluate the influence of the laser welding parameters on the performances of the models. The results demonstrated that the proposed approach resulted successfully in a consistent model providing accurate and reliable predictions of weld bead dimensional characteristics under variable welding conditions. The best model presents prediction errors lower than 7% for the three weld quality characteristics.


Introduction
Laser welding is an assembly process widely used in the industry, including the automotive industry. Overlap welding of galvanized steels enables joining of body car elements from different thicknesses. The disadvantage of the overlap configuration is the premature vaporization of zinc, which generates pressure at the interface of the overlapped sheets. These pressurized vapors eventually eject the metal out of the melting pool or trapped as blowers after solidification.
Several experimental studies have shown the possibility of overcoming this situation by controlling the welding process parameters. Like the keyhole welding, which creates a channel permitting the evacuation of zinc vapors, an optimal gap between the parts to be welded also allows the lateral evacuation of these vapors. This means that a good control of welding parameters and conditions (laser power, welding speed, focal diameter, Gap between sheets and sheet thicknesses) can produce the desired welds characteristics.
Laser welding parameters play an important role in determining the mechanical characteristics of the weld seam [1]. Since the resistance of welded joints is linearly proportional to the shape and dimensions of the weld cross section, it is obvious to identify the relationship between the welding parameters and the geometrical attributes of the weld. To obtain welds with well-defined characteristics, the traditional test-failure method proves too expensive and more time-consuming. Finite element modeling has led to promising results through the performance of simulation software, but the complexity of the laser welding process, which includes many physical phenomena (thermal transfer, fluid flow, electromagnetic and thermodynamics), makes the models very complex; therefore, the calculation time becomes too long.
In contrast, thanks to their strong learning ability, artificial neural networks (ANNs) can establish nonlinear deterministic relationships between the inputs and the outputs of any system regardless of their complexity. ANNs are inspired by the human brain, they can learn and experience from examples, as they have a powerful ability to classify and recognize patterns. ANNs are used in many different fields of business, industry and science [2]. Synthia et al. [1] have developed a neural network-based prediction model of weld bead geometry according to laser welding parameters, in three different shielding gases (argon, helium and nitrogen). Another study applied an artificial neural network to predict a geometry of GMAW welds with alternating shielding gases. The experimental results proved conformity and accordance with the predicted geometries. Furthermore, a sensitivity analysis showed that the welding speed is the most influential input parameter in the predicting model [3].
Frason et al. [4] developed a laser weld penetration monitoring system using an ANN to analyze acoustic emissions from the weld, and thereby determine the depth of penetration of the weld in real time. The system uses a fuzzy logic algorithm to compute the necessary speed changes to maintain the penetration at desired levels. An identical study used an ANN model to diagnose welding After training, the ANN could identify normal and abnormal welds [5]. In the same vein, an ANN model uses data extracted from infrared thermal images that are recorded in real time during A-TIG welding, for the purpose of weld width and depth estimation [6]. Another study shows the possibility of using neural networks in the ascertainment of the weld quality for thermoplastics welded by laser transmission [7].
Olabi et al. [8] combined a backpropagation ANN with Taguchi design for experiments in order to optimize the parameters level (welding speed, laser power and focal position) of CO2 keyhole laser welding process in butt joint configurations. The laser welding of stainless steel in butt joint configuration was modeled using backpropagation trained neural network. The predicted weld dimensions showed conformance with the measured weld cross sections [9].
Castiliano et al. integrated an artificial neural network into the laser welding process, in order to optimize process parameters when welding stainless steel and increase its efficiency [10].
Depending on their architecture and their fields of application, several types of ANN exist. A broader description of different neural networks is presented in the literature review made by Zhang et al. [2]. The Multi-layer feedforward ANN is the most popular and widely used ANN in many applications, especially forecasting, because of their great ability to map nonlinear and complex relationships in multi-inputs multi-output context [11] [12] [13]. Jacques et al. proposed an ANN based predictive modelling approach for weld shape and dimensions in butt joint laser welding of galvanized steel [14]. The resulting model presents excellent predictions with an average error less than 10%. This model, however, can only be applied in the case of laser welding in butt joint configurations.
Only a few studies used ANNs to predict the quality of laser welding of galvanized steels and even less in overlap configurations. The few attempts revealed in the literature are focussed on specific application of the ANNs without explicit and detailed references to the nature of the data used in the models training and validation and criteria adopted for the model performance evaluation. These fundamental ideas that constitute the basic ingredients of any models optimization procedure are indispensable to build an efficient predictive modeling approach.
The present paper presents an artificial neural network based model for predicting the weld bead dimensional characteristic in laser overlap welding of low carbon galvanized steel. The modelling approach is based on laser welding parameters such as laser power, welding speed, laser beam diameter and the gap between the overlapped parts to estimate specific weld bead dimensional characteristics such as depth of penetration, width at top surface and width at interface. A series of data provided from experiments using a 3KW Nd-YAG laser source in a well-structured Taguchi design are combined with simulation data provided by a 3D finite element model to train and test the ANN built using variables selection based factorial design. Hold-out test and k-fold cross validation Journal of Software Engineering and Applications combined to various improved statistical criteria are used for assessing the models performance.

Methodology
The purpose of this study is to set up a model able to predict accurately and quickly three geometrical characteristics of the weld seams: depth of penetration In order to know the most influential laser welding parameters on the model accuracy, as well as the effects of these parameters on the quality of the of weld characteristics prediction, 16 models are built according to a full factorial design including the variables known for their influence on the variation of the geometrical characteristics of the weld. As shown in Table 1, a variable takes the value 1 when it is included in the model and 0 when it is not.
To eliminate the maximum random error sources, the learning data inputs, and the testing data inputs must represent the same population, i.e. both should be contained in the same variation range. This is the case in the present study, as shown in Table 2. Three levels are assigned to each parameter. The upper and lower limits of factors are respectively 2000 to 3000 W for the power of the laser, 40 to 70 mm/s for the welding speed, 300 to 490 μm for the beam diameter and 0.05 to 0.15 mm for the Gap. The Data assigned for training and testing the various models are partly provided from an experimental investigation of laser welding process [15] while the other part is produced by a 3D FEM simulation [16]. In order to include the gap in the ANN modeling, the finite element model  "hold-out set method" and "k-fold crossvalidation method". The hold-out set method consists of using the large part of the data to train the model and the remaining data to test it. The k-fold cross validation method consists of sampling all the n data after its randomization in k segments, the model is then trained by n-k data and tested by k remaining data. The procedure is repeated k times by changing the testing sample each time. The validation errors are estimated by various statistical tools for the k variants, then averaged to determine the real prediction errors of the model.
The neural network modeling procedure used in this study consists first in confirming the reliability of the data provided by the 3D finite element model.
Using the hold-out set method, the ANN models are trained by the entire simu-Journal of Software Engineering and Applications lation data and then tested by the experimental data. Second, all the data are mixed and randomized, then the k-fold cross validation method is applied, with k = 6.

ANN Model Building
There are several kinds of networks according to their architectures, their internal mechanisms and their application objectives. In the present study, the interest is focused on multilayer feedforward back propagation perceptron for its prediction capability. As illustrated in Figure 2, the MLP is mainly composed of: 1) an input layer with a number of neurons equals the number of input variables of the ANN, called independent variables. 2) One or more hidden layers having a limited number of neurons (n). It is necessary to try several networks for different values of n in order to optimize the training performances especially as the number of variables varies from one model to another and to avoid overtraining. Consequently, to avoid long training and overfitting that could affect the models accuracy, only one hidden layer is considered using n = 2 × p + 1, with p is the number of independent variables. 3) An output layer containing a specific number of neurons equal to the number of output variables. In our case, there are three outputs (DOP, WS and WI). The artificial neuron is an integrator that performs the weighted sum of its inputs originate from the previous layer (Equation (1)). The resulted sum is then transformed by a transfer function to provide the neuron output. The transfer function used for neurons of the input and hidden layer, is a sigmoid (Equation

Model Assessment
Based on the modeling process results, three statistical variables are estimated to evaluate the performance of each model: 1) Coefficient of determination R 2 which is commonly applied to training errors. Its main defect is its growth with the addition of input variables to the model, whereas an excess of variables does not always lead to robust models. This is why one is interested in the adjusted coefficient 2 R . 2) Root mean squared error (RMSE) is the standard deviation of prediction errors (residuals), it measures the extent of these residuals and indicates the concentration of data around the line of best fit, and 3) mean absolute percentage error (MAPE) is a useful measure of forecasting accuracy. It is easy to interpret because it is expressed in percentage. The criteria are expressed mathematically as: where n, p, i y , ŷ and y denote respectively sample size, number of input process parameter, actual output, predicted output and the mean actual output.

Results and Discussion
The   Variance analysis (ANOVA) results in Table 4  The P-value and F-value express the reliability of ANOVA results. For example, for P = 0.03, the Gap contribution of 1.2% is a reliable result with 97% confidence. As we can see, the confidence interval for the effects of laser power, welding speed and focal diameter is about 99%, and that associated with the gap effect is 94%, this is most likely due to difficulty maintaining a constant Gap along the welding line.
A comparison between validation errors and learning errors shows how well an ANN model can predict the geometric attributes of the weld for any laser welding parameters combination. The comparison is applied to the models that show better performances during the learning process, namely models M 1 , M 2 , M 5 and M 8 . Table 5 includes learning errors, validation errors, and k-fold crossvalidation error.      The results do not show a large deviation between training errors and validation errors, as the maximum gap between these two has been proved to not exceed 4%. The validation errors obtained by the two methods are almost identical. In the light of the results shown in Table 5, the DOP can be predicted with a precision greater than 93% by the model M 1 , a precision greater than 91% by the M 2 model and a prediction error exceeding 10% for the two other models. WS can be estimated with a precision greater than 95% by the four models. WI can be predicted by the model M 1 with an accuracy greater than 93% and a precision of 91% for other models. Figure 6 shows the values predicted by the model M 1 Vs actual values, respectively of DOP, WS and WI. Figure 7 shows those predicted by the model M 2 and Figure 8 shows those predicted by model M 5 . The contour of the cross section of a weld bead can be deduced from the three predicted geometric attributes DOP, WS and WI.

Conclusion
This paper presents a structured approach developed to design an effective artificial neural network based model for predicting the weld bead dimensional characteristic in laser overlap welding of low carbon galvanized steel. Based on a fused data provided by structured experimental investigations using Taguchi method and in-depth FEM based 3D simulations, the possible relationships between welding parameters such as laser power, welding speed, laser beam diameter and gap, and weld bead dimensional characteristics such as depth of penetration, width at top surface and width at interface are analyzed and their sensitivity to the welding conditions are evaluated using relevant statistical tools.
Based on these results, a factorial design is used to develop, implement and evaluate different neural network based prediction models. The proposed models Journal of Software Engineering and Applications are trained and tested using experimental data, supported by the data generated by the 3D simulation. Hold-out test and k-fold cross validation combined to improved statistical criteria are used to evaluate the influence of the laser welding parameters on the performances of the models. Analyses of variance results reveal that all the welding parameters have a positive contribution to the improvement of the prediction quality. The laser power and the welding speed contributions are much more important compared to the contribution of the laser beam diameter. The gap contribution appears to be insignificant.
The achieved predictive modelling results demonstrate that the resulting models present excellent performances and can effectively predict the weld bead dimensional characteristics with average predicting errors less than 10%. The validation process reveals that the WS can be predicted with an accuracy of 96% while the prediction accuracy of DOP and WI is about 93%. These results demonstrate that the proposed ANN based prediction approach can effectively lead to a consistent model able to accurately and reliably provide an appropriate prediction of weld bead dimensional characteristics in laser overlap welding of low carbon galvanized steel under variable welding parameters and conditions.
With the encouraging results achieved using this modelling strategy, the laser overlap welding of low carbon galvanized steel will be the subject of additional and exhaustive investigations to produce more numerical simulation and experimental data as well as to test others neural networks approach in order to develop more efficient ANN predictive modelling method.