Sage Journals: Discover world-class research

Abstract

Aiming at the problems of poor welding quality and low degree of automatic welding on the engineering site, a welding process parameter control method based on machine vision and nonlinear regression technology is proposed. Firstly, a vision unit and a peripheral sensor unit are designed to obtain the information of each influencing factor of the welding process parameters. Secondly, a clustering algorithm is used to improve the extraction accuracy of feature point coordinates of weld images. Thirdly, a nonlinear regression fitting method is proposed to determine the mathematical relationship between welding quality at different welding positions and corresponding process parameters. Experimental results show that the control system is easy to operate, and the flexible control of welding process parameters in the whole process is realized. The weld cumulative height and width deviations are less than 0.5 and 0.3 mm, respectively. The welding surface is stable and meets welding requirements. Therefore, this method is of great practical significance in engineering field welding.

Keywords

All-position welding machine vision nonlinear regression control system weld formation

The inspiration of my work

Through the analysis of a large number of welding experimental data, the results show that the welding current, welding voltage, and welding speed are related to the position of the groove to be welded and geometric information. We use the method of nonlinear regression to determine the mathematical relationship between the dependent variable and the independent variable.

Considering that the geometric information of the weld is difficult to measure with conventional methods, this paper designs a machine vision sensor to collect the characteristic information of the weld to be welded.

Considering the noise interference caused by slag splash and arc signal in the welding process, this paper proposes a clustering algorithm to improve the accuracy and stability of image feature extraction. According to the characteristics of the weld image and the distribution law of the sampling points, the direction and distance in the Euclidean geometry are used as the judgment standard, and the optimal threshold is set, and finally the classification of the sampling points is realized.

The welding control system based on the above method is designed, and the feasibility of this method is verified through experiments.

Introduction

Vision technology has developed into a mature stage, enabling more and more industrial robots to be used in enterprise production.^1,2 Welding system with multiple sensing technologies has a good application prospect in the welding field.^3–5 Welding technology and system play an important role in modern industrial application,⁶ with all-position welding of pipelines always being a research hotspot, which has a broad application prospect to realize all-position low-cost and efficient welding while ensuring welding quality.⁷ At present, all-position welding of most pipelines is manual or semi-automatic, which suffers low welding efficiency, and high dependence of the welding quality on the skill of welders, so it is difficult to guarantee the welding quality and the stability of weld formation. The core of all-position automatic welding is how to obtain the key information of welding area and weld preparation, and how to automatically match and control the welding parameters in the welding area, in a bid to meet the quality requirements of all-position welding.

All-position welding of pipeline is composed of horizontal welding, vertical welding, and overhead welding, of which vertical welding is divided into vertical up welding and vertical down welding. The welding difficulties include the following: First, the requirements of welding parameters change accordingly with different positions. Second, the weld formation of a layer affects the setting of welding parameters of the next layer in multi-layer and multi-pass weld preparation, and the final shape of the molten pool is influenced by factors such as the direction toward which metal in the molten pool flows, the amount of supplementary metal, the retention time at high temperature, and the spreading height of the side wall.⁸ For now, a traditional demonstration mode prevails in all-position welding robots for pipelines at home and abroad, making the robots expensive and mostly fixed, have high requirements on the working environment, and go against the promotion and application in industrial fields. In the rapidly developing manufacturing industry, work efficiency has become an important index to measure the automation of equipment. And the continuous advancement of Industry 4.0 makes it difficult for the traditional demonstration mode to meet the needs of industrial automation.

For all-position welding of pipelines, Xu et al.^9,10 conducted statistical modeling, prediction, and optimization of weld geometry. Guo et al.¹¹ established a visual servo control system for effectively integrating and extracting characteristic parameters of images, thereby achieving welding attitude control based on visual servo control by controlling the position of welding gun. By designing an appropriate excitation structure, Yue et al.⁷ used an exterior high-frequency alternating field to generate eddy current in the metal molten pool, finally triggering electromagnetic force opposite to gravity. This scheme is of positive significance for restraining metal flowing and raising efficiency in all-position welding, but it is inapplicable to outdoor pipeline welding with complex working environment.

In all-position pipeline welding, the welding parameters of each position are greatly subject to the current welding position, and the thickness and width of the welding layer of weld preparation to be welded. In recent years, machine vision technology has developed rapidly and has been widely used in automatically-guided welding due to its advantages of non-contact and high precision.^12,13 The application of sampling vision sensing technology to weld space measurement tends to mature.^14–16 Deep learning technology is gradually applied to the field of robot welding for image analysis and prediction.^17,18 In practice, the images collected on site are accompanied by a lot of noise primarily resulting from welding arc light, weld spatter, and weld fume. The noise will directly cause weld characteristic signals to be inconspicuous or even submerged, then reduce the accuracy of automatic matching of welding parameters, and finally lower the welding quality. To measure the welding seam, the most important task for the information processing unit of laser vision welding seam is to find the inflection point and accurately extract the characteristic parameters of the welding seam.¹⁹

With that, this paper was proposed to design an all-position welding control system based on machine vision and nonlinear regression for all-position welding control of welding robots. Meanwhile, it provided a nonlinear regression-based optimization method for all-position welding parameters, which is effective in automatic control of welding parameters by analyzing welding parameters and weld preparation information at different positions of the pipeline and then fitting a function.

The rest of this paper is structured as follows. Section 2 presents the related work. Section 3 describes extraction of weld feature information. Section 4 presents comprehensive experiments and analyses. Section 5 concludes the paper.

Related works

Take 20# carbon steel pipe with a diameter of 400 mm as an example, with a thickness of 16 mm and a V-shaped groove. The content of carbon, silicon, and manganese in this carbon steel pipe are 0.2%–0.25%, 0.17%–0.37%, and 0.35%–0.65% respectively. The vision sensor used to collect the weld seam image is mainly composed of an industrial camera and a line laser. The resolution of the industrial camera is 1280 × 1024, the sensor type is CMOS, and the image color is black and white. The power of the line laser is 16 mW.

Through the analysis of experimental data, the non-linear regression method is used to establish the functional relationship between the weld feature information and the welding process parameters, and the control system is designed. Because the geometric information of the weld is difficult to measure with conventional methods, this paper designs a machine vision sensor to collect the characteristic information of the weld to be welded, and uses a clustering algorithm to improve the accuracy of the weld information, and the current welding area is determined by the angle sensor, thereby realizing the pipeline all-position welding.

The all-position welding control system based on machine vision and nonlinear regression was mainly composed of vision module, control module, and execution module, whose system architecture was shown in Figure 1.

Figure 1.

System architecture.

The vision module consisted of an industrial camera, a line laser, and an industrial computer, as shown in Figure 2. According to laser triangulation,²⁰ the light bar projected on the pipeline weld by the line laser is deflected when it covers the welding seam. Considering the accessibility of field use, the industrial camera and the line laser form a visual sensing unit at relative positions in space to implement the image acquisition function. Weld spatter reduces the quality of images collected with the industrial camera. In order to eliminate noise interference and increase accuracy of image acquisition, the visual sensing unit, with an interval of 50 mm from the welding torch, is installed at the end of the trackless crawling welding robot. With an image processing algorithm, the Industrial Personal Computer (IPC) analyzes images collected using the visual sensing unit to attain the width and thickness of the welding layer.

Figure 2.

Vision module schematic.

The control module is composed of embedded PC, robot pose detection sensor and supporting electrical components, and controls trackless crawling welding robots and digital welding power supply through the embedded PC. The vision module, the basis of the all-position welding control system to control welding process parameters, transmits the processed weld data to the control module. The robot pose detection sensor is used to detect the crawling angle of a trackless crawling welding robot on pipeline, and transmit the data to embedded PC in real time. The embedded PC adopted in this paper had a minimum scan cycle of 50 μs, while it enjoyed fast data processing and supported large amount of information processing, compared with the programmable controller with millisecond scanning cycle, which fully met the requirements of the all-position welding control system for real-time information transmission and data processing speed. In order to minimize the equipment volume, the control module is embedded into the welding robot, so that the welding robot is spatially independent of the control module, and the volume of this system is only 60% of the traditional welding control system (Figure 3).

Figure 3.

System schematic.

The execution module consists of a trackless crawling welding robot and a digital welding power supply. The trackless crawling welding robot is a magnetic adsorption type four-wheel three-axis robot, which can go back and forth (X), swing (Y), and go up and down (Z).

The flow of the all-position welding control system is shown in Figure 4.

Figure 4.

Control system flow.

The research method used in this article is shown in Figure 5.

Figure 5.

Control system flow.

Extraction of weld feature information

Weld seam image processing

As shown in Figure 3, the laser stripe emitted by the line laser was projected on the welding seam, and then regularly deflected along with the geometry of the weld preparation. The vision module was designed to accurately extract the welding seam image, obtain the weld contour and the coordinates of weld feature, and then work out the accurate weld layer width and height. In Gas Metal Arc Welding (GMAW), the quality of images collected by an industrial camera will be greatly reduced by weld spatter and the consequent weld fume, so it is difficult to obtain stable and accurate contour information via traditional contour extraction. Figure 6(a) and (b) respectively show the normal image and the image with noise.

Figure 6.

Welding seam image: (a) normal image and (b) image with noise.

The vision module was designed with process flow and the measurement experiment was performed in this paper, as shown in Figure 7, to improve the accuracy and stability of weld images. After the vision module is started, the camera periodically collects weld images. First, the gray value of the image was transformed using linear function, and image details were highlighted via image contrast enhancement. Next, on the premise of not changing the whole feature information of the image, isolated image noise points were removed. The key of the process flow is to collect key information points of weld image and remove interference sampling points by clustering algorithm. Weld feature information is always in the fixed area of an image consequently, a rectangular window can be set in the image to select the target area, which reduced the workload of subsequent image information processing to 50%. The image was then smoothed using a Gaussian filter to partially eliminate image noise; and to differentiate the profile curve, where a positive derivative indicates that the gray value increases from small to large, which is a positive edge, and negative derivative indicates that the gray value grows from large to small, which is a negative edge. In this paper, the negative edge points were selected as the edge sampling points of the target contour.

Figure 7.

Image processing flow.

Obtain weld feature information by clustering algorithm

In recent years, so great progress has been made in the research of clustering algorithm that clustering, an unsupervised learning algorithm, has been widely used in image analysis.^21,22 In most cases, sample data sets have no subsets, and data samples have no fixed label, as well. Clustering is to integrate object members with similar attributes in a set into different subsets by classification and judgment. As illustrated in Figure 8, a large number of edge sampling points were extracted from the edge image of the welding seam after preprocessing, along with interference points. Figure 8(a) and (b) showed the sampling results of normal image and noise image, respectively. A fast and accurate clustering algorithm was designed here to screen sampling points, providing a prerequisite for the accuracy of weld feature values.

Figure 8.

Sampling distribution of welding seam images: (a) normal image sampling point and (b) noise image sampling point.

Clustering algorithm is a method whereby the similar samples in a data set are divided into several categories, with the measurement of the similarity between samples as its pivot. The key to improve the classification accuracy by the clustering algorithm is to set reasonable judging criteria and determine the optimal threshold based on the distribution of weld sampling points, so as to eliminate interference to the maximum extent and obtain stable, effective sampling points. In this paper, the direction and distance in Euclidean geometry were taken as the judging criteria according to the characteristics of weld image and the distribution law of sampling points, so as to set the optimal threshold, and eventually realize the classification of sampling points.²³

D (X_i, X_j) is the Euclidean distance between two adjacent sampling points X_i, X_j, and θ(X_i, X_j) is used to represent the angle formed by the connecting line between two adjacent sampling points and the horizontal direction, where l is the sample feature dimension and the vision module extracts the two-dimensional coordinates of all sampling points, so d is 2, then:

D (X_{i}, X_{j}) = \sqrt{\sum_{l = 1}^{d} {(x_{il} - x_{jl})}^{2}}

(1)

θ (X_{i}, X_{j}) = | \arctan ((x_{j 2} - x_{i 2})) / (x_{jl} - x_{il}) |

(2)

Setting D_T, θ_T as a distance threshold and an angle threshold respectively, and when X_i, X_j satisfy the condition (3),

{\begin{matrix} D (X_{i}, X_{j}) \leq D_{T} \\ θ (X_{i}, X_{j}) \leq θ_{T} \end{matrix}

(3)

X_i, X_j are considered as the same class and put into the same subset.

The clustering algorithm was performed as follows:

Initiate the clustering algorithm, read sampling points column by column, and if the sampling points in the first column are n, create n subsets of C₁, C₂, C₃,…, C_n, and record them as C_i;

Obtain the sampling points in the second column, and calculate the distance and angle with the sampling points of subset C_i by using formulas (1)–(3) one by one, and then judge whether the two sampling points belong to the same class. If the threshold condition is met, the point will be attributed to C_i, otherwise, it will be placed in the newly created subset C_n+1. By analogy, create new subsets C_n+2, C_n+3, …, and record it as C_i;

Obtain the sampling points in the 3rd, 4th, …, i columns in turn, and classify the sampling points by performing the operation in step ②.

The algorithm ends when all sampling points are read, calculated, and classified.

After classification by clustering algorithm, sampling points in weld images were displayed as shown in Figure 9, in which the sampling points in different categories are represented using different colors. Figure 9(a) and (b) showed the processed result of normal image and noise image by clustering algorithm, respectively. Sampling points in subsets with more elements were represented in green, which were weld outline points. Sampling points in subsets with less elements were represented in blue, red, and orange. The results showed that the clustering algorithm could effectively remove the interference and select the optimum sampling points.

Figure 9.

Screening sampling points by clustering algorithm: (a) grouping of normal image sampling points and (b) grouping of noise image sampling points.

Accuracy analysis and design of system software

The machined standard groove of 18 mm width was selected as the experimental object. Resolution of each image pixel was calibrated to 0.1 mm after feature extraction. In the welding process, 100 welding image frames were processed continuously without any deviation correction operation for the welding robot and welding gun, and the groove width deviation value was within 1 pixels, that is, the measurement accuracy of deviation of vision module was 0.1 mm.

C++ language was used to extract seam feature information, and QT was used to visualize image acquisition and processing. The system software interface was shown in Figure 10. According to the geometric relationship determined by the calibration system, the vision module performed data operation on the coordinates of weld feature points on the image, and sent the obtained actual weld information data to the control module.

Figure 10.

The program interface of system.

Optimization of all-position welding parameters and Experimental results analysis

Factors behind weld formation

For all-position welding of the pipeline, the welding torch performs a full circle welding along the pipeline, so the welding torch posture changes from 0° to 360° as the welding position changes. Since the sinking of the molten pool is under the combined action of gravity and the supporting force of the pipe wall, the degree of sinking of the molten pool changes with the change of the welding area. Experiments show that the molten pool forming in the same area for different pipes has regularity, and the molten pool forming in a fixed range area is consistent. Therefore, a strategy of summarizing the process parameters of each area by subdividing the welding area, and then using a nonlinear regression method to fit the pipeline all-position welding parameter equation. During all-position welding, the welding speed, the width of the welding layer to be welded and the angle of the welding gun have regular influence on the weld formation.²⁴ Besides, gravity makes the force of the molten pool unbalanced in different spatial positions, leading to instability of weld formation. All-position welding positions of pipeline were shown in Figure 11.

Figure 11.

Schematic diagram of welding position.

Among which non-horizontal welding positions, such as vertical down welding, overhead welding, and vertical up welding, were subject to poor weld formation, incomplete fusion between welding layers and high bulge in the center of weld, as shown in Figure 12(a) and (b),respectively.

Figure 12.

Defect weld image: (a) incomplete fusion and (b) high bulge of weld.

In all-position welding process, parameters that affected weld formation vary from welding current, welding voltage, to crawling speed of welding robot, all of which directly affected the stability of welding process, and the appearance of weld. How to configure the parameters reasonably was a problem to be solved.

Nonlinear regression mathematical model

Welding parameters were directly linked to the width and thickness of the welding layer to be welded and the angle of the welding gun. Traditional univariate experiments fail to test the interaction between different parameters, and suffered low efficiency and were a huge workload. Regression modeling could describe the influence intensity of multiple independent variables on a dependent variable, while polynomial regression could fit the data of nonlinear relationships and deal with the complex relationships between dependent variables and independent variables more flexibly. In this paper, a mathematical model was established by means of experimental design to reduce the trial cost, increase test efficiency, and obtain scientific and reasonable test results.

Based on the fact that weld pool characteristics were enslaved to welding parameters in a regular way, the reference values of welding parameters were obtained through pre-experiments. The results showed that welding current I, welding voltage U, and crawling speed V of welding robot had great influence on the shape of molten pool and weld formation, and the three parameters were associated with welding layer width d, welding layer height h, and crawling angle α of welding robot.

Welding current I, welding voltage U, and crawling speed V of welding robot were taken as response values, while welding layer width d, welding layer height h, and crawling angle α of welding robot were considered as input variables.

Subsequently, a nonlinear regression equation was established with the response values and input variables to fit the function between them. If the response values were denoted as y_j and the input variables were x_i, the functional relationship can be expressed as y_j = f(x₁, x₂, ……, x_i), where y_j was a multivariate quadratic function, the nonlinear regression equation could be expressed as formula (4), and the value set of j was{1, 2, 3}.

y_{j} = b_{0} + \sum_{i = 1}^{3} b_{i} x_{i} + \sum_{i = 1}^{3} c_{i} x_{i}^{2}

(4)

After a large number of welding data were obtained through experiments, the regression coefficients in the second-order nonlinear regression equation were clarified by the least square method with the relationship between response values and input variables, as shown in Tables 1 to 3.

Table 1.

Coefficients of second-order nonlinear regression equation of welding current I.

Processing parameter	Floor	$b_{0}$	$b_{1}$	$b_{2}$	$b_{3}$	$c_{1}$	$c_{2}$	$c_{3}$
Welding current I	1	19.6675	1	3.3398	−0.0515	1	1.2924	0.0001766
	2	−710.7009	2.7347	136.9588	−0.1006	−2.0588	−5.4256	0.0003
	3	−959.8264	132.0541	100.0598	−0.0809	−13.5862	−3.2021	0.00025527
	4	331.3391	238.8611	−115.3726	−0.0874	−16.5988	3.1383	0.00031316

Table 2.

Coefficient of second-order nonlinear regression equation of welding voltage U.

Processing parameter	Floor	$b_{0}$	$b_{1}$	$b_{2}$	$b_{3}$	$c_{1}$	$c_{2}$	$c_{3}$
Welding voltage U	1	−17.7289	1	−1.3348	−0.0051	1	0.7080	0.00001766
	2	−67.0701	0.2735	13.6959	−0.0101	−0.2059	−0.5425	0.00003050
	3	−91.9826	13.2054	10.0060	−0.0081	−1.3586	−0.3202	0.00002553
	4	38.1339	23.8861	−11.5373	−0.0087	−1.6599	0.3138	0.00003132

Table 3.

Coefficients of second-order nonlinear regression equation of crawling speed V.

Processing parameter	Floor	$b_{0}$	$b_{1}$	$b_{2}$	$b_{3}$	$c_{1}$	$c_{2}$	$c_{3}$
Crawling speed	1	−18.7203	1	−1.4587	−0.0173	1	0.6925	0.00005616
	2	210.5132	11.3846	−32.9665	0.02	−1.6977	1.2292	−0.00004337
	3	−314.2515	30.2421	33.4947	−0.0149	−3.1354	−1.1108	0.00003879
	4	−34.0067	48.9579	−14.6780	−0.0132	−3.4257	0.4052	0.00004780

The second-order nonlinear regression equation of important welding parameters behind weld formation, such as welding current I, welding voltage U, and crawling speed V of welding robot, reflected the mathematical relationship between welding parameters, characteristics of welding seam characteristics, and the angle of welding gun. The results indicated that the first-order and quadratic terms of crawling angles α of welding robot had extremely significant influence on welding parameters.

Experimental results and analysis

The experimental device of all-position welding control system based on machine vision and nonlinear regression was shown in Figure 13. In order to verify the accuracy and stability of the welding control of the all-position welding control system, the welding seams to be welded were machined by lathe, with high straightness and consistent seam width values, which could eliminate the interference caused by the irregularity of initial welding seams and help to improve the accuracy of data analysis. The base metal and related parameters were displayed in Table 4. For the vision module, a 660 ± 10 nm narrow bandpass filter was installed in front of the industrial camera lens to reduce arc noise and better the quality of image acquisition. The hardware carrier of the control module was C6015 from Beckhoff, an embedded IPC characterized by small physical volume, high integration, and microsecond operation speed, which provides a foundation for large-scale data processing and information interaction between the vision module and the control module.

Figure 13.

Experimental device of all-position welding robot.

Table 4.

Welding parent metal and related parameters.

Steel class	Diameter	Thickness	Welding material	Mode	Groove category	Groove width	Protective gas
20# carbon steel	400 mm	12 mm	1.2 mm solid core welding wire	GMAW	V	18 mm	18% $C O_{2}$ + 82%Ar

Panasonic YD-350GS digital welding machine with low spatter was used as welding power source, and the initial welding process parameters were shown in Table 5.

Table 5.

Initial welding process parameters.

Welding current	Welding voltage	Crawling speed	Swing width	Swing speed	Margin delay
140 A	18 V	2.3 mm/s	8 mm	28 mm/s	300 ms

In all-position welding process, wireless remote control was employed to control the system. When the system was in operation, the vision module periodically collects and processes images, obtains welding layer width and height data, and sends them to the control module. The pose detection sensor was built in the all-position welding robot to obtain the current angle data of the welding gun in real time. With these data, the welding parameters are calculated by the control module through internal algorithm, and sent to the execution module. The all-position welding robot and digital welding machine receive and execute the instructions sent by the control module, thus realizing all-position welding of pipes with automatic matching of welding parameters in the welding process.

During the entire control process, extraction of welding layer information was critical. Its precision determines the welding seam’s final forming effect. Traditional template matching algorithm utilizes mature technology, and the method based on feature matching had strong adaptability to circumstances with strong noise interference and large gray scale change. In order to analyze the stability of seam feature point extraction, template matching algorithm and clustering algorithm were used to extract the feature points at both ends of the groove of the same image with large interference noise. Figure 14(a) and (b) showed the extraction results of the template matching algorithm for ordinary pictures and noisy pictures, while Figure 14(c) and (d) showed the clustering algorithm for the extraction of the above two pictures result. As shown in Figure 14(a) to (d), under strong arc interference, when the image feature extraction method based on template matching was in error, the clustering algorithm could still achieve the accuracy of feature value coordinate extraction. The results showed that the feature extraction accuracy of template matching was only about 70%, while the feature extraction accuracy of clustering algorithm used in this paper was 90%.

Figure 14.

Feature extraction results of noisy images: (a) template matching extraction of No.1 image, (b) template matching extraction of No.2 image, (c) clustering algorithm extraction of No.1 image, and (d) clustering algorithm extraction of No.2 image.

On the premise of ensuring that all other factors such as welding materials, pipe groove, and welding process parameters are consistent, cluster, and template matching algorithms were used to extract the height and width of welding layers, and complete all-position pipe welding. The error curves of welding layer width and height were shown in Figures 15 and 16. The results showed that the accuracy of feature point extraction using the template matching method was low. The maximum errors of width and height of single seam were 0.4 and 0.36 mm, and the root mean square errors were 0.24 and 0.21 mm, respectively. The accuracy of feature points extracted by the clustering algorithm in this paper was high. The maximum errors of width and height of single seam were 0.3 and 0.25 mm, and the root mean square errors were 0.17 and 0.15 mm, respectively.

Figure 15.

Comparison of welding layer width error.

Figure 16.

Comparison of welding layer height error.

Compared with the template matching algorithm, the clustering algorithm adopted in this paper improved the accuracy of the entire welding system. This was because feature extraction based on template matching was significantly influenced by a single template picture, and when arc interference information greatly influenced template features, the accuracy and stability of weld feature coordinate extraction could not be guaranteed. As shown in Figure 17(a) and (b), the final welding effect showed that the method of extracting feature point coordinates by template matching had low stability and production of welding defects of incomplete fusion could be commonplace.

Figure 17.

Comparison of single-layer welding effect: (a) appearance of template matching algorithm and (b) appearance of clustering algorithm.

In order to quantitatively verify the accuracy and stability of the all-position welding control system based on machine vision and nonlinear regression, the weld preparation of the same pipeline was welded in three ways: keeping welding parameters unchanged, manually adjusting welding parameters, and automatically matching welding parameters by using the all-position control system. As shown in Figure 10, the pipeline was divided into 16 areas according to varied welding positions. Figure 18(a) and (b) showed the width and thickness of the formed weld, respectively. The all-position welding control system designed in this paper benefitted from a stable molten pool and good weld formation. In addition, the maximum accumulative thickness deviation of four layers was 0.5 mm, and the width deviation was 0.3 mm. The actual welding effect was shown in Figure 19(a) and (b), which respectively represent the surface morphology and section morphology of the weld.

Figure 18.

Comparison of weld formation by region: (a) comparison of weld layer width and (b) comparison of weld layer height.

Figure 19.

Weld forming: (a) appearance of weld forming and (b) weld section view.

Conclusions

This paper designed a welding process control method based on machine vision and nonlinear regression technology to improve welding quality of all-position pipeline welding. A visual sensor was designed to collect weld information, and the stability and accuracy of feature information extraction were improved through an optimized clustering algorithm. Experiments showed that the all-position welding system designed using the method outlined in this paper provided stable weld pool shape and a positive weld appearance during welding. Furthermore, the root mean square errors of width and height of single-layer welds were 0.17 and 0.15 mm, respectively. The stability and precision of the system met the requirements of the pipeline all-position welding process.

Footnotes

Handling Editor: Chenhui Liang

Author contributions

Yu Tang: Conceptualization, Methodology, Software, Data curation, Writing – original draft, Investigation, Experiment. Zhongren Wang: Overall scheme design, Funding acquisition, Validation. Liying Jin: Methodology, Software, Data curation, Investigation, Experiment. Xilin Ke: Data curation, Investigation, Experiment. Haisheng Liu: Supervision, Investigation, Formal analysis, Experiment.

Declaration of conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by Key Science and Technology Plan Project of Xiangyang City in 2020 (Grant No. 2020ABH002033) and Hubei Superior and Distinctive Discipline Group of “Mechatronics and Automobiles” (Grant No. XKQ2020007).

ORCID iDs

Yu Tang

Liying Jin

References

Pan

. On visual knowledge. Front Inf Technol Electron Eng 2019; 20: 1021–1025.

Tian

Chen

Xiong

, et al. Towards human-like and transhuman perception in AI 2.0: a review. Front Inf Technol Electron Eng 2017; 18: 58–67.

Muhammad

Altun

Abo-Serie

. Welding seam profiling techniques based on active vision sensing for intelligent robotic welding. Int J Adv Manuf Technol 2017; 88: 127–145.

, et al. Automated control of welding penetration based on audio sensing technology. J Mater Process Technol 2017; 250: 81–98.

Xue

Chang

Peng

, et al. A vision based detection method for narrow butt joints and a robotic seam tracking system. Sensors 2019; 19: 1144.

Wang

Sun

, et al. Intelligent welding system technologies: state-of-the-art review and perspectives. J Manuf Syst 2020; 56: 373–391.

Yue

Jiang

, et al. All position MAG welding formation control technology and research review. China Mech Eng 2012; 23: 1256–1259.

. Research on droplet transfer and weld formation of swing arc narrow gap MAG welding for various positions in space. Harbin: Harbin Institute of Technology, 2015.

Lin

Fan

, et al. Prediction and optimization of weld bead geometry in oscillating arc narrow gap all-position GMA welding. Int J Adv Manuf Technol 2015; 79: 183–196.

10.

Lin

Fan

, et al. Statistical modelling of weld bead geometry in oscillating arc narrow gap all-position GMA welding. Int J Adv Manuf Technol 2014; 72: 1705–1716.

11.

Guo

Zhu

Sun

, et al. A novel field box girder welding robot and realization of all-position welding process based on visual servoing. J Manuf Process 2021; 63: 70–79.

12.

Jin

Zhang

, et al. Automatic tube-sheet welding vision sensor image processing. Trans China Weld Inst 2017; 38: 117–120+134.

13.

Yang

Wang

, et al. An embedded vision tracking control system for autonomous mobile welding robot. Comput Integr Manuf Syst 2020; 26: 3049–3056.

14.

Shao

Huang

Zhang

. A novel weld seam detection method for space weld seam of narrow butt joint in laser welding. Opt Laser Technol 2018; 99: 39–51.

15.

Wang

Shi

Yan

, et al. Intelligent welding robot path optimization based on discrete elite PSO. Soft Comput 2017; 21: 5869–5881.

16.

Hong

Gao

, et al. Welding seam trajectory recognition for automated skip welding guidance of a spatially intermittent welding seam based on laser vision sensor. Sensors 2020; 20: 19.

17.

Pan

, et al. Dynamic modeling of weld bead geometry features in thick plate GMAW based on machine vision and learning. Sensors 2020; 20: 18.

18.

Aviles-Viñas

Rios-Cabrera

Lopez-Juarez

. On-line learning of welding bead geometry in industrial robots. Int J Adv Manuf Technol 2016; 83: 217–231.

19.

Gan

Luo

Wang

. Research on positioning method of laser vision tracking for pipeline welding. Laser Infrared 2018; 48: 675–681.

20.

Wang

Gao

Wang

. Survey on the laser triangulation. Chin J Sci Instrum 2004; S2: 601–604+608.

21.

Zhao

. Overlapping green apple recognition based on improved spectral clustering. Spectrosc Spect Anal 2019; 39: 2974–2981.

22.

Zhang

Sun

Liu

, et al. Improved clustering algorithms for image segmentation based on non-local information and back projection. Inf Sci 2021; 550: 129–144.

23.

Liberti

Lavor

Maculan

, et al. Euclidean distance geometry and applications. SIAM Rev 2014; 56: 3–69.

24.

. Research on rotating arc narrow gap welding technology of multi-position in space. Harbin: Harbin Institute of Technology, 2012.

All-position welding control system based on machine vision and nonlinear regression

Abstract

Keywords

The inspiration of my work

Introduction

Related works

Extraction of weld feature information

Weld seam image processing

Obtain weld feature information by clustering algorithm

Accuracy analysis and design of system software

Optimization of all-position welding parameters and Experimental results analysis

Factors behind weld formation

Nonlinear regression mathematical model

Experimental results and analysis

Conclusions

Footnotes

Author contributions

Declaration of conflicting interests

Funding

ORCID iDs

References