To tackle the problems related to the complexities of obtaining depth information for circular workpiece with arc surface and holes, a novel vision guidance method has been introduced to precisely gauge interlayer spacing. The process includes the acquisition and preprocessing of point cloud depth information, along with matching and edge processing. The depth coordinates of the point cloud are subsequently determined. Two-dimensional image processing technology is employed to extract the coordinates of the center of the surface circular hole in the curved porous circular workpiece. The 3D coordinates are generated for guiding the assembly by integrating these datasets. Experiments on grid parts in aviation propulsion systems demonstrate that this method maintains dot matrix spacing within 0.5–1.2 mm, ensures the coaxiality of the center hole, and meets assembly standards. The results confirm the method’s effectiveness for automated assembly of curved porous round workpieces.
XuJHouZMWangW, et al. Feedback deep deterministic policy gradient with fuzzy reward for robotic multiple peg-in-hole assembly tasks. IEEE Trans Industr Inform2019; 15(3): 1658–1667.
2.
MasoodTEggerJ.Augmented reality in support of industry 4.0-Implementation challenges and success factors. Robot Comput Integr Manuf2019; 58: 181–195.
3.
YangHLiGHeJ, et al. Improved FMEA based on IVF and fuzzy VIKOR method: a case study of workpiece box system of CNC gear milling machine. Qual Reliab Eng Int2021; 37(6): 2478–2498.
4.
ChenTTsaiHR.Ubiquitous manufacturing: current practices, challenges, and opportunities. Robot Comput Integr Manuf2017; 45: 126–132.
5.
XuLWangCBiZM, et al. Object-oriented templates for automated assembly planning of complex products. IEEE Trans Autom Sci Eng2014; 11(2): 492–503.
6.
LiuCYWuJJiangXL, et al. Automatic assembly of prefabricated components based on vision-guided robot. Autom Constr2024; 162: 105385.
7.
ZhuCYuTChangQ.Task-oriented safety field for robot control in human-robot collaborative assembly based on residual learning. Expert Syst Appl2024; 238: 121946.
8.
ZhangZZWangYZZhangZN, et al. A residual reinforcement learning method for robotic assembly using visual and force information. J Manuf Syst2024; 72: 245–262.
9.
NygaardTFMartinCPTorresenJ, et al. Real-world embodied AI through a morphologically adaptive quadruped robot. Nat Mach Intell2021; 3(5): 410–419.
10.
LeeDHNaMWSongJB, et al. Assembly process monitoring algorithm using force data and deformation data. Robot Comput Integr Manuf2019; 56: 149–156.
11.
Navarro-GonzalezJLLopez-JuarezIRios-CabreraR, et al. Online knowledge acquisition and enhancement in robotic assembly tasks. Robot Comput Integr Manuf2015; 33: 78–89.
12.
YanSHXuDTaoX.Hierarchical policy learning with demonstration learning for robotic multiple peg-in-hole assembly tasks. IEEE Trans Industr Inform2023; 19(10): 10254–10264.
13.
WangCBiZMXuLD.IoT and cloud computing in automation of assembly modeling systems. IEEE Trans Industr Inform2014; 10: 1426–1434.
14.
Realyvásquez-VargasAArredondo-SotoKCGarcía-AlcarazJL, et al. Introduction and configuration of a collaborative robot in an assembly task as a means to decrease occupational risks and increase efficiency in a manufacturing company. Robot Comput Integr Manuf2019; 57: 315–328.
15.
JiangJGHuangZYBiZM, et al. State-of-the-art control strategies for robotic PiH assembly. Robot Comput Integr Manuf2020; 65: 101894.
16.
WangSChenGXuH, et al. A robotic peg-in-hole assembly strategy based on variable compliance center. IEEE Access2019; 7: 167534–167546.
17.
XuYSongAGLiHJ.Research on automatic assembly technology based on machine vision and force feedback. Meas Control Technol2019; 38(4): 11–16.
18.
ZhuQDuJShiYM, et al. Neurobehavioral assessment of force feedback simulation in industrial robotic teleoperation. Autom Constr2021; 126: 103674.
19.
ChenXDQianCZhaoMY, et al. Improving ellipse fitting via multi-scale smoothing and key-point searching. Pattern Recognit2024; 151: 110432.
20.
GrelssonBFelsbergMIsakssonF.Highly accurate attitude estimation via horizon detection. J Field Robot2016; 33(7): 967–993.
21.
IllingworthJKittlerJV.A survey of the Hough transform. Comput Vis Graph Image Process1988; 43(2): 280.
22.
OkAOBaseskiE.Circular oil tank detection from panchromatic satellite images: a new automated approach. IEEE Geosci Remote Sens Mag2015; 12(6): 1347–1351.
23.
GuoFZhengWLianG, et al. A point cloud registration method based on multiple-local-feature matching. Optik2023; 295: 171511.
24.
JamshidiJKayaniAIravaniP, et al. Manufacturing and assembly automation by integrated metrology systems for aircraft wing fabrication. Proc IMechE Part B: J Engineering Manufacture2010; 224(1): 25–36.
25.
KonstantinouELasenbyJBrilakisI.Adaptive computer vision-based 2D tracking of workers in complex environments. Autom Constr2019; 103(3): 168–184.
26.
LiuHZhuWKeY.Pose alignment of aircraft structures with distance sensors and CCD cameras. Robot Comput Integr Manuf2017; 48: 30–38.
27.
DengZHuangXLiS, et al. On-line calibration and uncertainties evaluation of spherical joint positions on large aircraft component for zero-clearance posture alignment. Robot Comput Integr Manuf2019; 56: 38–54.
28.
WangZZhangSWWangN, et al. A feature-based assembly information modeling method for complex products’ 3D assembly design. Proc IMechE Part B: J Engineering Manufacture2023; 237(9): 1311–1325.
29.
NebAHitzerJ.Automatic generation of assembly graphs based on 3d models and assembly features. Proc CIRP2020; 88: 70–75.
30.
WangKLiuDXLiuZY, et al. A fast object registration method for augmented reality assembly with simultaneous determination of multiple 2D-3D correspondences. Robot Comput Integr Manuf2020; 63: 101890.
31.
WongCCFengHMLaiYC, et al. Manipulator system designs for drawing random objects through point cloud posture estimation. Proc IMechE Part B: J Engineering Manufacture2022; 236(14): 1867–1884.
32.
JiangMHFuLHWangZ, et al. A new method for specular curved surface defect inspection based on reflected pattern integrity. J Meas Sci Instrum2016; 7(3): 221–228.
33.
RenXYChenGDWangZ, et al. Polishing path planning based on point cloud. Assoc Comput Mach2020; 7: 222–228.
34.
LiGFWeiJFHeJL, et al. Implicit Kalman filtering method for remaining useful life prediction of rolling bearing with adaptive detection of degradation stage transition point. Reliab Eng Syst Saf2023; 235: 109269.
35.
WangMLLiuXTWangYS, et al. Research on assembly tolerance allocation and quality control based on fuzzy reliability. Proc IMechE, Part C: J Mechanical Engineering Science2016; 230(20): 3755–3766.
36.
ZhaoMFCaoLBLiuS, et al. Independent method for selecting radius of FPFH neighborhood in 3D point cloud registration. Laser Optoelectron Prog2021; 58(6): 123–131.
37.
LiXCrippsRJ.Algorithm for finding all k-nearest neighbours in three-dimensional scattered points and its application in reverse engineering. Proc IMechE Part B: J Engineering Manufacture2007; 221(9): 1467–1472.
38.
XuHChenGWangZ, et al. RGB-D-based pose estimation of workpieces with semantic segmentation and point cloud registration. Sensors2019; 19: 1873.
39.
CaoYLiuTYangJ, et al. A novel tolerance analysis method for three-dimensional assembly. Proc IMechE Part B: J Engineering Manufacture2019; 233(7): 1818–1827.
40.
YiYLiuXLiuT, et al. A generic integrated approach of assembly tolerance analysis based on skin model shapes. Proc IMechE Part B: J Engineering Manufacture2021; 235(4): 689–704.
41.
ZhangYJGeLL.A novel geometry error measurement methodology for coaxiality evaluation. Proc IMechE Part B: J Engineering Manufacture2021; 235(4): 627–639.
42.
ZhangYGFangYZhouXF, et al. Sag measurement method of wind-induced vibration for uniced overhead power line via laser rangefinder and angle monitoring. IEEE Trans Instrum Meas2024; 73: 1–16.
43.
WeiFZhengLYWeiJ, et al. A machining accuracy informed adaptive positioning method for finish machining of assembly interfaces of largescale aircraft components. Robot Comput Integr Manuf2021; 67: 102021.
44.
BiZMLiuYFKriderJ, et al. Real-time force monitoring of smart grippers for internet of things (IoT) applications. J Ind Inf Integr2018; 11: 19–28.
45.
LiangZQLiuXTWangYS, et al. Universal grey number theory for the uncertainty presence of wiper structural system. Assem Autom2021; 41(1): 55–70.
46.
FangYWangJGZhuZK, et al. Rapid measurement method for key dimensions of train wheelset based on improved image processing algorithm. Meas Sci Technol2024; 35(8): 086012.
