When facing large-size targets, for the problem that the target imaging field of monocular camera is small and the target imaging is not clear at a long distance, this paper proposes an uncalibrated visual servoing method using multiple cameras for large targets. On the basis of image-based visual servo control, an uncalibrated visual servo model of an arrayed multiple cameras is constructed, and the nonlinear mapping relationship between image features of multi-view fusion and robot end six-degree-of-freedom motion velocity is constructed by using image moments. Visual servoing operation for large-size targets by predicting robot end-motion velocity using a neural network based on genetic particle swarm optimization without calibrating the camera parameters and hand-eye relationship. The experimental results show that the proposed method can effectively realize multi-view fusion visual servoing operation for large-size targets with high operation accuracy and robustness.
ZhangYWangNWangH, et al. Curve control points-based feature extraction for visual servo with rotational pose compensation. In: Chinese control and decision conference, Hefei, China, 22–24 August 2020, pp.450–454. IEEE.
2.
ZhongXGZhongXYHuHS, et al. A nonparametric-learning visual servoing framework for robot manipulator in unstructured environments. Neurocomputing2021; 437(1): 206–217.
3.
YeTYChengMChenYL, et al. Reinforcement learning-based IBVS structure for control of point-to-point motion of robot manipulators. J Mar Sci Technol2020; 28(5): 367–375.
4.
LiPShuTXieWF, et al. Dynamic visual servoing of a 6-RSS parallel robot based on optical CMM. J Intell Robot Syst2021; 102(2): 1–17.
5.
ReyesRMurrieta-CidR.An approach integrating planning and image-based visual servo control for road following and moving obstacles avoidance. Int J Control2020; 93(10): 2442–2456.
6.
ZhaoWLiuHWangX.Robust visual servoing control for quadrotors landing on a moving target. J Franklin Inst2021; 358(4): 2301–2319.
7.
ShiHShiLSunG, et al. Adaptive image-based visual servoing for hovering control of quad-rotor. IEEE Trans Cogn Dev Syst2020; 12(3): 417–426.
8.
WangZZhouDGongS.Uncalibrated visual positioning using adaptive Kalman Filter with dual rate structure for wafer chip in LED packaging. Measurement2022; 191: 110829.
9.
ZhouZZhangRZhuZ.Robust Kalman filtering with long short-term memory for image-based visual servo control. Multimed Tools Appl2019; 78(18): 26341–26371.
10.
GongZTaoBQiuC, et al. Trajectory planning with shortest path for modified uncalibrated visual servoing based on projective homography. IEEE Trans Autom Sci Eng2020; 17(2): 1076–1083.
11.
FengHLuYChenD, et al. Development on a magnetic anchoring robot system based on visual servo control for laparoendoscopic single-site surgery. Int J Med Robot Comput Assist Surg2018; 14(4): e1904.
12.
LiTYuTPQiuQ, et al. Hybrid uncalibrated visual servoing control of harvesting robots with RGB-D cameras. IEEE Trans Ind Electron2023; 70(3): 2729–2738.
13.
GongZYTaoBYangH, et al. An uncalibrated visual servo method based on projective homography. IEEE Trans Autom Sci Eng2018; 15(2): 806–817.
14.
CongVDHanhLD.A new decoupled control law for image-based visual servoing control of robot manipulators. Int J Intell Robot Appl2022; 6: 576–585.
15.
GuJZhuMCaoL, et al. Improved uncalibrated visual servo strategy for hyper-redundant manipulators in on-orbit automatic assembly. Appl Sci2020; 10(19): 6968–6983.
16.
PanWLyuMHwangKS, et al. A neuro-fuzzy visual servoing controller for an articulated manipulator. IEEE Access2018; 6: 3346–3357.
17.
ShiHHwangKLiX, et al. A learning approach to image-based visual servoing with a bagging method of velocity calculations. Inform Sci2019; 481: 244–257.
18.
CrombezNMouaddibEMCaronG, et al. Visual servoing with photometric Gaussian mixtures as dense features. IEEE Trans Robot2019; 35(1): 49–63.
19.
ZhouKHuangXLiSG, et al. Improving pose estimation accuracy for large hole shaft structure assembly based on super-resolution. Rev Sci Instrum2023; 94(6): 065014.
20.
ChenLMaLZhanW, et al. Research on the method of anti-occlusion of surgical instrument tracking based on multi-camera module information fusion. Measurement2025; 239: 115480.
21.
AmosaTISebastianPIzharLI, et al. Multi-camera multi-object tracking: a review of current trends and future advances. Neurocomputing2023; 552: 126558.
22.
ZhuTMaoJHanL, et al. Fuzzy adaptive model predictive control for image-based visual servoing of robot manipulators with kinematic constraints. Int J Control Autom Syst2024; 22(1): 311–322.
23.
AhnKHNaMSongJB.Robotic assembly strategy via reinforcement learning based on force and visual information. Rob Auton Syst2023; 164: 104399.
24.
LiZ CZhouY FZhuM C, et al. Image moment-based visual positioning and robust tracking control of ultra-redundant manipulator. J Intell Robot Syst2024; 110(2): 83.
25.
LinWYLiuCLGuoH, et al. Hybrid visual-ranging servoing for positioning based on image and measurement features. IEEE Trans Cybern2023; 53(7): 4270–4279.
26.
SahuUKPatraDSubudhiB.Adaptive intelligent vision-based control of a flexible-link manipulator. Electr Eng2023; 105(5): 3263–3281.
27.
DuflotLAReisenhoferRTamadazteB, et al. Wavelet and shearlet-based image representations for visual servoing. Int J Robot Res2019; 38(4): 422–450.
28.
ZhouKHuangXLiS G, et al. Convolutional neural network-based pose mapping estimation as an alternative to traditional hand-eye calibration. Rev Sci Instrum2023; 94(6): 065002.
29.
LiBTianWZhangC, et al. Positioning error compensation of an industrial robot using neural networks and experimental study. Chin J Aeronaut2022; 35(2): 346–360.
30.
ZhaoPHuangXLiS, et al. A convolutional neural network based method for fork type wing fuselage docking. Proc Inst Mech Eng Part B: J Eng Manuf. Epub ahead of print 28 October 2024. DOI: 10.1177/09544054241289636.
31.
DuanJFangYZhangQ, et al. HRC for dual-robot intelligent assembly system based on multimodal perception. Proc Inst Mech Eng Part B: J Eng Manuf2024; 238(4): 562–576.
32.
CheungWHYangQ.Fabric defect detection using AI and machine learning for lean and automated manufacturing of acoustic panels. Proc Inst Mech Eng Part B: J Eng Manuf2024; 238(12): 1827–1836.
