Hybrid servo-visual control for the positioning of a Robotic Manipulator

Authors

  • Edison Patricio Velasco Sanchez Universidad de Alicante
  • Juan Pablo Neme Universidad de Alicante
  • Pablo Gil Universidad de Alicante

DOI:

https://doi.org/10.17979/ja-cea.2026.47.13752

Keywords:

Autonomous robotic systems , Navigation, guidance and control , Robots manipulators, Motion control, Robotics technology

Abstract

This paper presents a hybrid servo-visual control architecture for positioning a robotic manipulator. The proposed approach combines a position-based controller (PBVS) and an image-based controller (IBVS) ollowed by a final stage of a contact-based approach. The PBVS controller enables an initial movement toward the target pose using geometric information from the camera-robot system. Subsequently, the IBVS controller refines the positioning by minimizing the visual error in the image plane to improve local accuracy despite calibration uncertainties or small pose deviations. Finally, the robot performs a controlled movement toward the desired point until it detects contact with the environment via a force condition. The architecture is experimentally validated using three scenarios: PBVS control, IBVS control, and hybrid PBVS–IBVS control with contact-based approach. The results enable analysis of visual convergence and positioning accuracy, as well as the system’s ability to perform contact tasks in a structured manner.

References

Bateux, Q., Marchand, E., Leitner, J., Chaumette, F., Corke, P., 2018. Training deep neural networks for visual servoing. In: IEEE Int. Conf. on Robotics and Automation (ICRA). pp. 3307–3314. DOI: 10.1109/ICRA.2018.8461068

Chaumette, F., 2004. Image moments: a general and useful set of features for visual servoing. IEEE Trans. on Robotics 20 (4), 713–723. DOI: 10.1109/TRO.2004.829463

Chaumette, F., Hutchinson, S., 2006. Visual servo control. i. basic approaches. IEEE Robotics & Automation Magazine 13 (4), 82–90. DOI: 10.1109/MRA.2006.250573

Collewet, C., Marchand, E., 2011. Photometric visual servoing. IEEE Trans. on Robotics 27 (4), 828–834. DOI: 10.1109/TRO.2011.2112593

Espiau, B., Chaumette, F., Rives, P., 1992. A new approach to visual servoing in robotics. IEEE Trans. on Robotics and Automation 8 (3), 313–326. DOI: 10.1109/70.143350

Free Software Foundation Inc., 2021. easy handeye2: automated, hardwareindependent hand-eye calibration for ros2. URL: https://github.com/marcoesposito1988/easy_handeye2/

Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F. J., Medina- Carnicer, R., 2014. Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition 47 (6), 2280–2292.

Kermorgant, O., Chaumette, F., 2011. Combining ibvs and pbvs to ensure the visibility constraint. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems. pp. 2849–2854. DOI: 10.1109/IROS.2011.6094589

Khamis, H., Xia, B., Redmond, S., 2019. A novel optical 3d force and displacement sensor–towards instrumenting the papillarray tactile sensor. Sensors and Actuators A: Physical 291, 174–187. DOI: 10.1016/j.sna.2019.03.051

PAL Robotics S.L., 2020. Aruco ros. URL: https://github.com/pal-robotics/aruco_ros

Sturm, P., 2021. Pinhole camera model. In: Ikeuchi, K. (Ed.), Computer Vision. A Reference Guide. Springer Cham, pp. 983–986. DOI: 10.1007/978-3-030-63416-2

Tahri, O., Chaumette, F., 2005. Point-based and region-based image moments for visual servoing of planar objects. IEEE Trans. on Robotics 21 (6), 1116–1127. DOI: 10.1109/TRO.2005.853500

Tirado-Garín, J., Civera, J., 2025. Anycalib: On-manifold learning for modelagnostic single-view camera calibration. In: IEEE/CVF Int. Conf. on Computer Vision (ICCV). pp. 8044–8055. DOI: 10.1109/ICCV51701.2025.00754

Tsai, R., Lenz, R., 1989. A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Trans. on Robotics and Automation 5 (3), 345–358. DOI: 10.1109/70.34770

Velasco-Sanchez, E., Castano-Amoros, J., Gil, P., Torres, F., 2025. Touch- ˜ based effector control to track 3d surfaces. In: IEEE 30th Int. Conf. on Emerging Technologies and Factory Automation (ETFA). pp. 1–6. DOI: 10.1109/ETFA65518.2025.11205606

Downloads

Published

2026-09-01

Issue

Section

Robótica