Autonomous robotic inspection for three-dimensional reconstruction of large space structures

Authors

  • Arturo Ríos Laboratorio de Robótica Espacial, Universidad de Málaga
  • Juan de Dios Alfaro Laboratorio de Robótica Espacial, Universidad de Málaga
  • David Rodríguez Martínez Laboratorio de Robótica Espacial, Universidad de Málaga https://orcid.org/0000-0003-4817-9225
  • Carlos Pérez del Pulgar Laboratorio de Robótica Espacial, Universidad de Málaga

DOI:

https://doi.org/10.17979/ja-cea.2026.47.13806

Keywords:

Aerial and space robotics, Robotic perception and sensing, Autonomous navigation, Task and motion planning, Robotic learning and adaptation

Abstract

The development of large space structures, such as orbital data centers or space stations, increases the need for autonomous inspection, maintenance, and repair systems. Currently, many of these tasks rely on standardized interfaces, visual markers, or predefined sequences, solutions that lose scalability when dealing with large, diverse structures or structures not specifically designed for autonomous inspection. This work proposes a markerless autonomous inspection system based on the planning of enveloping trajectories around the structure under analysis. During these trajectories, synchronized multimodal RGB-T-D data are acquired, combining visual, thermal, and depth information. In addition, different 3D reconstruction techniques are evaluated in order to select the most suitable method for integration into the proposed test bench. The acquired data are used to generate a three-dimensional geometric reconstruction of the scene, intended to support the subsequent diagnosis of mechanical and thermal faults. The results obtained show the feasibility of the proposed approach for autonomous robotic inspection in space environments.

References

Castilla-Arquillo, R., Mandow, A., Pérez-del Pulgar, C. J., Álvarez Llamas, C., Vadillo, J. M., Laserna, J., 2024. Thermal imagery for rover soil assessment using a multipurpose environmental chamber under simulated mars conditions. IEEE Transactions on Instrumentation and Measurement 73, 1–12. DOI: 10.1109/TIM.2023.3346528

Coleman, D., S¸ ucan, I. A., Chitta, S., Correll, N., may 2014. Reducing the barrier to entry of complex robotic software: a moveit! case study. Journal of Software Engineering for Robotics 5(1), 3–16. DOI: 10.6092/JOSER 2014 05 01

Deremetz, M., Debroise, M., Boitte, R., De Stefano, M., Mishra, H., Brunner, B., 2023. Mirror-a modular and relocatable multi-arm robot demonstrator for on-orbit large telescope assembly. In: 17th Symposium on AASTRA At.

Esposito, M., Xin, R., Bihlmaier, A., G. Viedma, E., 2017. easy handeye: A ROS package for intuitive hand-eye calibration. Repositorio de GitHub. Consultado el 25 de febrero de 2026. URL: https://github.com/IFL-CAMP/easy_handeye

Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F. J., Marín-Jiménez, M. J., 2014. Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition 47 (6), 2280–2292. DOI: 10.1016/j.patcog.2014.01.005

Gu, X., Fan, Z., Zhu, S., Dai, Z., Tan, F., Tan, P., 2020. Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp. 2492–2501. DOI: 10.1109/CVPR42600.2020.00257

Kerbl, B., Kopanas, G., Leimk¨uhler, T., Drettakis, G., et al., 2023. 3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph. 42 (4), 139–1.

Kinova Robotics, 2025. Gen2 robots.

Leroy, V., Cabon, Y., Revaud, J., 2024. Grounding image matching in 3d with mast3r. In: European conference on computer vision. Springer, pp. 71–91.

Letier, P., Yang, X., Deremetz, M., et al., 2019. Mosar: Modular spacecraft assembly and reconfiguration demonstrator, astra. In: 15th Symposium on Advanced Space Technologies in Robotics and Automation, Noordwijk, Netherlands.

Martínez-Petersen, A., Gerdes, L., Rodríguez-Martínez, D., Pérez-del Pulgar, C. J., 2026. High-fidelity 3d reconstruction for planetary exploration. In: IEEE Conference on Artificial Intelligence (CAI), Special Session on AI for Space Exploration”. IEEE, Granada, Spain. DOI: 10.48550/arXiv.2602.13909

Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., Ng, R., 2021. Nerf: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM 65 (1), 99–106.

Park, F., Martin, B., 1994. Robot sensor calibration: solving ax=xb on the euclidean group. IEEE Transactions on Robotics and Automation 10 (5), 717–721. DOI: 10.1109/70.326576

Paz-Delgado, G. J., Pérez-del Pulgar, C. J., Azkarate, M., Kirchner, F., García- Cerezo, A., 2023. Multi-stage warm started optimal motion planning for over-actuated mobile platforms. Intelligent Service Robotics 16, 247–263. DOI: 10.1007/s11370-023-00461-x

Roa, M. A., Beyer, A., Rodr´ıguez, I., Stelzer, M., de Stefano, M., Lutze, J.-P., Mishra, H., Elhardt, F., Grunwald, G., Dubanchet, V., et al., 2024. Eross: In-orbit demonstration of european robotic orbital support services. In: 2024 IEEE Aerospace Conference. IEEE, pp. 1–9.

Roa Garzon, M. A., Koch, C., Rognant, M., Ummel, A., Letier, P., Turetta, A., Lopez, P., Trinh, S., Rodriguez Brena, I. V., Nottensteiner, K., et al., 2022. Pulsar: Testing the technologies for on-orbit assembly of a large telescope. In: 16th Symposium on Advanced Space Technologies in Robotics and Automation (ASTRA). ESA.

Schönberger, J. L., Frahm, J.-M., 2016. Structure-from-motion revisited. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 4104–4113. DOI: 10.1109/CVPR.2016.445

Tancik, M.,Weber, E., Ng, E., Li, R., Yi, B., Wang, T., Kristoffersen, A., Austin, J., Salahi, K., Ahuja, A., et al., 2023. Nerfstudio: A modular framework for neural radiance field development. In: ACM SIGGRAPH 2023 conference proceedings. pp. 1–12. DOI: 10.1145/3588432.3591516

Tsai, R., Lenz, R., 1989. A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Transactions on Robotics and Automation 5 (3), 345–358. DOI: 10.1109/70.34770

Wang, P., Liu, L., Liu, Y., Theobalt, C., Komura, T., Wang, W., 2021. Neus: learning neural implicit surfaces by volume rendering for multi-view reconstruction. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. Curran Associates Inc. DOI: 10.5555/3540261.3542342

Zhang, Z., 2000. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (11), 1330–1334. DOI: 10.1109/34.888718

Zhou, Q.-Y., Park, J., Koltun, V., 2018. Open3D: A modern library for 3D data processing. arXiv:1801.09847.

Downloads

Published

2026-09-01

Issue

Section

Robótica