Pose Estimation Based on ArUco Markers Using Event Cameras

Authors

  • Javier Luna-Santamaría Universidad de Sevilla
  • Raul Tapia Universidad de Sevilla https://orcid.org/0000-0002-4435-5466
  • José Ramiro Martínez-de Dios Universidad de Sevilla
  • Anibal Ollero Universidad de Sevilla

DOI:

https://doi.org/10.17979/ja-cea.2026.47.13871

Keywords:

Event camera, Pose estimation, Computer vision, Fiducial markers, Visual localization

Abstract

Pose estimation is a fundamental technique in robotics and computer vision. However, systems based on conventional cameras suffer from limitations under fast motion, motion blur, and challenging lighting conditions. Event cameras have emerged as an alternative, capturing intensity changes asynchronously with high temporal resolution and a wide dynamic range, making them particularly suitable for dynamic scenes. This work presents a pose estimation method based on ArUco markers using only events. The method employs a marker detector specifically designed for event-based sensors, enabling marker identification without the need for image reconstruction. From the detected markers, the camera pose is estimated using a PnP approach based on 2D-3D correspondences. Experimental results on board a multirotor aerial robot flying indoors and outdoors show that the system is capable of providing accurate pose estimates at over 100 Hz on CPU.

References

Campos, Carlos, Richard Elvira, Juan J. Gómez Rodríguez, José M. M. Montiel, and Juan D. Tardós. “ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM.” IEEE Transactions on Robotics 37, no. 6 (2021): 1874–90. https://doi.org/10.1109/TRO.2021.3075644.

Douglas, David H., and Thomas K. Peucker. “Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or Its Caricature.” Cartographica 10, no. 2 (1973): 112–22. https://doi.org/10.3138/FM57-6770-U75U-7727.

Garrido-Jurado, S., R. Muñoz-Salinas, F. J. Madrid-Cuevas, and M. J. Marín-Jiménez. “Automatic Generation and Detection of Highly Reliable Fiducial Markers under Occlusion.” Pattern Recognition 47, no. 6 (2014): 2280–92. https://doi.org/10.1016/j.patcog.2014.01.005.

Garrido-Jurado, S., R. Muñoz-Salinas, F. J. Madrid-Cuevas, and R. Medina-Carnicer. “Generation of Fiducial Marker Dictionaries Using Mixed Integer Linear Programming.” Pattern Recognition 51 (March 2016): 481–91. https://doi.org/10.1016/j.patcog.2015.09.023.

Garrido-Jurado, Sergio, Francisco J. Romero-Ramirez, and Rafael Muñoz-Salinas. “ArUco Nano: A Simpler, Faster, and More Reliable Fiducial Marker Detector.” SoftwareX 34 (June 2026): 102690. https://doi.org/10.1016/j.softx.2026.102690.

Huang, Yuxuan, Taogang Hou, Shijie Zhang, Xuan Pei, Ruiqing Yu, and Hongjie Liu. “A Novel ArUco Marker for Event Cameras.” International Conference on Frontiers of Robotics and Software Engineering, June 2023, 271–77. https://doi.org/10.1109/FRSE58934.2023.00044.

Jurado-Rodriguez, David, Rafael Muñoz-Salinas, Sergio Garrido-Jurado, and Rafael Medina-Carnicer. “Planar Fiducial Markers: A Comparative Study.” Virtual Reality 27, no. 3 (2023): 1733–49. https://doi.org/10.1007/s10055-023-00772-5.

Kalaitzakis, Michail, Brennan Cain, Sabrina Carroll, Anand Ambrosi, Camden Whitehead, and Nikolaos Vitzilaios. “Fiducial Markers for Pose Estimation: Overview, Applications and Experimental Comparison of the Artag, AprilTag, ArUco and Stag Markers.” Journal of Intelligent & Robotic Systems 101, no. 4 (2021): 71. https://doi.org/10.1007/s10846-020-01307-9.

Kitade, Takuya, Wataru Yamada, Keiichi Ochiai, and Michita Imai. “Bicode: A Hybrid Blinking Marker System for Event Cameras.” IEEE International Conference on Robotics and Automation, May 13, 2024, 2939–45. https://doi.org/10.1109/ICRA57147.2024.10611033.

Loch, Adam, Germain Haessig, and Markus Vincze. “Event-Based High-Speed Low-Latency Fiducial Marker Tracking.” In International Conference on Machine Vision, edited by Jianhong (Jessica) Zhou, Wolfgang Osten, and Dmitry P. Nikolaev. SPIE, 2023. https://doi.org/10.1117/12.2679683.

Mai, Ngoc Trung, Ren Komatsu, Hajime Asama, and Atsushi Yamashita. “Pose Estimation for Event Camera Using Charuco Board Based on Image Reconstruction.” IEEE/SICE International Symposium on System Integration, January 17, 2023, 1–6. https://doi.org/10.1109/SII55687.2023.10039168.

Muñoz-Salinas, Rafael, Manuel J. Marín-Jimenez, and R. Medina-Carnicer. “SPM-SLAM: Simultaneous Localization and Mapping with Squared Planar Markers.” Pattern Recognition 86 (February 2019): 156–71. https://doi.org/10.1016/j.patcog.2018.09.003.

Muñoz-Salinas, Rafael, and R. Medina-Carnicer. “UcoSLAM: Simultaneous Localization and Mapping by Fusion of Keypoints and Squared Planar Markers.” Pattern Recognition 101 (May 2020): 107193. https://doi.org/10.1016/j.patcog.2019.107193.

Romero-Ramirez, Francisco J., Rafael Muñoz-Salinas, and Rafael Medina-Carnicer. “Speeded up Detection of Squared Fiducial Markers.” Image and Vision Computing 76 (August 2018): 38–47. https://doi.org/10.1016/j.imavis.2018.05.004.

Sarmadi, Hamid, Rafael Munoz-Salinas, Miguel A. Olivares-Mendez, and Rafael Medina-Carnicer. “Detection of Binary Square Fiducial Markers Using an Event Camera.” IEEE Access 9 (2021): 27813–26. https://doi.org/10.1109/ACCESS.2021.3058423.

Suzuki, Satoshi, and Keiichi Abe. “Topological Structural Analysis of Digitized Binary Images by Border Following.” Computer Vision, Graphics, and Image Processing 30, no. 1 (1985): 32–46. https://doi.org/10.1016/0734-189X(85)90016-7.

Tapia, Raul, José Ramiro Martínez-de Dios, and Anibal Ollero. “eFFT: An Event-Based Method for the Efficient Computation of Exact Fourier Transforms.” IEEE Transactions on Pattern Analysis and Machine Intelligence 46, no. 12 (2024): 9630–47. https://doi.org/10.1109/TPAMI.2024.3422209.

Tapia, Raul, José Ramiro Martínez-de Dios, and Anibal Ollero. “eFFT-C++: An Open-Source Implementation of the Event-Based Fast Fourier Transform.” Journal of Open Research Software 14 (April 2026): 27. https://doi.org/10.5334/jors.642.

Tofighi, Nafiseh Jabbari, Maxime Robic, Fabio Morbidi, and Pascal Vasseur. “A Survey on Event-Based Optical Marker Systems.” Preprint, arXiv, 2025. https://doi.org/10.48550/ARXIV.2504.20736.

Zhang, Shijie, Yuxuan Huang, Xuan Pei, et al. “An Improved LED ArUco-Marker Detection Method for Event Camera.” In Communications, Networking, and Information Systems, vol. 1839, edited by Haonan Chen, Pingyi Fan, and Lipo Wang. Springer Nature Singapore, 2023. https://doi.org/10.1007/978-981-99-3581-9%255C_3.

Downloads

Published

2026-09-01

Issue

Section

Robótica