Eye-Guided Human-Robot Collaborative Assembly: A Feasibility Study
2026 (English) In: Advances in Production Management Systems. Cyber-Physical-Human Production Systems: Human-AI Collaboration and Beyond: 44th IFIP WG 5.7 International Conference, APMS 2025, Kamakura, Japan, August 31-September 4, 2025, Proceedings, Part I / [ed] Hajime Mizuyama; Eiji Morinaga; Tomomi Nonaka; Toshiya Kaihara; Gregor von Cieminski; David Romero, Cham: Springer, 2026, p. 120-133Conference paper, Published paper (Refereed)
Abstract [en]
Collaboration between robots and human workers constitutes an important part of the shift towards human-centric production processes. While collaborative robots have increased flexibility and enabled compact production environments, real-time intent recognition and joint actions in human-robot collaboration (HRC) continue to pose challenges, particularly in dynamic target selection and coordination. Conventional HRC systems rely on manual inputs or predefined gestures. This study explores the feasibility of gaze-based interaction as a natural and intuitive control mechanism for close-proximity HRC in dynamic industrial settings. The approach is demonstrated in the form of a prototype workstation for wire harness assembly on a car bumper, where the human and the robot collaborate in real time using eye gaze-based dynamic target selection and tight action coordination. The human eye gaze was recorded in real-time using eye-tracking glasses, and the forward-facing scene camera of the glasses matched it to upcoming assembly targets for the robot. The system was evaluated based on detection accuracy and response time. Results indicate that the human eye gaze can constitute a powerful cue for robotic target selection and action coordination in HRC-based assembly. The YOLOv8-based object detection model achieved average target recognition confidence above 60%, despite sensitivity to lighting variations and dataset composition. These findings support the viability of gaze-based robotic control in industrial assembly, demonstrating its potential to enhance operator ergonomics, streamline task execution, and improve overall system responsiveness in dynamic work environments
Place, publisher, year, edition, pages Cham: Springer, 2026. p. 120-133
Series
IFIP Advances in Information and Communication Technology, ISSN 1868-4238, E-ISSN 1868-422X ; 764
Keywords [en]
Human-Robot Collaboration, Eye-Tracking, Proactive Eye Gaze (PEG), Computer Vision, Industrial Assembly
National Category
Robotics and automation Production Engineering, Human Work Science and Ergonomics
Research subject Virtual Production Development (VPD); Interaction Lab (ILAB)
Identifiers URN: urn:nbn:se:his:diva-25817 DOI: 10.1007/978-3-032-03515-8_9 ISI: 001583355400009 Scopus ID: 2-s2.0-105015454648 ISBN: 978-3-032-03514-1 (print) ISBN: 978-3-032-03517-2 (print) ISBN: 978-3-032-03515-8 (electronic) OAI: oai:DiVA.org:his-25817 DiVA, id: diva2:1998774
Conference 44th IFIP WG 5.7 International Conference, APMS 2025, Kamakura, Japan, August 31 – September 4, 2025
Projects EWASS - Empowering Human Workers for Assembly of Wire Harnesses
Funder Vinnova, 2022-01279
Note First Online: 27 August 2025
Copyright Information: IFIP International Federation for Information Processing 2026
Hardcover ISBN 978-3-032-03514-1. Published: 24 August 2025
Softcover ISBN 978-3-032-03517-2. Due: 07 September 2026
eBook ISBN 978-3-032-03515-8. Published: 26 August 2025
The authors would like to thank the project partners and participants of EWASS.
The present work was financially supported by the Swedish innovation agency Vinnova through the research and innovation programme Produktion2030, grant #2022-01279: Empowering Human Workers for Assembly of Wire Harnesses (EWASS)
2025-09-172025-09-172026-05-21 Bibliographically approved