Voice-Based Collaborative Robot Interaction: A Modular, Speech-Based Interface Using LLMs
2026 (English)In: Innovative Intelligent Industrial Production and Logistics: 6th IFAC/INSTICC International Conference, IN4PL 2025, Marbella, Spain, October 23–24, 2025, Proceedings, Part I / [ed] José Barata; Kurosh Madani; Hervé Panetto, Cham: Springer, 2026, p. 123-132Conference paper, Published paper (Refereed)
Abstract [en]
As the boundaries between human and machine interaction continue to blur, the need for intuitive and efficient interfaces becomes increasingly pressing. In industrial settings, collaborative robots (cobots) have emerged as pivotal tools in facilitating human-machine synergy. This paper presents a comprehensive design, implementation, and evaluation of a voice-controlled cobot interface using open-source software, speech recognition technologies, and large language models (LLMs). The system enables users to issue verbal commands, obtain audio feedback, inquire about process status, and even engage in casual conversation with the robot. By leveraging modular software architecture and locally deployed LLMs, the prototype offers a scalable and user-friendly solution. The study delves into the technical underpinnings, practical limitations, and future possibilities of hands-free robotic control, offering a contribution to the evolving field of human-robot interaction.
Place, publisher, year, edition, pages
Cham: Springer, 2026. p. 123-132
Series
Communications in Computer and Information Science, ISSN 1865-0929, E-ISSN 1865-0937 ; 2825
Keywords [en]
Cobot, Human-Robot Collaboration, Human-Robot Interaction, LLM, Voice Control, Collaborative robots, Human computer interaction, Industrial robots, Machine design, Man machine systems, Open systems, Software architecture, Speech communication, Humans-robot interactions, Language model, Large language model, Modulars, Pressung, Robot interactions, Speech-based interfaces, Open source software, Speech recognition
National Category
Robotics and automation Human Computer Interaction
Research subject
Virtual Production Development (VPD)
Identifiers
URN: urn:nbn:se:his:diva-26165DOI: 10.1007/978-3-032-15576-4_8Scopus ID: 2-s2.0-105029697234ISBN: 978-3-032-15575-7 (print)ISBN: 978-3-032-15576-4 (electronic)OAI: oai:DiVA.org:his-26165DiVA, id: diva2:2040219
Conference
6th International Conference on Innovative Intelligent Industrial Production and Logistics, IN4PL 2025, Marbella, Spain, October 23–24, 2025
Note
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2026
Correspondence Address: A. Syberfeldt; University of Skövde, Skövde, PO408, SE, 54148, Sweden; email: anna.syberfeldt@his.se
2026-02-192026-02-192026-05-22Bibliographically approved