Högskolan i Skövde

his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Augmented reality smart glasses as assembly operator support: Towards a framework for enabling industrial integration
University of Skövde, School of Engineering Science. University of Skövde, Virtual Engineering Research Environment. (Produktion och Automatiseringsteknik, Production and Automation Engineering)ORCID iD: 0000-0001-9512-7554
2020 (English)Licentiate thesis, comprehensive summary (Other academic)Alternative title
Smarta AR-glasögon som monteringsoperatörsstöd : Mot ett ramverk för att möjliggöra industriell integrering (Swedish)
Abstract [en]

Operators are likely to continue to play an integral part in industrial assembly for the foreseeable future. This is in part because increasingly shorter life-cycles and increased variety of products makes automation harder to achieve. As technological advancements enables greater digitalization, the demands for increased individual designs of products increases. These changes, combined with a global competition, does put an increasing strain on operators to handle large quantities of information in a short timeframe. Augmented reality (AR) has been identified as a technology that can present assembly information to operators in an efficient manner. AR smart glasses (ARSG) is an implementation of AR suitable for operators since they are hands-free and can provide individual instructions in the correct context directly in their real work environment. There are currently early adopters of ARSG in production within industry and there are many predictions that ARSG usage will continue to grow. However, to fully integrate ARSG as a tool among others in a modern and complex factory there are several perspectives that a company need to take into consideration. This thesis investigates both the operator perspective and the manufacturing engineering perspective to support industry in how to make the correct investment decisions as regards to ARSG.

The aim of this licentiate thesis is to provide a basis for a framework to enable industry to choose and integrate ARSG in production as a value adding operator support. This is achieved by investigating the theoretical basis of ARSG related technology and its maturity as well as the needs operators have in ARSG for their usage in assembly. The philosophical paradigm that is followed is that of pragmatism. The methodology used is design science, set in the research paradigm of mixed methods. Data has been collected through experiments with demonstrators, interviews, observations, and literature reviews. This thesis provides partial answers to the overall research aim.

The thesis shows that the topic is feasible, relevant to industry, and a novel scientific contribution. Observations, interviews, and a literature review gave an overview of the operator perspective. Some highlights from the results are that operators are willing to work with ARSG, that operators need help in unlearning old tasks as well as learning new ones, and that optimal weight distribution of ARSG is dependent on the operators’ head-positioning. Highlights from the preliminary findings for the manufacturing engineering perspective include a general lack of standards for AR as regards vertical industrial application, improved tools for faster instruction generation, and large variations in specifications of available ARSG.

Future work includes a complete answer to the manufacturing engineering perspective as well as combining all the results to create a framework for ARSG integration in industry.

Abstract [sv]

Operatörer kommer sannolikt fortsätta att vara en integral del av industriell montering inom en överskådlig framtid. Detta beror delvis på allt kortare livscykler och ökad variation på produkter gör det svårare att automatisera produktionen. Samtidigt som tekniska framsteg möjliggör mer digitalisering så ökar efterfrågan på individuellt designade produkter. De här förändringarna, i kombination med en global konkurrens, skapar en ökad press på operatörer att hantera stora mängder information inom en kort tidsram. Förstärkt verklighet (förkortat AR från engelska ”augmented reality”) har identifierats som en teknologi som effektivt kan presentera monteringsinstruktioner för operatörer. Smarta AR glasögon (förkortat ARSG från engelska ”AR smart glasses”) är en implementering av AR som är lämplig för operatörer eftersom de inte behöver använda sina händer för att bära dem och för att de kan presentera individuella instruktioner i rätt kontext direkt i deras verkliga arbetsmiljö. Det finns industriföretag som redan har börjat använda ARSG i produktion och det finns många förutsägelser om att ARSG kommer fortsätta att växa. För att kunna fullt integrera ARSG som ett bland många verktyg i en modern och komplex fabrik så måste dock ett företag ta hänsyn till ett flertal perspektiv. Den här avhandlingen undersöker både operatörs-perspektivet och beredningsperspektivet för att stödja industrins investeringsbeslut rörande ARSG.

Målet med den här licentiatavhandlingen är att bidra med en grund för ett ramverk som kan möjliggöra för industrin att välja, integrera och underhålla ARSG i produktion som ett värdeskapande operatörsstöd. Det här åstadkoms genom att undersöka den teoretiska grunden för ARSG-relaterad teknologi och dess mognad och även operatörernas behov i ARSG när de används i montering. Det filosofiska paradigm som har följts är pragmatism. Metodologin som har används är designvetenskap, kopplat till forskningsparadigmet blandade metoder. Data har samlats in genom demonstratorexperiment, intervjuer, observationer och litteraturstudier. Den här avhandlingen ger partiellt svar till det övergripande forskningsmålet.

Avhandlingen visar att ämnet är möjligt att genomföra, relevant för industrin och ett originellt vetenskapligt bidrag. Observationer, intervjuer och en litteraturstudie gav en översikt av operatörsperspektivet. Några exempel från resultaten att lyfta fram är att operatörer är villiga att arbeta med ARSG, att operatörer behöver hjälp med att avlära sig gamla uppgifter såväl som att lära sig nya och att den optimala viktspridningen av ARSG beror på operatörernas huvudpositionering. Bland de preliminära resultaten från beredningsperspektivet inkluderas en generell avsaknad av standarder för AR gällande vertikala industriella tillämpningar, förbättrade verktyg för instruktionsskapande som stödjer snabbare instruktionsgenerering och stora variationer gällande specifikationer i tillgängliga ARSG.

Framtida arbete inkluderar ett komplett svar till beredningsperspektivet samt att kombinera alla resultaten för att skapa ett ramverk för ARSG integration i industrin.

Place, publisher, year, edition, pages
Skövde: University of Skövde , 2020. , p. 55
Series
Dissertation Series ; 37
National Category
Computer Systems Production Engineering, Human Work Science and Ergonomics
Research subject
Production and Automation Engineering
Identifiers
URN: urn:nbn:se:his:diva-19339ISBN: 978-91-984919-1-3 (print)OAI: oai:DiVA.org:his-19339DiVA, id: diva2:1511928
Presentation
2021-01-14, ASSAR Industrial Innovation Arena, Skövde, 13:00 (English)
Opponent
Supervisors
Note

PUBLICATIONS WITH LOWER RELEVANCE

1. Holm, M., Danielsson, O., Syberfeldt, A., & Moore, P. (2017). Adaptive instructions to novice shop-floor operators using augmented reality. Journal of Industrial and Production Engineering, 34, 362-374.

2. Syberfeldt, A., Danielsson, O., & Gustavsson, P. (2017). Augmented Reality Smart Glasses in the Smart Factory: Product Evaluation Guidelines and Review of Available Products. IEEE Access, 5, 9118-9130.

3. Syberfeldt, A., Danielsson, O., Holm, M., & Wang, L. (2016). Dynamic operator in-structions based on augmented reality and rule-based expert systems. Proceedings of the 48thCIRP Conference on Manufacturing Systems, 41, 346-351.

4. Syberfeldt, A., Holm, M., Danielsson, O., & Wang, L. (2016). Support systems on the industrial shop-floors of the future: operators’ perspective on augmented reality. 6th CIRP Conference on Assembly Technologies and Systems, 44, 108-113.

5. Syberfeldt, A., Holm, M., Danielsson, O., & Wang, L. (2015). Visual Assembling Guidance Using Augmented Reality. Procedia Manufacturing, 1, 98-109.

6. Syberfeldt, A., Danielsson, O., Holm, M., & Ekblom, T. (2014). Augmented Reality at the Industrial Shop-Floor. Augmented and Virtual Reality, 1, 201-209.

Available from: 2021-01-20 Created: 2020-12-21 Last updated: 2021-01-20Bibliographically approved
List of papers
1. Assessing Instructions in Augmented Reality for Human-Robot Collaborative Assembly by Using Demonstrators
Open this publication in new window or tab >>Assessing Instructions in Augmented Reality for Human-Robot Collaborative Assembly by Using Demonstrators
2017 (English)In: Procedia CIRP, E-ISSN 2212-8271, Vol. 63, p. 89-94Article in journal (Refereed) Published
Abstract [en]

Robots are becoming more adaptive and aware of their surroundings. This has opened up the research area of tight human-robot collaboration,where humans and robots work directly interconnected rather than in separate cells. The manufacturing industry is in constant need ofdeveloping new products. This means that operators are in constant need of learning new ways of manufacturing. If instructions to operatorsand interaction between operators and robots can be virtualized this has the potential of being more modifiable and available to the operators.Augmented Reality has previously shown to be effective in giving operators instructions in assembly, but there are still knowledge gapsregarding evaluation and general design guidelines. This paper has two aims. Firstly it aims to assess if demonstrators can be used to simulatehuman-robot collaboration. Secondly it aims to assess if Augmented Reality-based interfaces can be used to guide test-persons through apreviously unknown assembly procedure. The long-term goal of the demonstrator is to function as a test-module for how to efficiently instructoperators collaborating with a robot. Pilot-tests have shown that Augmented Reality instructions can give enough information for untrainedworkers to perform simple assembly-tasks where parts of the steps are done with direct collaboration with a robot. Misunderstandings of theinstructions from the test-persons led to multiple errors during assembly so future research is needed in how to efficiently design instructions.

Place, publisher, year, edition, pages
Elsevier, 2017
Keywords
Augmented Reality, Human Robot Collaboration, Assembly
National Category
Robotics
Research subject
Production and Automation Engineering; INF201 Virtual Production Development
Identifiers
urn:nbn:se:his:diva-14023 (URN)10.1016/j.procir.2017.02.038 (DOI)000418465500015 ()2-s2.0-85028641292 (Scopus ID)
Conference
The 50th CIRP Conference on Manufacturing Systems, Taichung City, Taiwan on May 3rd – 5th, 2017
Projects
SYMBIO-TIC
Note

CC BY-NC-ND 4.0

Edited by Mitchell M. Tseng, Hung-Yin Tsai, Yue Wang

Available from: 2017-08-22 Created: 2017-08-22 Last updated: 2024-09-04Bibliographically approved
2. Operators perspective on augmented reality as a support tool in engine assembly
Open this publication in new window or tab >>Operators perspective on augmented reality as a support tool in engine assembly
2018 (English)In: Procedia CIRP, E-ISSN 2212-8271, Vol. 72, p. 45-50Article in journal (Refereed) Published
Abstract [en]

Augmented Reality (AR) has shown its potential in supporting operators in manufacturing. AR-glasses as a platform both in industrial use are emerging markets, thereby making portable and hands-free AR more and more feasible. An important aspect of integrating AR as a support tool for operators is their acceptance of the technology. This paper presents the results of interviewing operators regarding their view on AR technology in their field and observing them working in automotive engine assembly and how they interact with current instructions. The observations and follow-up questions identified three main aspects of the information that the operators looked at: validating screw torque, their current assembly time, and if something went wrong. The interviews showed that a large amount of the operators were positive towards using AR in assembly. This has given an insight in both the current information interaction the operators do and their view on the potential in using AR. Based on these insights we suggest a mock-up design of an AR-interface for engine assembly to serve as a base for future prototype designs.

Place, publisher, year, edition, pages
Elsevier, 2018
Keywords
augmented reality, engine assembly, operator, förstärkt verklighet, motormontering, operatör
National Category
Communication Systems
Research subject
Production and Automation Engineering
Identifiers
urn:nbn:se:his:diva-15937 (URN)10.1016/j.procir.2018.03.153 (DOI)000526120800008 ()2-s2.0-85049604095 (Scopus ID)
Conference
51st CIRP Conference on Manufacturing Systems, Stockholm, May 16-18, 2018
Note

CC BY-NC-ND 4.0

Edited by Lihui Wang

The authors would like to thank the operators and management at the assembly line in the Volvo Car factory in Skövde for their immense help in gathering this data.

Available from: 2018-07-06 Created: 2018-07-06 Last updated: 2024-09-04Bibliographically approved
3. Augmented Reality Smart Glasses for Industrial Assembly Operators: A Meta-Analysis and Categorization
Open this publication in new window or tab >>Augmented Reality Smart Glasses for Industrial Assembly Operators: A Meta-Analysis and Categorization
2019 (English)In: Advances in Manufacturing Technology XXXIII: Proceedings of the 17th International Conference on Manufacturing Research, incorporating the 34th National Conference on Manufacturing Research, 10–12 September 2019, Queen’s University, Belfast, UK / [ed] Yan Jin; Mark Price, Amsterdam: IOS Press, 2019, Vol. 9, p. 173-179Conference paper, Published paper (Refereed)
Abstract [en]

Augmented reality smart glasses (ARSG) are an emerging technology that has the potential to revolutionize how operators interact with information in cyber-physical systems. However, augmented reality is currently not widespread in industrial assembly. The aim of this paper is to investigate and map ARSG in manufacturing from the perspectives of the operator, of manufacturing engineering, and of its technological maturity. This mapping provides an overview of topics relevant to enabling the implementation of ARSG in a manufacturing system, thus facilitating future exploration of the three perspectives. This investigation was done using a meta-analysis of literature reviews of applications of augmented reality in industrial manufacturing. The meta-analysis categorized previously identified topics within augmented reality in industrial manufacturing and mapped those to the scope of the three perspectives.

Place, publisher, year, edition, pages
Amsterdam: IOS Press, 2019
Series
Advances in Transdisciplinary Engineering, ISSN 2352-751X, E-ISSN 2352-7528 ; 9
Keywords
Augmented Reality, Literature Review, Assembly, Assembly Operators
National Category
Production Engineering, Human Work Science and Ergonomics
Research subject
Production and Automation Engineering; VF-KDO
Identifiers
urn:nbn:se:his:diva-17850 (URN)10.3233/ATDE190031 (DOI)2-s2.0-85108891840 (Scopus ID)978-1-64368-008-8 (ISBN)978-1-64368-009-5 (ISBN)
Conference
17th International Conference on Manufacturing Research, incorporating the 34th National Conference on Manufacturing Research, 10–12 September 2019, Queen’s University, Belfast, UK
Available from: 2019-11-04 Created: 2019-11-04 Last updated: 2024-06-19Bibliographically approved
4. Augmented reality smart glasses for operators in production: Survey of relevant categories for supporting operators
Open this publication in new window or tab >>Augmented reality smart glasses for operators in production: Survey of relevant categories for supporting operators
2020 (English)In: Procedia CIRP, E-ISSN 2212-8271, Vol. 93, p. 1298-1303Article in journal (Refereed) Published
Abstract [en]

The aim of this paper is to give an overview of the current knowledge and future challenges of augmented reality smart glasses (ARSG) for use by industrial operators. This is accomplished through a survey of the operator perspective of ARSG for industrial application, aiming for faster implementation of ARSG for operators in manufacturing. The survey considers the categories assembly instructions, human factors, design, support, and training from the operator perspective to provide insights for efficient use of ARSG in production. The main findings include a lack of standards in the design of assembly instructions, the field of view of ARSG are limited, and the guidelines for designing instructions focus on presenting context-relevant information and limiting the disturbance of reality. Furthermore, operator task routine is becoming more difficult to achieve and testing has mainly been with non-operator testers and overly simplified tasks. Future challenges identified from the review include: longitudinal user-tests of ARSG, a deeper evaluation of how to distribute the weight of ARSG, further improvement of the sensors and visual recognition to facilitate better interaction, and task complexity is likely to increase.

Place, publisher, year, edition, pages
Elsevier, 2020
Keywords
augmented reality, assembly operator, literature survey, augmented reality smart glasses
National Category
Mechanical Engineering
Research subject
Production and Automation Engineering; VF-KDO
Identifiers
urn:nbn:se:his:diva-19088 (URN)10.1016/j.procir.2020.04.099 (DOI)2-s2.0-85092429154 (Scopus ID)
Conference
53rd CIRP Conference on Manufacturing Systems 2020
Note

CC BY-NC-ND 4.0

Edited by Robert X. Gao, Kornel Ehmann

Available from: 2020-09-23 Created: 2020-09-23 Last updated: 2024-09-04Bibliographically approved
5. Augmented reality smart glasses in industrial assembly: Current status and future challenges
Open this publication in new window or tab >>Augmented reality smart glasses in industrial assembly: Current status and future challenges
2020 (English)In: Journal of Industrial Information Integration, ISSN 2467-964X, E-ISSN 2452-414X, Vol. 20, article id 100175Article, review/survey (Refereed) Published
Abstract [en]

This article aims to provide a better understanding of Augmented Reality Smart Glasses (ARSG) for assembly operators from two perspectives, namely, manufacturing engineering and technological maturity. A literature survey considers both these perspectives of ARSG. The article's contribution is an investigation of the current status as well as challenges for future development of ARSG regarding usage in the manufacturing industry in relation to the two perspectives. This survey thereby facilitate a better future integration of ARSG in manufacturing. Findings include that commercially available ARSG differ considerably in their hardware specifications. The Technological Readiness Level (TRL) of some of the components of ARSG is still low, with displays having a TRL of 7 and tracking a TRL of 5. A mapping of tracking technologies and their suitability for industrial ARSG was done and identified Bluetooth, micro-electro mechanical sensors (MEMS) and infrared sensors as potentially suitable technologies to improve tracking. Future work identified is to also explore the operator perspective of ARSG in manufacturing. © 2020

Place, publisher, year, edition, pages
Elsevier, 2020
Keywords
Augmented reality, Industry 4.0, Literature survey, Smart glasses, Glass, Infrared detectors, Surveys, Hardware specifications, Industrial assemblies, Manufacturing engineering, Manufacturing industries, Micro electro mechanical sensors, Technological readiness levels, Tracking technology, Manufacture
National Category
Production Engineering, Human Work Science and Ergonomics Interaction Technologies
Research subject
Production and Automation Engineering
Identifiers
urn:nbn:se:his:diva-19226 (URN)10.1016/j.jii.2020.100175 (DOI)000595313300004 ()2-s2.0-85093920571 (Scopus ID)
Available from: 2020-11-05 Created: 2020-11-05 Last updated: 2023-06-02Bibliographically approved

Open Access in DiVA

fulltext(4493 kB)2535 downloads
File information
File name FULLTEXT02.pdfFile size 4493 kBChecksum SHA-512
3f86ab6f54afa1cadef74c914dee49e11abf69fea0c175c634d914d4018ce73b381b5a1fb59105ec7bde1b289860432a2e89bcb64048b229440780f6c7764999
Type fulltextMimetype application/pdf

Authority records

Danielsson, Oscar

Search in DiVA

By author/editor
Danielsson, Oscar
By organisation
School of Engineering ScienceVirtual Engineering Research Environment
Computer SystemsProduction Engineering, Human Work Science and Ergonomics

Search outside of DiVA

GoogleGoogle Scholar
Total: 2544 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1108 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf