Högskolan i Skövde

In the manufacturing industry, automatic quality inspections can lead to improved product quality and productivity. Deep learning-based computer vision technologies, with their superior performance in many applications, can be a possible solution for automatic quality inspections. However, collecting a large amount of annotated training data for deep learning is expensive and time-consuming, especially for processes involving various products and human activities such as assembly. To address this challenge, we propose a method for automated assembly quality inspection using synthetic data generated from computer-aided design (CAD) models. The method involves two steps: automatic data generation and model implementation. In the first step, we generate synthetic data in two formats: two-dimensional (2D) images and three-dimensional (3D) point clouds. In the second step, we apply different state-of-the-art deep learning approaches to the data for quality inspection, including unsupervised domain adaptation, i.e., a method of adapting models across different data distributions, and transfer learning, which transfers knowledge between related tasks. We evaluate the methods in a case study of pedal car front-wheel assembly quality inspection to identify the possible optimal approach for assembly quality inspection. Our results show that the method using Transfer Learning on 2D synthetic images achieves superior performance compared with others. Specifically, it attained 95% accuracy through fine-tuning with only five annotated real images per class. With promising results, our method may be suggested for other similar quality inspection use cases. By utilizing synthetic CAD data, our method reduces the need for manual data collection and annotation. Furthermore, our method performs well on test data with different backgrounds, making it suitable for different manufacturing environments. 

Recently the concept of Industry 5.0 has been introduced, reinforcing the human-centric perspective for future industry. The human-centric scientific discipline and profession ergonomics is applied in industry to find solutions that are optimized in regard to both human well-being and overall system performance. It is found, however, that most production development and preparation work carried out in industry tends to address one of these two domains at a time, in a sequential process, typically making optimization slow and complicated. The aim of this paper is to suggest, demonstrate, and evaluate a concept that makes it possible to optimize aspects of human well-being and overall system performance in an efficient and easy parallel process. The concept enables production planning and balancing of human work in terms of two parameters: assembly time as a parameter of productivity (system performance), and risk of musculoskeletal disorders as a parameter of human well-being. A software demonstrator was developed, and results from thirteen test subjects were compared with the traditional sequential way of working. The findings show that the suggested relatively unique parallel approach has a positive impact on the expected musculoskeletal risk and does not necessarily negatively affect productivity, in terms of cycle time and time balance between assembly stations. The time to perform the more complex two-parameter optimization in parallel was shorter than the time in the sequential process. The majority of the subjects stated that they preferred the parallel way of working compared to the traditional serial way of working.

This paper presents a decision support approach to enable decision-makers to identify no-preference solutions in multi-objective optimization for factory layout planning. Using a set of trade-off solutions for a battery production assembly station, a decision support method is introduced to select three solutions that balance all conflicting objectives, namely, the solution closest to the ideal point, the solution furthest from the nadir point, and the one that is best performing along the ideal nadir vector. To further support decision-making, additional analyses of system performance and worker well-being metrics are integrated. This approach emphasizes balancing operational efficiency with human-centric design, aligning with human factors and ergonomics (HFE) principles and Industry 4.0–5.0. The findings demonstrate that objective decision support based on Pareto front analysis can effectively guide stakeholders in selecting optimal solutions that enhance both system performance and worker well-being. Future work could explore applying this framework with alternative multi-objective optimization algorithms.

The convergence of the focus of Industry 5.0 on human well-being and the prevalent problem of work-related musculoskeletal disorders necessitates advanced digital solutions due to limitations in manual risk assessment methods. This research aimed to compare usability of a newly developed video-based awkward posture identification software, the ergonomist assistant for evaluation (ERAIVA) with a conventional manual method. The risk assessment tool utilised in this study, integrated into the ERAIVA digital platform, is the risk management assessment tool for manual handling proactively (RAMP). Four assessors evaluated video-recorded tasks using both methods (manual and ERAIVA). The usability was assessed through the post-study system usability questionnaire, time consumption, number of video replays and video annotation deletions. The impact on identification of awkward posture durations was also studied. ERAIVA exhibited the highest usability score; it showed a higher number of video replays of specific sequences and annotations without significant differences in time consumption.

Planning and designing factory layouts are frequently performed within virtual environments, relying on inputs from various cross-disciplinary activities e.g., product development, manufacturing process planning, resource descriptions, ergonomics, and safety. The success of this process heavily relies on the expertise of the practitioners performing the task. Studies have shown that layout planning often hinges on the practitioners’ knowledge and interpretation of current rules and requirements. As there is significant variability in this knowledge and interpretation, there is a risk that decisions are made on incorrect grounds. Consequently, the layout planning process depends on individual proficiency. In alignment with Industry 4.0 and Industry 5.0 principles, there is a growing emphasis on providing practitioners involved in industrial development processes with efficient decision support tools. This paper presents a digital support function integrated into a virtual layout planning tool, developed to support practitioners in considering current rules and requirements for space claims in the layout planning process. This digital support function was evaluated by industry practitioners and stakeholders involved in the factory layout planning process. This initiative forms part of a broader strategy to provide advanced digital support to layout planners, enhancing objectivity and efficiency in the layout planning process while bridging cross-disciplinary gaps.

The manufacturing factory layout planning process is commonly supported by the use of digital tools, enabling creation and testing of potential layouts before being realised in the real world. The process relies on engineers’ experience and inputs from several cross-disciplinary functions, meaning that it is subjective, iterative and prone to errors and delays. To address this issue, new tools and methods are needed to make the planning process more objective, efficient and able to consider multiple objectives simultaneously. This work suggests and demonstrates a simulation-based multi-objective optimisation approach that assists the generation and assessment of factory layout proposals, where objectives and constraints related to safety regulations, workers’ well-being and walking distance are considered simultaneously. The paper illustrates how layout planning for a logistics area can become a cross-disciplinary and transparent activity, while being automated to a higher degree, providing objective results to facilitate informed decision-making.

OCCUPATIONAL APPLICATIONS

In the context of Industry 5.0, our study advances manufacturing factory layout planning by integrating multi-objective optimization with nature-inspired algorithms and a digital human modeling tool. This approach aims to overcome the limitations of traditional planning methods, which often rely on engineers’ expertise and inputs from various functions in a company, leading to slow processes and risk of human errors. By focusing the multi-objective optimization on three primary targets, our methodology promotes objective and efficient layout planning, simultaneously considering worker well-being and system performance efficiency. Illustrated through a pedal car assembly station layout case, we demonstrate how layout planning can transition into a transparent, cross-disciplinary, and automated activity. This methodology provides multi-objective decision support, showcasing a significant step forward in manufacturing factory layout design practices.

TECHNICAL ABSTRACT

Rationale: Integrating multi-objective optimization in manufacturing layout planning addresses simultaneous considerations of productivity, worker well-being, and space efficiency, moving beyond traditional, expert-reliant methods that often overlook critical design aspects. Leveraging nature-inspired algorithms and a digital human modeling tool, this study advances a holistic, automated design process in line with Industry 5.0. Purpose: This research demonstrates an innovative approach to manufacturing layout optimization that simultaneously considers worker well-being and system performance. Utilizing the Non-dominated Sorting Genetic Algorithm II (NSGA-II) and Particle Swarm Optimization (PSO) alongside a Digital Human Modeling (DHM) tool, the study proposes layouts that equally prioritize ergonomic factors, productivity, and area utilization. Methods: Through a pedal car assembly station case, the study illustrates the transition of layout planning into a transparent, cross-disciplinary, and automated process. This method offers objective decision support, balancing diverse objectives concurrently. Results: The optimization results obtained from the NSGA-II and PSO algorithms represent feasible non-dominated solutions of layout proposals, with the NSGA-II algorithm finding a solution superior in all objectives compared to the expert engineer-designed start solution for the layout. This demonstrates the presented method’s capacity to refine layout planning practices significantly. Conclusions: The study validates the effectiveness of combining multi-objective optimization with digital human modeling in manufacturing layout planning, aligning with Industry 5.0’s emphasis on human-centric processes. It proves that operational efficiency and worker well-being can be simultaneously considered and presents future potential manufacturing design advancements. This approach underscores the necessity of multi-objective consideration for optimal layout achievement, marking a progressive step in meeting modern manufacturing’s complex demands.

Enhancing data visualization on the shop floor provides support for dealing with the increasing complexity of production and the need for progressing towards emerging goals like energy efficiency. It enables personnel to make informed decisions based on real-time data displayed on user-friendly interfaces. Augmented reality (AR) technology provides a promising solution to this problem by allowing for the visualization of data in a more immersive and interactive way. The aim of this study is to present a framework to visualize live and historic data about energy consumption in AR, using Power BI and Unity, and discuss the applications' capabilities. The study demonstrated that both Power BI and Unity can effectively visualize near-real-time machine data with the aid of appropriate data pipelines. While both applications have their respective strengths and limitations, they can support informed decision-making and proactive measures to improve energy utilization. Additional research is needed to examine the correlation between energy consumption and production dynamics, as well as to assess the user-friendliness of the data presentation for effective decision-making support. 

Factory layouts are frequently planned and designed in virtual environments, based on the experience of the layout planner. This planning and design process depends on information from several cross-disciplinary activities performed by several functions and experts, e.g., product development, manufacturing process planning, resource descriptions, ergonomics, and safety. Additionally, the layout planner also needs to consider applicable rules and regulations. This experience-based and manual approach to plan and design factory layouts, considering a multitude of inputs and parameters, is a cumbersome iterative process with a high risk of human error and faulty inputs and updates. The general trend in industry is to automate and assist users with their tasks and activities, deriving from concepts such as Industry 4.0 and Industry 5.0. This paper presents and demonstrates how digital support for rules and regulations can assist layout planners in factory layout work. The objective is to support the layout planner in accounting for area/volume reservations required to comply with rules and regulations for workers and equipment in the factory layout. This is a step in a wider initiative to provide enhanced digital support to layout planners, making the layout planning and design process more objective and efficient, and bridge gaps between cross-disciplinary planning and design activities.

The factory layout is frequently planned in virtual environments, based on the experience of software tool users. This planning process is cumbersome and iterative to collect the necessary information, with a high risk of faulty inputs and updates. The digital twin concept has been introduced in order to speed up information sharing within a company; it relies on connectivity. However, the concept is often misunderstood as just a 3D model of a virtual object, not including connectivity. The aim of this paper is to present an extended virtual and physical engineering communication framework including four concepts: digital model, digital pre-runner, digital shadow, and digital twin. The four concepts are demonstrated and described in order to facilitate understanding how data exchange between virtual and physical objects can work in the future and having up-to date virtual environments enables simulating, analysing, and improving on more realistic and accurate datasets.