Högskolan i Skövde

In the manufacturing industry, automatic quality inspections can lead to improved product quality and productivity. Deep learning-based computer vision technologies, with their superior performance in many applications, can be a possible solution for automatic quality inspections. However, collecting a large amount of annotated training data for deep learning is expensive and time-consuming, especially for processes involving various products and human activities such as assembly. To address this challenge, we propose a method for automated assembly quality inspection using synthetic data generated from computer-aided design (CAD) models. The method involves two steps: automatic data generation and model implementation. In the first step, we generate synthetic data in two formats: two-dimensional (2D) images and three-dimensional (3D) point clouds. In the second step, we apply different state-of-the-art deep learning approaches to the data for quality inspection, including unsupervised domain adaptation, i.e., a method of adapting models across different data distributions, and transfer learning, which transfers knowledge between related tasks. We evaluate the methods in a case study of pedal car front-wheel assembly quality inspection to identify the possible optimal approach for assembly quality inspection. Our results show that the method using Transfer Learning on 2D synthetic images achieves superior performance compared with others. Specifically, it attained 95% accuracy through fine-tuning with only five annotated real images per class. With promising results, our method may be suggested for other similar quality inspection use cases. By utilizing synthetic CAD data, our method reduces the need for manual data collection and annotation. Furthermore, our method performs well on test data with different backgrounds, making it suitable for different manufacturing environments. 

This paper presents a decision support approach to enable decision-makers to identify no-preference solutions in multi-objective optimization for factory layout planning. Using a set of trade-off solutions for a battery production assembly station, a decision support method is introduced to select three solutions that balance all conflicting objectives, namely, the solution closest to the ideal point, the solution furthest from the nadir point, and the one that is best performing along the ideal nadir vector. To further support decision-making, additional analyses of system performance and worker well-being metrics are integrated. This approach emphasizes balancing operational efficiency with human-centric design, aligning with human factors and ergonomics (HFE) principles and Industry 4.0–5.0. The findings demonstrate that objective decision support based on Pareto front analysis can effectively guide stakeholders in selecting optimal solutions that enhance both system performance and worker well-being. Future work could explore applying this framework with alternative multi-objective optimization algorithms.

Planning and designing factory layouts are frequently performed within virtual environments, relying on inputs from various cross-disciplinary activities e.g., product development, manufacturing process planning, resource descriptions, ergonomics, and safety. The success of this process heavily relies on the expertise of the practitioners performing the task. Studies have shown that layout planning often hinges on the practitioners’ knowledge and interpretation of current rules and requirements. As there is significant variability in this knowledge and interpretation, there is a risk that decisions are made on incorrect grounds. Consequently, the layout planning process depends on individual proficiency. In alignment with Industry 4.0 and Industry 5.0 principles, there is a growing emphasis on providing practitioners involved in industrial development processes with efficient decision support tools. This paper presents a digital support function integrated into a virtual layout planning tool, developed to support practitioners in considering current rules and requirements for space claims in the layout planning process. This digital support function was evaluated by industry practitioners and stakeholders involved in the factory layout planning process. This initiative forms part of a broader strategy to provide advanced digital support to layout planners, enhancing objectivity and efficiency in the layout planning process while bridging cross-disciplinary gaps.

The manufacturing factory layout planning process is commonly supported by the use of digital tools, enabling creation and testing of potential layouts before being realised in the real world. The process relies on engineers’ experience and inputs from several cross-disciplinary functions, meaning that it is subjective, iterative and prone to errors and delays. To address this issue, new tools and methods are needed to make the planning process more objective, efficient and able to consider multiple objectives simultaneously. This work suggests and demonstrates a simulation-based multi-objective optimisation approach that assists the generation and assessment of factory layout proposals, where objectives and constraints related to safety regulations, workers’ well-being and walking distance are considered simultaneously. The paper illustrates how layout planning for a logistics area can become a cross-disciplinary and transparent activity, while being automated to a higher degree, providing objective results to facilitate informed decision-making.

OCCUPATIONAL APPLICATIONS

In the context of Industry 5.0, our study advances manufacturing factory layout planning by integrating multi-objective optimization with nature-inspired algorithms and a digital human modeling tool. This approach aims to overcome the limitations of traditional planning methods, which often rely on engineers’ expertise and inputs from various functions in a company, leading to slow processes and risk of human errors. By focusing the multi-objective optimization on three primary targets, our methodology promotes objective and efficient layout planning, simultaneously considering worker well-being and system performance efficiency. Illustrated through a pedal car assembly station layout case, we demonstrate how layout planning can transition into a transparent, cross-disciplinary, and automated activity. This methodology provides multi-objective decision support, showcasing a significant step forward in manufacturing factory layout design practices.

TECHNICAL ABSTRACT

Rationale: Integrating multi-objective optimization in manufacturing layout planning addresses simultaneous considerations of productivity, worker well-being, and space efficiency, moving beyond traditional, expert-reliant methods that often overlook critical design aspects. Leveraging nature-inspired algorithms and a digital human modeling tool, this study advances a holistic, automated design process in line with Industry 5.0. Purpose: This research demonstrates an innovative approach to manufacturing layout optimization that simultaneously considers worker well-being and system performance. Utilizing the Non-dominated Sorting Genetic Algorithm II (NSGA-II) and Particle Swarm Optimization (PSO) alongside a Digital Human Modeling (DHM) tool, the study proposes layouts that equally prioritize ergonomic factors, productivity, and area utilization. Methods: Through a pedal car assembly station case, the study illustrates the transition of layout planning into a transparent, cross-disciplinary, and automated process. This method offers objective decision support, balancing diverse objectives concurrently. Results: The optimization results obtained from the NSGA-II and PSO algorithms represent feasible non-dominated solutions of layout proposals, with the NSGA-II algorithm finding a solution superior in all objectives compared to the expert engineer-designed start solution for the layout. This demonstrates the presented method’s capacity to refine layout planning practices significantly. Conclusions: The study validates the effectiveness of combining multi-objective optimization with digital human modeling in manufacturing layout planning, aligning with Industry 5.0’s emphasis on human-centric processes. It proves that operational efficiency and worker well-being can be simultaneously considered and presents future potential manufacturing design advancements. This approach underscores the necessity of multi-objective consideration for optimal layout achievement, marking a progressive step in meeting modern manufacturing’s complex demands.

Enhancing data visualization on the shop floor provides support for dealing with the increasing complexity of production and the need for progressing towards emerging goals like energy efficiency. It enables personnel to make informed decisions based on real-time data displayed on user-friendly interfaces. Augmented reality (AR) technology provides a promising solution to this problem by allowing for the visualization of data in a more immersive and interactive way. The aim of this study is to present a framework to visualize live and historic data about energy consumption in AR, using Power BI and Unity, and discuss the applications' capabilities. The study demonstrated that both Power BI and Unity can effectively visualize near-real-time machine data with the aid of appropriate data pipelines. While both applications have their respective strengths and limitations, they can support informed decision-making and proactive measures to improve energy utilization. Additional research is needed to examine the correlation between energy consumption and production dynamics, as well as to assess the user-friendliness of the data presentation for effective decision-making support. 

Factory layouts are frequently planned and designed in virtual environments, based on the experience of the layout planner. This planning and design process depends on information from several cross-disciplinary activities performed by several functions and experts, e.g., product development, manufacturing process planning, resource descriptions, ergonomics, and safety. Additionally, the layout planner also needs to consider applicable rules and regulations. This experience-based and manual approach to plan and design factory layouts, considering a multitude of inputs and parameters, is a cumbersome iterative process with a high risk of human error and faulty inputs and updates. The general trend in industry is to automate and assist users with their tasks and activities, deriving from concepts such as Industry 4.0 and Industry 5.0. This paper presents and demonstrates how digital support for rules and regulations can assist layout planners in factory layout work. The objective is to support the layout planner in accounting for area/volume reservations required to comply with rules and regulations for workers and equipment in the factory layout. This is a step in a wider initiative to provide enhanced digital support to layout planners, making the layout planning and design process more objective and efficient, and bridge gaps between cross-disciplinary planning and design activities.

The factory layout is frequently planned in virtual environments, based on the experience of software tool users. This planning process is cumbersome and iterative to collect the necessary information, with a high risk of faulty inputs and updates. The digital twin concept has been introduced in order to speed up information sharing within a company; it relies on connectivity. However, the concept is often misunderstood as just a 3D model of a virtual object, not including connectivity. The aim of this paper is to present an extended virtual and physical engineering communication framework including four concepts: digital model, digital pre-runner, digital shadow, and digital twin. The four concepts are demonstrated and described in order to facilitate understanding how data exchange between virtual and physical objects can work in the future and having up-to date virtual environments enables simulating, analysing, and improving on more realistic and accurate datasets.

In line with Industry 5.0, ergonomic factors have recently received more attention in balancing assembly lines to enhance the human-centric aspect. Meanwhile, today’s mass-customized trend yields manufacturers to offset the assembly lines for different product variants. Thus, this study addresses the mixed-model assembly line balancing problem (MMALBP) by considering worker posture. Digital human modeling and posture assessment technologies are utilized to assess the risks of work-related musculoskeletal disorders using a method known as rapid entire body analysis (REBA). The resulting MMALBP is formulated as a mixed-integer linear programming (MILP) model while considering three objectives: cycle time, maximum ergonomic risk of workstations, and total ergonomic risks. An enhanced non-dominated sorting genetic algorithm (E-NSGA-II) is developed by incorporating a local search procedure that generates neighborhood solutions and a multi-criteria decision-making mechanism that ensures the selection of promising solutions. The E-NSGA-II is benchmarked against Epsilon-constraint, MOGA, and NSGA-II while solving a case study and also test problems taken from the literature. The computational results show that E-NSGA-II can find promising Pareto front solutions while dominating the considered methods in terms of performance metrics. The robustness of E-NSGA-II results is evaluated through one-way ANOVA statistical tests. The analysis of results shows that a smooth distribution of time and ergonomic loads among the workstations can be achieved when all three objectives are simultaneously considered.

This paper presents an approach to automatic surface defect detection by a deep learning-based object detection method, particularly in challenging scenarios where defects are rare, i.e., with limited training data. We base our approach on an object detection model YOLOv8, preceded by a few steps: 1) filtering out irrelevant information, 2) enhancing the visibility of defects, namely brightness contrast, and 3) increasing the diversity of the training data through data augmentation. We evaluated the method in an industrial case study of crown wheel surface inspection in detecting Unclean Gear as well as Deburring defects, resulting in promising performances. With the combination of the three preprocessing steps, we improved the detection accuracy by 22.2% and 37.5% respectively while detecting those two defects. We believe that the proposed approach is also adaptable to various applications of surface defect detection in other industrial environments as the employed techniques, such as image segmentation, are available off the shelf.