Högskolan i Skövde

his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Knowledge discovery for interactive decision support and knowledge-driven optimization
University of Skövde, School of Engineering Science. University of Skövde, Virtual Engineering Research Environment. (Virtual Production Development (VPD))ORCID iD: 0000-0003-3124-0077
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Multi-objective optimization involves the simultaneous optimization of several objective functions. In real-world problems, these objectives are often in conflict, giving rise to trade-offs in the optimal solutions from the optimization process. All these solutions are equally viable, with no single solution being better or worse than the others. Typically, decision makers have certain preferences that guide the selection of a final solution for practical implementation. While most multi-criteria decision analysis methods focus on the performance of solutions in the objective space, it is important to note that practically relevant knowledge is often found in the design space. Access to this knowledge can provide decision makers with meaningful insights into the problem and the optimization process, leading to more informed decision-making.

This thesis develops and employs methods for knowledge discovery in the context of multi-objective optimization. By emphasizing explicit knowledge representations, this thesis investigates how extracted knowledge can be processed and presented to decision-makers in an interactive manner for insightful decision support. This thesis also explores how extracted knowledge from preferred solutions can be integrated into the algorithms or the multi-objective optimization problem itself, to improve the convergence behavior of optimization algorithms. This approach, called Knowledge-Driven Optimization (KDO), can be implemented either offline or online. Offline KDO involves incorporating knowledge obtained from previous optimization runs into future problem scenarios of a similar nature, restricting the search process to preferred regions of the objective space. A main challenge with such approaches is the storage and retrieval of relevant past knowledge, as well as modifications to the optimization problem formulation. In contrast, online KDO involves integrating knowledge discovery methods with optimization algorithms and utilizing the knowledge obtained during their runtime to enhance the search process, driving algorithms towards better convergence in preferred regions of the objective space. This approach necessitates the development of new search operators capable of incorporating and exploiting various forms of knowledge.

In both offline and online KDO, the veracity and accuracy of the extracted knowledge are critical factors. The thesis validates the effectiveness of the developed methods using various benchmark and engineering optimization test problems, and use-cases from the manufacturing industry. A particular focus is given to generating explicit knowledge that is both meaningful to human decision makers, and can easily be processed algorithmically. The main contributions of this thesis are methods for discovering relevant knowledge about the convergence characteristics of problems, a decision support system for interactive knowledge discovery, and algorithms for realizing both offline and online KDO by incorporating knowledge into the optimization process.

Abstract [sv]

Flermålsoptimering hanterar samtidig optimering av flera målfunktioner, vilka i praktiska optimeringsproblem ofta är i konflikt, vilket ger upphov till avvägningar i de optimala lösningarna från optimeringsprocessen. Alla dessa lösningar är lika värdefulla, och ingen lösning är bättre eller sämre än någon annan. Typiskt sett har beslutsfattare också preferenser som styr valet av en slutlig lösning att implementera i praktiken. De flesta metoder för analys av flera kriterier fokuserar på prestandan hos en uppsättning lösningar i målrymden, det är dock viktigt att notera att praktiskt relevant kunskap ofta finns i designrymden till lösningarna. Tillgång till denna kunskap kan ge beslutsfattare betydelsefulla insikter till både problemet och optimeringsprocessen, vilket leder till mer informerat beslutstagande.

Denna avhandling utvecklar och använder metoder för kunskapsutvinning i sammanhanget av flermålsoptimering. Genom ett särskilt fokus på explicit kunskap, undersöker denna avhandling hur utvunnen kunskap kan bearbetas och presenteras för beslutsfattare på ett interaktivt sätt för förbättrat beslutsstöd. Det undersöks också hur utvunnen kunskap från tidigare lösningar kan integreras i algoritmer för flermålsoptimerings eller direkt i optimeringsproblem för att avlasta beräkning av nya lösningar i optimeringsprocessen. Sådana metoder, kallade kunskapsdriven optimering (KDO), kan implementeras antingen offline eller online. Offline KDO innebär att integrera kunskap som erhållits från tidigare optimeringar, i framtida, liknande problem, vilket avlastar sökprocessen till preferensrika regioner i målrymden. En huvudsaklig utmaning med offline KDO är lagring och återhämtning av relevant tidigare kunskap, samt modifieringar av formuleringar till optimeringsproblem. I kontrast innefattar online KDO att integrera metoder för kunskapsutvinning tillsammans med optimeringsalgoritmer, och att utnyttja den resulterande kunskapen under optimeringen, för att förbättra sökprocessen och driva algoritmerna mot snabbare ankomst i preferensrika regioner i målrymden. Sådana metoder kräver utveckling av nya sökoperatorer kapabla att integrera och utnyttja olika former av utvunnen kunskap.

I både offline och online KDO är det viktigt att den integrerade kunskapen beskriver beslutfattarens preferenser noggrant. Denna avhandling validerar effektiviteten hos de utvecklade metoderna med hjälp av olika benchmark-optimeringsproblem, praktiska tekniska testproblem och fallstudier från tillverkningsindustrin. Ett särskilt fokus har lagts på utvinning av explicit kunskap som både är meningsfull för beslutsfattare och som enkelt kan bearbetas algoritmiskt. Denna avhandlings huvudsakliga bidrag består av metoder för utvinning av relevant kunskap om sökbeteendet för problem, ett beslutstödssystem för interaktiv kunskapsutvinning, samt algoritmer för att förverkliga både offline och online KDO genom att integrera kunskap i optimeringsprocessen.

Place, publisher, year, edition, pages
Skövde: University of Skövde , 2023. , p. xv, 185
Series
Dissertation Series ; 52
National Category
Computer Sciences Information Systems Software Engineering Computer Systems Computational Mathematics
Research subject
Virtual Production Development (VPD); VF-KDO
Identifiers
URN: urn:nbn:se:his:diva-23152ISBN: 978-91-987906-6-5 (print)OAI: oai:DiVA.org:his-23152DiVA, id: diva2:1793441
Public defence
2023-09-27, Assar Industrial Innovation Arena, Kavelbrovägen 2B, Skövde, 13:00 (English)
Opponent
Supervisors
Part of project
Virtual factories with knowledge-driven optimization (VF-KDO), Knowledge FoundationAvailable from: 2023-09-01 Created: 2023-09-01 Last updated: 2023-09-01Bibliographically approved
List of papers
1. Trend Mining 2.0: Automating the Discovery of Variable Trends in the Objective Space
Open this publication in new window or tab >>Trend Mining 2.0: Automating the Discovery of Variable Trends in the Objective Space
2020 (English)In: 2020 IEEE Congress on Evolutionary Computation, CEC 2020 - Conference Proceedings, IEEE, 2020Conference paper, Published paper (Refereed)
Abstract [en]

Practical multi-criterion decision making not only involves the articulation of preferences in the objective space, but also a consideration of how the variables impact these preferences. Trend mining is a recently proposed visualization technique that offers the decision maker a quick overview of the variables' effect on the structure of the objective space and easily discover interesting variable trends. The original trend mining approach relies on a set of predefined reference directions along which an interestingness score is measured for each variable. In this paper, we relax this requirement by automating the approach to find optimal reference directions that maximize the interestingness for each variable. Additional extensions include the use of an Achievement Scalarizing Function (ASF) for ranking solutions along a given reference direction, and an updated interestingness score formulation for more appropriately handling discrete variables. We demonstrate the working of the extended approach on DTLZ2 and WFG2 benchmarks for up to five objectives and on a biobjective engineering design problem. The results show that the ability of the proposed approach to detect variable trends in high dimensional objective spaces is heavily dependent on the quality of the solutions used. 

Place, publisher, year, edition, pages
IEEE, 2020
Keywords
decision making, multi-objective optimization, objective space, variable trends, Computer science, Evolutionary algorithms, Decision makers, Discrete variables, Engineering design problems, High-dimensional, Interestingness, Multi-criterion decision makings, Scalarizing function, Visualization technique
National Category
Computer Sciences
Research subject
Production and Automation Engineering; VF-KDO
Identifiers
urn:nbn:se:his:diva-19183 (URN)10.1109/CEC48606.2020.9185892 (DOI)000703998203021 ()2-s2.0-85092020461 (Scopus ID)978-1-7281-6929-3 (ISBN)978-1-7281-6930-9 (ISBN)
Conference
IEEE Congress on Evolutionary Computation, CEC 2020, 19-24 July 2020, Glasgow, United Kingdom, United Kingdom [online]
Available from: 2020-10-15 Created: 2020-10-15 Last updated: 2023-09-01Bibliographically approved
2. Finding Influential Variables in Multi-Objective optimization Problems
Open this publication in new window or tab >>Finding Influential Variables in Multi-Objective optimization Problems
2020 (English)In: 2020 IEEE Symposium Series on Computational Intelligence (SSCI), IEEE, 2020, p. 173-180Conference paper, Published paper (Refereed)
Abstract [en]

The use of evolutionary algorithms for solving multi-objective optimization problems leaves the decision makers with a set of Pareto-optimal solutions to be considered in their decision making. Multi-objective optimization problems offer two spaces for a decision maker to analyze, the decision space and the objective space. In the literature, most of the focus has been on analyzing the objective space, however, in this paper, two procedures are presented for analyzing the decision space by identifying the variables that predominantly influence the structure of the objective space. Both procedures employ a recently proposed rule mining approach, which is used to find significant rules in terms of the variables. The rules are then combined and an influence score is calculated. The method is demonstrated on four problems, two scalable test problems (DTLZ2 and WFG2) with cases of three, five and seven objectives, one engineering design problem and one simulation-based optimization problem. The experiments show that the proposed approach is able to identify influential variables in most problem cases. 

Place, publisher, year, edition, pages
IEEE, 2020
Keywords
clustering, decision making, knowledge discovery, multi-objective optimization, trend mining, Evolutionary algorithms, Intelligent computing, Pareto principle, Decision makers, Decision space, Engineering design problems, Multi-objective optimization problem, Objective space, Pareto optimal solutions, Simulation-based optimizations, Test problem, Multiobjective optimization
National Category
Information Systems Computer Sciences Computational Mathematics
Research subject
Production and Automation Engineering; VF-KDO
Identifiers
urn:nbn:se:his:diva-19448 (URN)10.1109/SSCI47803.2020.9308383 (DOI)000682772900024 ()2-s2.0-85099716671 (Scopus ID)978-1-7281-2547-3 (ISBN)978-1-7281-2546-6 (ISBN)978-1-7281-2548-0 (ISBN)
Conference
2020 IEEE Symposium Series on Computational Intelligence, SSCI 2020, Virtual, Canberra, Australia, 1 December 2020 through 4 December 2020, Category number CFP20COI-ART, Code 166370
Note

© 2020 IEEE.

Available from: 2021-02-04 Created: 2021-02-04 Last updated: 2023-09-01Bibliographically approved
3. Interactive knowledge discovery and knowledge visualization for decision support in multi-objective optimization
Open this publication in new window or tab >>Interactive knowledge discovery and knowledge visualization for decision support in multi-objective optimization
2023 (English)In: European Journal of Operational Research, ISSN 0377-2217, E-ISSN 1872-6860, Vol. 306, no 3, p. 1311-1329Article in journal (Refereed) Published
Abstract [en]

In many practical applications, the end-goal of multi-objective optimization is to select an implementable solution that is close to the Pareto-optimal front while satisfying the decision maker’s preferences. The decision making process is challenging since it involves the manual consideration of all solutions. The field of multi-criteria decision making offers many methods that help the decision maker in this process. However, most methods only focus on analyzing the solutions’ objective values. A more informed decision generally requires the additional knowledge of how different preferences affect the variable values. One difficulty in realizing this is that while the preferences are often expressed in the objective space, the knowledge required to implement a preferred solution exists in the decision space. In this paper, we propose a decision support system that allows interactive knowledge discovery and knowledge visualization to support practitioners by simultaneously considering preferences in the objective space and their impact in the decision space. The knowledge discovery step can use either of two recently proposed data mining techniques for extracting decision rules that conform to given preferences, while the extracted knowledge is visualized via a novel graph-based approach that allows the discovery of important variables, their values and their interactions with other variables. The result is an intuitive and interactive decision support system that aids the entire decision making process — from solution visualization to knowledge visualization. We demonstrate the usefulness of this system on benchmark optimization problems up to 10 objectives and real-world problems with up to six objectives.

Place, publisher, year, edition, pages
Elsevier, 2023
Keywords
Decision support systems, Multi-objective optimization, Multiple criteria decision making, Data mining, Knowledge discovery
National Category
Computer Sciences Other Computer and Information Science Computer Systems Information Systems
Research subject
Production and Automation Engineering; VF-KDO
Identifiers
urn:nbn:se:his:diva-21874 (URN)10.1016/j.ejor.2022.09.008 (DOI)000925146600001 ()2-s2.0-85139046739 (Scopus ID)
Funder
Knowledge Foundation
Note

CC BY 4.0

Corresponding author: Henrik Smedberg. E-mail addresses: henrik.smedberg@his.se (H. Smedberg), sunith.bandaru@his.se (S. Bandaru).

Erratum in: European Journal of Operational Research, Volume 308, Issue 1, 2023, Pages 496-497. doi:10.1016/j.ejor.2023.01.040

The authors acknowledge the financial support received from KK-stiftelsen (The Knowledge Foundation, Stockholm, Sweden) under the Research Profile 2018 project Virtual Factories with Knowledge-Driven Optimization. For more information, please visit www.virtualfactories.se/

Available from: 2022-09-28 Created: 2022-09-28 Last updated: 2023-09-01Bibliographically approved
4. Mimer: A web-based tool for knowledge discovery in multi-criteria decision support
Open this publication in new window or tab >>Mimer: A web-based tool for knowledge discovery in multi-criteria decision support
2024 (English)In: IEEE Computational Intelligence Magazine, ISSN 1556-603X, E-ISSN 1556-6048, Vol. 19, no 3, p. 73-87Article in journal (Refereed) Published
Abstract [en]

Practitioners of multi-objective optimization currently lack open tools that provide decision support through knowledge discovery. There exist many software platforms for multi-objective optimization, but they often fall short of implementing methods for rigorous post-optimality analysis and knowledge discovery from the generated solutions. This paper presents Mimer, a multi-criteria decision support tool for solution exploration, preference elicitation, knowledge discovery, and knowledge visualization. Mimer is openly available as a web-based tool and uses state-of-the-art web-technologies based on WebAssembly to perform heavy computations on the client-side. Its features include multiple linked visualizations and input methods that enable the decision maker to interact with the solutions, knowledge discovery through interactive data mining and graph-based knowledge visualization. It also includes a complete Python programming interface for advanced data manipulation tasks that may be too specific for the graphical interface. Mimer is evaluated through a user study in which the participants are asked to perform representative tasks simulating practical analysis and decision making. The participants also complete a questionnaire about their experience and the features available in Mimer. The survey indicates that participants find Mimer useful for decision support. The participants also offered suggestions for enhancing some features and implementing new features to extend the capabilities of the tool.

Place, publisher, year, edition, pages
IEEE, 2024
National Category
Computer Sciences Information Systems Software Engineering Computer Systems Computational Mathematics
Research subject
Virtual Production Development (VPD); VF-KDO
Identifiers
urn:nbn:se:his:diva-23154 (URN)10.1109/MCI.2024.3401420 (DOI)001271410100001 ()2-s2.0-85198700093 (Scopus ID)
Funder
Knowledge Foundation, 2018-0011
Note

This work was supporetd by The Knowledge Foundation (KKS), Sweden, through the KKS Profile, Virtual Factories with Knowledge-Driven Optimization (VF-KDO) under Grant 2018-0011.

Available from: 2023-09-01 Created: 2023-09-01 Last updated: 2024-10-09Bibliographically approved
5. Knowledge-Driven Multi-Objective Optimization for Reconfigurable Manufacturing Systems
Open this publication in new window or tab >>Knowledge-Driven Multi-Objective Optimization for Reconfigurable Manufacturing Systems
Show others...
2022 (English)In: Mathematical and Computational Applications, ISSN 1300-686X, E-ISSN 2297-8747, Vol. 27, no 6, article id 106Article in journal (Refereed) Published
Abstract [en]

Current market requirements force manufacturing companies to face production changes more often than ever before. Reconfigurable manufacturing systems (RMS) are considered a key enabler in today's manufacturing industry to cope with such dynamic and volatile markets. The literature confirms that the use of simulation-based multi-objective optimization offers a promising approach that leads to improvements in RMS. However, due to the dynamic behavior of real-world RMS, applying conventional optimization approaches can be very time-consuming, specifically when there is no general knowledge about the quality of solutions. Meanwhile, Pareto-optimal solutions may share some common design principles that can be discovered with data mining and machine learning methods and exploited by the optimization. In this study, the authors investigate a novel knowledge-driven optimization (KDO) approach to speed up the convergence in RMS applications. This approach generates generalized knowledge from previous scenarios, which is then applied to improve the efficiency of the optimization of new scenarios. This study applied the proposed approach to a multi-part flow line RMS that considers scalable capacities while addressing the tasks assignment to workstations and the buffer allocation problems. The results demonstrate how a KDO approach leads to convergence rate improvements in a real-world RMS case.

Place, publisher, year, edition, pages
MDPI, 2022
Keywords
multi-objective optimization, knowledge discovery, reconfigurable manufacturing system, simulation
National Category
Production Engineering, Human Work Science and Ergonomics Computer Sciences
Research subject
Production and Automation Engineering; VF-KDO
Identifiers
urn:nbn:se:his:diva-22194 (URN)10.3390/mca27060106 (DOI)000904384800001 ()
Funder
Knowledge Foundation, 2018-0011
Note

CC BY 4.0

Correspondence: henrik.smedberg@his.se

This work was funded by the Knowledge Foundation (KKS), Sweden, through the KKS Profile Virtual Factories with Knowledge-Driven Optimization, VF-KDO, Grant No. 2018-0011.

(This article belongs to the Special Issue Evolutionary Multi-objective Optimization: An Honorary Issue Dedicated to Professor Kalyanmoy Deb)

Available from: 2023-01-19 Created: 2023-01-19 Last updated: 2023-09-01Bibliographically approved
6. A Modular Knowledge-Driven Mutation Operator for Reference-Point Based Evolutionary Algorithms
Open this publication in new window or tab >>A Modular Knowledge-Driven Mutation Operator for Reference-Point Based Evolutionary Algorithms
2022 (English)In: IEEE Congress of Evolutionary Computation, CEC - Conference Proceedings, IEEE, 2022Conference paper, Published paper (Refereed)
Abstract [en]

Although an entire frontier of Pareto-optimal solutions exists for multi-objective optimization problems, in practice, decision makers are often only interested in a small subset of these solutions, called the region of interest. Specialized optimizers, such as reference-point based evolutionary algorithms, exist that can focus the search to only find solutions inside this region of interest. These algorithms typically only modify the selection mechanism of regular multi-objective optimizers to preferentially select solutions that conform to the reference point. However, a more effective search may be performed by additionally modifying the variation mechanism of the optimizers, namely the crossover and the mutation operators, to preferentially generate solutions conforming to the reference point. In this paper, we propose a modular mutation operator that uses a recent knowledge discovery technique to first find decision rules unique to the preferred solutions in each generation. These rules are then used to build an empirical distribution in the decision space that can be sampled to generate new mutated solutions which are more likely to be closer to the preferred solutions. The operator is modular in the sense that it can be used with any existing reference-point based evolutionary algorithm by simply replacing the mutation operator. We incorporate the proposed knowledge-driven mutation operator into three such algorithms, and through benchmark test problems up to 10 objectives, demonstrate that their performance improves significantly in the majority of cases according to two different performance indicators. 

Place, publisher, year, edition, pages
IEEE, 2022
Keywords
Benchmarking, Decision making, Genetic algorithms, Image segmentation, Pareto principle, Modular knowledge, Modulars, Multi-objectives optimization, Mutation operators, Optimizers, Point-based, Preferred solutions, Reference points, Region-of-interest, Regions of interest, Multiobjective optimization, knowledge discovery, multi-objective optimization, mutation operator, reference point
National Category
Computer Sciences Computational Mathematics Other Computer and Information Science
Research subject
Production and Automation Engineering; VF-KDO
Identifiers
urn:nbn:se:his:diva-21917 (URN)10.1109/CEC55065.2022.9870268 (DOI)000859282000053 ()2-s2.0-85138691252 (Scopus ID)978-1-6654-6708-7 (ISBN)978-1-6654-6709-4 (ISBN)
Conference
2022 IEEE Congress on Evolutionary Computation, CEC 2022 - Conference Proceedings CEC 2022 Padua 18 July 2022 through 23 July 2022
Note

© 2022 IEEE.

Available from: 2022-10-06 Created: 2022-10-06 Last updated: 2023-09-01Bibliographically approved
7. Knowledge-Driven Multi-Objective Optimization Using Variable Importance
Open this publication in new window or tab >>Knowledge-Driven Multi-Objective Optimization Using Variable Importance
(English)Manuscript (preprint) (Other academic)
National Category
Computer Sciences Information Systems Software Engineering Computer Systems Computational Mathematics
Research subject
Virtual Production Development (VPD); VF-KDO
Identifiers
urn:nbn:se:his:diva-23155 (URN)
Note

2023

Available from: 2023-09-01 Created: 2023-09-01 Last updated: 2023-09-01Bibliographically approved

Open Access in DiVA

fulltext(31193 kB)682 downloads
File information
File name FULLTEXT01.pdfFile size 31193 kBChecksum SHA-512
8e513b88e532c12266a762940232081d7a16118d36e4e60d4ca7e4c4a8979f3a069ac1fcfc6a640e8afcc14592485766b0fb79dfdf7efe19b6ad1173fd6e6918
Type fulltextMimetype application/pdf

Authority records

Smedberg, Henrik

Search in DiVA

By author/editor
Smedberg, Henrik
By organisation
School of Engineering ScienceVirtual Engineering Research Environment
Computer SciencesInformation SystemsSoftware EngineeringComputer SystemsComputational Mathematics

Search outside of DiVA

GoogleGoogle Scholar
Total: 686 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1346 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf