his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Challenges for IF performance evaluation in practice
University of Skövde, School of Humanities and Informatics. University of Skövde, The Informatics Research Centre.
2009 (English)In: Information Fusion, 2009. FUSION '09. 12th International Conference on, IEEE conference proceedings, 2009, 866-873 p.Conference paper, (Refereed)
Abstract [en]

This study presents a literature analysis of 52 publications on the topic of information fusion performance evaluation. The aim is to identify whether information fusion researchers are aware of the problematic nature of performance evaluation in practice, which is substantially different from performance evaluation in test environments. As expected, only 6% of the publications do actually report on studies conducted in practice, and therefore more such studies are needed. However, 58% of the publications do critically reflect on the problematic nature of performance evaluation in practice. As ground truth is lacking in practice, there is a need for (a set of) performance measures which are both comprehensive and adaptable to domain or situation context and changing circumstances over time. More studies need to address the overall question how multiple performance measures can function in concert and how exactly can be judged whether adaptation has been an improvement or not.

Place, publisher, year, edition, pages
IEEE conference proceedings, 2009. 866-873 p.
Keyword [en]
Performance evaluation, literature survey
National Category
Computer and Information Science
Research subject
Technology
Identifiers
URN: urn:nbn:se:his:diva-3459ISI: 000273560000112Scopus ID: 2-s2.0-70449387077ISBN: 978-0-9824-4380-4 OAI: oai:DiVA.org:his-3459DiVA: diva2:273194
Conference
12th International Conference on Information Fusion, FUSION 2009, Seattle, WA, United States, 6 July 2009 through 9 July 2009
Available from: 2009-10-20 Created: 2009-10-20 Last updated: 2016-02-09Bibliographically approved

Open Access in DiVA

No full text

Other links

Scopushttp://ieeexplore.ieee.org/Xplore/login.jsp?reload=true&url=http%3A%2F%2Fieeexplore.ieee.org%2Fiel5%2F5173445%2F5203583%2F05203752.pdf%3Farnumber%3D5203752&authDecision=-201

Search in DiVA

By author/editor
van Laere, Joeri
By organisation
School of Humanities and InformaticsThe Informatics Research Centre
Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar

Total: 751 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf