Counterfactual Explanations for Conformal Prediction Sets
2025 (English) In: Fourteenth Symposium on Conformal and Probabilistic Prediction with Applications (COPA 2025), 10-12 September 2025, Royal Holloway, London, UK / [ed] Khuong An Nguyen; Zhiyuan Luo; Harris Papadopoulos; Tuwe Löfström; Lars Carlsson; Henrik Boström, ML Research Press , 2025, p. 405-424Conference paper, Published paper (Refereed)
Abstract [en]
Conformal classification outputs prediction sets with formal guarantees, making it suitable for uncertainty-aware decision support. However, explaining such prediction sets remains an open challenge, as most existing explanation methods, including counterfactual ones, are tailored to point predictions. In this paper, we introduce a novel form of counterfactual explanations for conformal classifiers. These counterfactuals identify minimal changes that modify the conformal prediction set at a fixed significance level, thereby explaining how and why certain classes are included or excluded. To guide the generation of informative counterfactuals, we consider proximity, sparsity, and plausibility. While proximity and sparsity are commonly used in the literature, we introduce credibility as a new measure of how well a counterfactual conforms to the underlying data distribution, and hence its plausibility. We empirically evaluate our method across multiple tabular datasets and optimization criteria. The findings demonstrate the potential of using counterfactual explanations for conformal classification as informative and trustworthy explanations for conformal prediction sets.
Place, publisher, year, edition, pages ML Research Press , 2025. p. 405-424
Series
Proceedings of Machine Learning Research, E-ISSN 2640-3498 ; 266
Keywords [en]
Conformal prediction, Counterfactual explanations, Explainable AI (XAI), Artificial intelligence, Classification (of information), Conformal predictions, Counterfactual explanation, Counterfactuals, Data distribution, Decision supports, Optimization criteria, Significance levels, Uncertainty, Forecasting
National Category
Computer Sciences
Research subject Interaction Lab (ILAB)
Identifiers URN: urn:nbn:se:his:diva-25798 ISI: 001595063100021 Scopus ID: 2-s2.0-105013958881 OAI: oai:DiVA.org:his-25798 DiVA, id: diva2:1994974
Conference 14th Symposium on Conformal and Probabilistic Prediction with Applications, COPA 2025, 10-12 September 2025, Royal Holloway, London, UK
Note © 2025 A. Maalej, C. Sönströd & U. Johansson
2025-09-042025-09-042026-05-21 Bibliographically approved