English
Related papers

Related papers: Making learning more transparent using conformaliz…

200 papers

Machine-specific optimizations command the machine to behave in a specific way. As current programming models largely leave machine details unexposed, they cannot accommodate direct encoding of such commands. In previous work we have…

Programming Languages · Computer Science 2018-03-30 Benjamin Andreassen Bjørnseth , Jan Christian Meyer , Lasse Natvig

Treatment effect estimation is essential for informed decision-making in many fields such as healthcare, economics, and public policy. While flexible machine learning models have been widely applied for estimating heterogeneous treatment…

Machine Learning · Computer Science 2025-09-29 Pascal Memmesheimer , Vincent Heuveline , Jürgen Hesser

This paper presents a transparent screening framework for estimating inference and training impacts of current large language models under limited observability. The framework converts natural-language application descriptions into bounded…

Machine Learning · Computer Science 2026-04-23 Arnault Pachot , Thierry Petit

Informed machine learning methods allow the integration of prior knowledge into learning systems. This can increase accuracy and robustness or reduce data needs. However, existing methods often assume hard constraining knowledge, that does…

Machine Learning · Computer Science 2024-10-10 Christian Schlauch , Nadja Klein , Christian Wirth

Machine learning systems are increasingly used to support public sector decision-making across a variety of sectors. Given concerns around accountability in these domains, and amidst accusations of intentional or unintentional bias, there…

Computers and Society · Computer Science 2018-11-06 Michael Veale

Striking an optimal balance between predictive performance and fairness continues to be a fundamental challenge in machine learning. In this work, we propose a post-processing framework that facilitates fairness-aware prediction by…

Machine Learning · Computer Science 2026-03-20 Zhouting Zhao , Tin Lok James Ng

As artificial intelligence systems increasingly inform high-stakes decisions across sectors, transparency has become foundational to responsible and trustworthy AI implementation. Leveraging our role as a leading institute in advancing AI…

Machine Learning · Computer Science 2025-08-01 Dhanesh Ramachandram , Himanshu Joshi , Judy Zhu , Dhari Gandhi , Lucas Hartman , Ananya Raval

Machine learning systems are increasingly used to make decisions about people's lives, such as whether to give someone a loan or whether to interview someone for a job. This has led to considerable interest in making such machine learning…

Machine Learning · Computer Science 2017-10-13 Daniel McNamara , Cheng Soon Ong , Robert C. Williamson

Conformal prediction has emerged as a widely used framework for constructing valid prediction sets in classification and regression tasks. In this work, we extend the split conformal prediction framework to hierarchical classification,…

Machine Learning · Statistics 2026-04-13 Thomas Mortier , Alireza Javanmardi , Yusuf Sale , Eyke Hüllermeier , Willem Waegeman

Interest has been growing in decision-focused machine learning methods which train models to account for how their predictions are used in downstream optimization problems. Doing so can often improve performance on subsequent decision…

Machine Learning · Computer Science 2025-03-03 Santiago Cortes-Gomez , Carlos Patiño , Yewon Byun , Steven Wu , Eric Horvitz , Bryan Wilder

Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-probabilistic…

Machine Learning · Statistics 2024-11-27 Eshant English , Christoph Lippert

Meta-learning is used to efficiently enable the automatic selection of machine learning models by combining data and prior knowledge. Since the traditional meta-learning technique lacks explainability, as well as shortcomings in terms of…

Machine Learning · Computer Science 2022-06-14 Xinyue Shao , Hongzhi Wang , Xiao Zhu , Feng Xiong

Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model…

Methodology · Statistics 2023-03-20 Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas , Ryan J. Tibshirani

Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels that are guaranteed to contain the true label with high…

Machine Learning · Computer Science 2025-03-11 Botong Zhang , Shuo Li , Osbert Bastani

We propose a novel training regime termed counterfactual training that leverages counterfactual explanations to increase the explanatory capacity of models. Counterfactual explanations have emerged as a popular post-hoc explanation method…

Machine Learning · Computer Science 2026-01-23 Patrick Altmeyer , Aleksander Buszydlik , Arie van Deursen , Cynthia C. S. Liem

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Black-box machine learning models are now routinely used in high-risk settings, like medical diagnostics, which demand uncertainty quantification to avoid consequential model failures. Conformal prediction is a user-friendly paradigm for…

Machine Learning · Computer Science 2022-12-08 Anastasios N. Angelopoulos , Stephen Bates

While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although research efforts…

Machine Learning · Computer Science 2022-12-08 Yuying Zhao , Yu Wang , Tyler Derr

Classical machine learning classifiers tend to be overconfident can be unreliable outside of the laboratory benchmarks. Properly assessing the reliability of the output of the model per sample is instrumental for real-life scenarios where…

Artificial Intelligence · Computer Science 2025-11-07 Javier Fumanal-Idocin , Javier Andreu-Perez

Deep neural networks exhibit remarkable performance, yet their black-box nature limits their utility in fields like healthcare where interpretability is crucial. Existing explainability approaches often sacrifice accuracy and lack…

Machine Learning · Computer Science 2025-04-08 Linhui Huang , Sayeri Lala , Niraj K. Jha