English
Related papers

Related papers: Classification with Conceptual Safeguards

200 papers

This paper provides both an introduction to and a detailed overview of the principles and practice of classifier calibration. A well-calibrated classifier correctly quantifies the level of uncertainty or confidence associated with its…

Machine Learning · Computer Science 2023-06-16 Telmo Silva Filho , Hao Song , Miquel Perello-Nieto , Raul Santos-Rodriguez , Meelis Kull , Peter Flach

Uncertainty in machine learning refers to the degree of confidence or lack thereof in a model's predictions. While uncertainty quantification methods exist, explanations of uncertainty, especially in high-dimensional settings, remain an…

Machine Learning · Computer Science 2025-07-30 Isaac Roberts , Alexander Schulz , Sarah Schroeder , Fabian Hinder , Barbara Hammer

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

Currently, various uncertainty quantification methods have been proposed to provide certainty and probability estimates for deep learning models' label predictions. Meanwhile, with the growing demand for the right to be forgotten, machine…

Machine Learning · Computer Science 2025-08-12 Wei Qian , Chenxu Zhao , Yangyi Li , Wenqian Ye , Mengdi Huai

Large-scale machine learning models deliver strong performance across a wide range of tasks but come with significant computational and resource constraints. To mitigate these challenges, local smaller models are often deployed alongside…

Many applications of classification methods not only require high accuracy but also reliable estimation of predictive uncertainty. However, while many current classification frameworks, in particular deep neural networks, achieve high…

Machine Learning · Computer Science 2020-02-28 Jonathan Wenger , Hedvig Kjellström , Rudolph Triebel

Though black-box predictors are state-of-the-art for many complex tasks, they often fail to properly quantify predictive uncertainty and may provide inappropriate predictions for unfamiliar data. Instead, we can learn more reliable models…

Machine Learning · Statistics 2021-12-14 Jean Feng , Arjun Sondhi , Jessica Perry , Noah Simon

Reliable failure detection holds paramount importance in safety-critical applications. Yet, neural networks are known to produce overconfident predictions for misclassified samples. As a result, it remains a problematic matter as existing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Kien X. Nguyen , Tang Li , Xi Peng

In this paper we propose a formal, model-agnostic meta-learning framework for safe reinforcement learning. Our framework is inspired by how parents safeguard their children across a progression of increasingly riskier tasks, imparting a…

Machine Learning · Computer Science 2024-11-01 Nabil Omi , Hosein Hasanbeig , Hiteshi Sharma , Sriram K. Rajamani , Siddhartha Sen

Classifiers learnt from data are increasingly being used as components in systems where safety is a critical concern. In this work, we present a formal notion of safety for classifiers via constraints called safe-ordering constraints. These…

Machine Learning · Computer Science 2022-06-13 Klas Leino , Aymeric Fromherz , Ravi Mangal , Matt Fredrikson , Bryan Parno , Corina Păsăreanu

We introduce ConceptVision, a method that aims for high accuracy in categorizing large number of scenes, while keeping the model relatively simpler and efficient for scalability. The proposed method combines the advantages of both low-level…

Computer Vision and Pattern Recognition · Computer Science 2014-10-31 Ahmet Iscen , Eren Golge , Ilker Sarac , Pinar Duygulu

Probabilistic conceptual network is a knowledge representation scheme designed for reasoning about concepts and categorical abstractions in utility-based categorization. The scheme combines the formalisms of abstraction and inheritance…

Artificial Intelligence · Computer Science 2013-03-08 Kim-Leng Poh , Michael R. Fehling

Concept-based Models aim to improve interpretability by predicting high-level intermediate concepts, representing a promising approach for deployment in high-risk scenarios. However, they are known to suffer from information leakage,…

Machine Learning · Computer Science 2026-03-25 Enrico Parisini , Tapabrata Chakraborti , Chris Harbron , Ben D. MacArthur , Christopher R. S. Banerji

Concept probing has recently garnered increasing interest as a way to help interpret artificial neural networks, dealing both with their typically large size and their subsymbolic nature, which ultimately renders them unfeasible for direct…

Artificial Intelligence · Computer Science 2025-07-25 Manuel de Sousa Ribeiro , Afonso Leote , João Leite

Machine learning models that incorporate concept learning as an intermediate step in their decision making process can match the performance of black-box predictive models while retaining the ability to explain outcomes in human…

Machine Learning · Computer Science 2021-06-28 Anita Mahinpei , Justin Clark , Isaac Lage , Finale Doshi-Velez , Weiwei Pan

Unbiased confidence estimates of neural networks are crucial especially for safety-critical applications. Many methods have been developed to calibrate biased confidence estimates. Though there is a variety of methods for classification,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Fabian Küppers , Jan Kronenberger , Amirhossein Shantia , Anselm Haselhoff

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their…

Machine Learning · Computer Science 2019-02-20 Juozas Vaicenavicius , David Widmann , Carl Andersson , Fredrik Lindsten , Jacob Roll , Thomas B. Schön

The discriminative approach to classification using deep neural networks has become the de-facto standard in various fields. Complementing recent reservations about safety against adversarial examples, we show that conventional…

Machine Learning · Computer Science 2018-07-25 William Wang , Angelina Wang , Aviv Tamar , Xi Chen , Pieter Abbeel

Learning concepts that are consistent with human perception is important for Deep Neural Networks to win end-user trust. Post-hoc interpretation methods lack transparency in the feature representations learned by the models. This work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

We address the problem of concept removal in deep neural networks, aiming to learn representations that do not encode certain specified concepts (e.g., gender etc.) We propose a novel method based on adversarial linear classifiers trained…

Machine Learning · Computer Science 2023-10-10 Yegor Klochkov , Jean-Francois Ton , Ruocheng Guo , Yang Liu , Hang Li