English
Related papers

Related papers: Interpretable Failure Detection with Human-Level C…

200 papers

Semantic noise in image classification datasets, where visually similar categories are frequently mislabeled, poses a significant challenge to conventional supervised learning approaches. In this paper, we explore the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yingxuan Li , Jiafeng Mao , Yusuke Matsui

Confidence-aware learning is proven as an effective solution to prevent networks becoming overconfident. We present a confidence-aware camouflaged object detection framework using dynamic supervision to produce both accurate camouflage map…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Jiawei Liu , Jing Zhang , Nick Barnes

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

Machine Learning · Computer Science 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

The interpretation of deep neural networks (DNNs) has become a key topic as more and more people apply them to solve various problems and making critical decisions. Concept-based explanations have recently become a popular approach for…

Human-Computer Interaction · Computer Science 2021-08-10 Zhenge Zhao , Panpan Xu , Carlos Scheidegger , Liu Ren

As robotic systems become increasingly integrated into real-world environments, ranging from autonomous vehicles to household assistants, they inevitably encounter diverse and unstructured scenarios that lead to failures. While such…

Robotics · Computer Science 2026-03-10 Aryaman Gupta , Yusuf Umut Ciftci , Somil Bansal

The crux of label-efficient semantic segmentation is to produce high-quality pseudo-labels to leverage a large amount of unlabeled or weakly labeled data. A common practice is to select the highly confident predictions as the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Haochen Wang , Yuchao Wang , Yujun Shen , Junsong Fan , Yuxi Wang , Zhaoxiang Zhang

Confidence estimates are often "detection-like" - driven by positive evidence in favour of a decision. This empirical observation has been interpreted as showing that human metacognition is limited by biases or heuristics. Here, we show…

Neurons and Cognition · Quantitative Biology 2026-05-11 Wiktoria Kozyra , Kevin O'Neill , Stephen M. Fleming

A cornerstone of machine learning evaluation is the (often hidden) assumption that model and human responses are reliable enough to evaluate models against unitary, authoritative, ``gold standard'' data, via simple metrics such as accuracy,…

Machine Learning · Computer Science 2026-01-30 Christopher Homan , Flip Korn , Deepak Pandita , Chris Welty

Data-driven methods have achieved notable performance on intent detection, which is a task to comprehend user queries. Nonetheless, they are controversial for over-confident predictions. In some scenarios, users do not only care about the…

Computation and Language · Computer Science 2022-03-18 Yantao Gong , Cao Liu , Fan Yang , Xunliang Cai , Guanglu Wan , Jiansong Chen , Weipeng Zhang , Houfeng Wang

The highest accuracy object detectors to date are based on a two-stage approach popularized by R-CNN, where a classifier is applied to a sparse set of candidate object locations. In contrast, one-stage detectors that are applied over a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Tsung-Yi Lin , Priya Goyal , Ross Girshick , Kaiming He , Piotr Dollár

Interpretability is crucial for ensuring RL systems align with human values. However, it remains challenging to achieve in complex decision making domains. Existing methods frequently attempt interpretability at the level of fundamental…

Machine Learning · Computer Science 2025-06-03 Anna Soligo , Pietro Ferraro , David Boyle

Credibility signals represent a wide range of heuristics typically used by journalists and fact-checkers to assess the veracity of online content. Automating the extraction of credibility signals presents significant challenges due to the…

Computation and Language · Computer Science 2024-11-06 João A. Leite , Olesya Razuvayevskaya , Kalina Bontcheva , Carolina Scarton

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

Flaky tests can pass or fail non-deterministically, without alterations to a software system. Such tests are frequently encountered by developers and hinder the credibility of test suites. State-of-the-art research incorporates machine…

Software Engineering · Computer Science 2024-03-05 Shizhe Lin , Ryan Zheng He Liu , Ladan Tahvildari

Recent work has identified noisy and misannotated data as a core cause of hallucinations and unfaithful outputs in Natural Language Generation (NLG) tasks. Consequently, identifying and removing these examples is a key open challenge in…

Computation and Language · Computer Science 2023-07-12 Faisal Ladhak , Esin Durmus , Tatsunori Hashimoto

State-of-the-art NLP methods achieve human-like performance on many tasks, but make errors nevertheless. Characterizing these errors in easily interpretable terms gives insight into whether a classifier is prone to making systematic errors,…

Computation and Language · Computer Science 2023-11-21 Michael A. Hedderich , Jonas Fischer , Dietrich Klakow , Jilles Vreeken

Recent advancements in post-hoc and inherently interpretable methods have markedly enhanced the explanations of black box classifier models. These methods operate either through post-analysis or by integrating concept learning during model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Bor-Shiun Wang , Chien-Yi Wang , Wei-Chen Chiu

Suicide rates have risen worldwide in recent years, underscoring the urgent need for proactive prevention strategies. Social media provides valuable signals, as many at-risk individuals - who often avoid formal help due to stigma - choose…

Computation and Language · Computer Science 2025-10-10 Yukai Song , Pengfei Zhou , César Escobar-Viera , Candice Biernesser , Wei Huang , Jingtong Hu

Intensive testing using model-based approaches is the standard way of demonstrating the correctness of automotive software. Unfortunately, state-of-the-art techniques leave a crucial and labor intensive task to the test engineer:…

Software Engineering · Computer Science 2022-12-16 Mike Becker , Roland Meyer , Tobias Runge , Ina Schaefer , Sören van der Wall , Sebastian Wolff