中文
相关论文

相关论文: Softmax is not Enough (for Adaptive Conformal Clas…

200 篇论文

Conformal prediction constructs a set of labels instead of a single point prediction, while providing a probabilistic coverage guarantee. Beyond the coverage guarantee, adaptiveness to example difficulty is an important property. It means…

机器学习 · 计算机科学 2025-11-18 Sooyong Jang , Insup Lee

Modern software-defined networks, such as Open Radio Access Network (O-RAN) systems, rely on artificial intelligence (AI)-powered applications running on controllers interfaced with the radio access network. To ensure that these AI…

信号处理 · 电气工程与系统科学 2025-02-06 Seonghoon Yoo , Sangwoo Park , Petar Popovski , Joonhyuk Kang , Osvaldo Simeone

The black box nature of deep learning models complicate their usage in critical applications such as remote sensing. Conformal prediction is a method to ensure trust in such scenarios. Subject to data exchangeability, conformal prediction…

机器学习 · 计算机科学 2024-05-07 Protim Bhattacharjee , Peter Jung

Conformal Prediction (CP) is a distribution-free framework for constructing statistically rigorous prediction sets. While popular variants such as CD-split improve CP's efficiency, they often yield prediction sets composed of multiple…

机器学习 · 统计学 2025-09-29 Mingyi Zheng , Hongyu Jiang , Yizhou Lu , Jiaye Teng

In high-stakes scenarios, such as medical imaging applications, it is critical to equip the predictions of a regression model with reliable confidence intervals. Recently, Conformal Prediction (CP) has emerged as a powerful statistical…

机器学习 · 计算机科学 2025-09-19 Yahav Cohen , Jacob Goldberger , Tom Tirer

Meta-learning has demonstrated promising results in few-shot classification (FSC) by learning to solve new problems using prior knowledge. Bayesian methods are effective at characterizing uncertainty in FSC, which is crucial in high-risk…

机器学习 · 计算机科学 2024-10-14 Tianjun Ke , Haoqun Cao , Zenan Ling , Feng Zhou

Recently there has been a surge of interest to deploy confidence set predictions rather than point predictions in machine learning. Unfortunately, the effectiveness of such prediction sets is frequently impaired by distribution shifts in…

机器学习 · 计算机科学 2025-08-14 Kevin Kasa , Zhiyu Zhang , Heng Yang , Graham W. Taylor

While existing depression prediction methods based on deep learning show promise, their practical application is hindered by the lack of trustworthiness, as these deep models are often deployed as black box models, leaving us uncertain on…

机器学习 · 计算机科学 2024-08-28 Yonghong Li , Xiuzhuang Zhou

Conformal Prediction (CP) provides distribution-free uncertainty quantification by constructing prediction sets that guarantee coverage of the true labels. This reliability makes CP valuable for high-stakes federated learning scenarios such…

机器学习 · 计算机科学 2025-10-21 Rui Xu , Xingyuan Chen , Wenxing Huang , Minxuan Huang , Yun Xie , Weiyan Chen , Sihong Xie

Uncertainty quantification (UQ) is important to machine learning (ML) force fields to assess the level of confidence during prediction, as ML models are not inherently physical and can therefore yield catastrophically incorrect predictions.…

化学物理 · 物理学 2022-11-22 Yuge Hu , Joseph Musielewicz , Zachary Ulissi , Andrew J. Medford

Deploying trustworthy AI systems requires principled uncertainty quantification. Conformal prediction (CP) is a widely used framework for constructing prediction sets with distribution-free coverage guarantees. In many practical settings,…

机器学习 · 计算机科学 2026-03-18 Haifeng Wen , Osvaldo Simeone , Hong Xing

This paper addresses the problem of selective classification for deep neural networks, where a model is allowed to abstain from low-confidence predictions to avoid potential errors. We focus on so-called post-hoc methods, which replace the…

机器学习 · 计算机科学 2025-06-23 Luís Felipe P. Cattelan , Danilo Silva

Ensuring the reliability of automated decision-making based on neural networks will be crucial as Artificial Intelligence systems are deployed more widely in critical situations. This paper proposes a new approach for measuring confidence…

机器学习 · 计算机科学 2025-05-01 Daniel Sikar , Artur d'Avila Garcez , Tillman Weyde

Deep Learning predictions with measurable confidence are increasingly desirable for real-world problems, especially in high-risk settings. The Conformal Prediction (CP) framework is a versatile solution that guarantees a maximum error rate…

机器学习 · 计算机科学 2023-08-08 Julia A. Meister , Khuong An Nguyen , Stelios Kapetanakis , Zhiyuan Luo

Conformal prediction (CP) generates a set of predictions for a given test sample such that the prediction set almost always contains the true label (e.g., 99.5\% of the time). CP provides comprehensive predictions on possible labels of a…

机器学习 · 计算机科学 2023-09-12 Yizhe Zhang , Shuo Wang , Yejia Zhang , Danny Z. Chen

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Kalun Ho , Franz-Josef Pfreundt , Janis Keuper , Margret Keuper

Uncertainty quantification (UQ) in natural language generation (NLG) tasks remains an open challenge, exacerbated by the closed-source nature of the latest large language models (LLMs). This study investigates applying conformal prediction…

计算与语言 · 计算机科学 2024-11-19 Zhiyuan Wang , Jinhao Duan , Lu Cheng , Yue Zhang , Qingni Wang , Xiaoshuang Shi , Kaidi Xu , Hengtao Shen , Xiaofeng Zhu

Conformal prediction (CP) has emerged as a powerful tool in robotics and control, thanks to its ability to calibrate complex, data-driven models with formal guarantees. However, in robot navigation tasks, existing CP-based methods often…

机器人学 · 计算机科学 2025-04-02 Jaeuk Shin , Jungjin Lee , Insoon Yang

Adaptive Conformal Inference (ACI) provides finite-sample coverage guarantees, enhancing the prediction reliability under non-exchangeability. This study demonstrates that these desirable properties of ACI do not require the use of…

机器学习 · 统计学 2025-07-02 Johan Hallberg Szabadváry , Tuwe Löfström

In clinical applications, the utility of segmentation models is often based on the accuracy of derived downstream metrics such as organ size, rather than by the pixel-level accuracy of the segmentation masks themselves. Thus, uncertainty…

图像与视频处理 · 电气工程与系统科学 2026-03-03 Matt Y. Cheung , Ashok Veeraraghavan , Guha Balakrishnan