中文
相关论文

相关论文: The Over-Certainty Phenomenon in Modern Test-Time …

200 篇论文

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

机器学习 · 计算机科学 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

As machine learning techniques become widely adopted in new domains, especially in safety-critical systems such as autonomous vehicles, it is crucial to provide accurate output uncertainty estimation. As a result, many approaches have been…

机器学习 · 计算机科学 2021-12-28 Sooyong Jang , Radoslav Ivanov , Insup Lee , James Weimer

We address the issue of safe optimal path planning under parametric uncertainties using a novel regularizer that allows trading off optimality with safety. The proposed regularizer leverages the notion that collisions may be modeled as…

Modern machine learning models with high accuracy are often miscalibrated -- the predicted top probability does not reflect the actual accuracy, and tends to be over-confident. It is commonly believed that such over-confidence is mainly due…

机器学习 · 计算机科学 2021-07-21 Yu Bai , Song Mei , Huan Wang , Caiming Xiong

Deep neural networks possess strong representational capacity yet remain vulnerable to overfitting, primarily because neurons tend to co-adapt in ways that, while capturing complex and fine-grained feature interactions, also reinforce…

机器学习 · 计算机科学 2025-12-16 Gelesh G Omathil , Sreeja CS

We introduce a framework for calibrating machine learning models so that their predictions satisfy explicit, finite-sample statistical guarantees. Our calibration algorithms work with any underlying model and (unknown) data-generating…

机器学习 · 计算机科学 2022-10-03 Anastasios N. Angelopoulos , Stephen Bates , Emmanuel J. Candès , Michael I. Jordan , Lihua Lei

Since neural classifiers are known to be sensitive to adversarial perturbations that alter their accuracy, \textit{certification methods} have been developed to provide provable guarantees on the insensitivity of their predictions to such…

机器学习 · 计算机科学 2025-02-26 Cornelius Emde , Francesco Pinto , Thomas Lukasiewicz , Philip H. S. Torr , Adel Bibi

Deep neural networks (DNNs) often suffer from the overconfidence issue, where incorrect predictions are made with high confidence scores, hindering the applications in critical systems. In this paper, we propose a novel approach called…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Yijun Liu , Jiequan Cui , Zhuotao Tian , Senqiao Yang , Qingdong He , Xiaoling Wang , Jingyong Su

Data samples generated by several real world processes are dynamic in nature \textit{i.e.}, their characteristics vary with time. Thus it is not possible to train and tackle all possible distributional shifts between training and inference,…

机器学习 · 计算机科学 2021-10-22 Prabhu Teja Sivaprasad , François Fleuret

Nowadays, sensors play a major role in several contexts like science, industry and daily life which benefit of their use. However, the retrieved information must be reliable. Anomalies in the behavior of sensors can give rise to critical…

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

机器学习 · 计算机科学 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

We consider the problem of uncertainty quantification in high dimensional regression and classification for which deep ensemble have proven to be promising methods. Recent observations have shown that deep ensemble often return…

机器学习 · 计算机科学 2023-04-11 Antoine de Mathelin , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

With the growing attention on learning-to-learn new tasks using only a few examples, meta-learning has been widely used in numerous problems such as few-shot classification, reinforcement learning, and domain generalization. However,…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Hung-Yu Tseng , Yi-Wen Chen , Yi-Hsuan Tsai , Sifei Liu , Yen-Yu Lin , Ming-Hsuan Yang

Test-time Adaptation (TTA) aims to improve model performance when the model encounters domain changes after deployment. The standard TTA mainly considers the case where the target domain is static, while the continual TTA needs to undergo a…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Xinru Meng , Han Sun , Jiamei Liu , Ningzhong Liu , Huiyu Zhou

Deep learning (DL) has recently attracted increasing interest to improve object type classification for automotive radar.In addition to high accuracy, it is crucial for decision making in autonomous vehicles to evaluate the reliability of…

机器学习 · 计算机科学 2021-06-11 Kanil Patel , William Beluch , Kilian Rambach , Adriana-Eliza Cozma , Michael Pfeiffer , Bin Yang

The combination of deep neural nets and theory-driven models, which we call deep grey-box modeling, can be inherently interpretable to some extent thanks to the theory backbone. Deep grey-box models are usually learned with a regularized…

机器学习 · 计算机科学 2022-10-25 Naoya Takeishi , Alexandros Kalousis

Machine learning can significantly improve performance for decision-making under uncertainty across a wide range of domains. However, ensuring robustness guarantees requires well-calibrated uncertainty estimates, which can be difficult to…

机器学习 · 计算机科学 2026-02-03 Christopher Yeh , Nicolas Christianson , Alan Wu , Adam Wierman , Yisong Yue

Preference tuning aligns pretrained language models to human judgments of quality, helpfulness, or safety by optimizing over explicit preference signals rather than likelihood alone. Prior work has shown that preference-tuning degrades…

计算与语言 · 计算机科学 2026-01-12 Constantinos Karouzos , Xingwei Tan , Nikolaos Aletras

Time series forecasting has become a critical task due to its high practicality in real-world applications such as traffic, energy consumption, economics and finance, and disease analysis. Recent deep-learning-based approaches have shown…

机器学习 · 计算机科学 2023-05-30 Youngin Cho , Daejin Kim , Dongmin Kim , Mohammad Azam Khan , Jaegul Choo

Deep neural networks have demonstrated impressive performance in various machine learning tasks. However, they are notoriously sensitive to changes in data distribution. Often, even a slight change in the distribution can lead to drastic…

计算机视觉与模式识别 · 计算机科学 2018-11-16 Alon Hazan , Yoel Shoshan , Daniel Khapun , Roy Aladjem , Vadim Ratner