English
Related papers

Related papers: Temperature Scaling Attack Disrupting Model Confid…

200 papers

Reliable confidence estimation for the predictions is important in many safety-critical applications. However, modern deep neural networks are often overconfident for their incorrect predictions. Recently, many calibration methods have been…

Machine Learning · Computer Science 2023-03-07 Fei Zhu , Zhen Cheng , Xu-Yao Zhang , Cheng-Lin Liu

The rapid increase in remote sensing satellites has led to the emergence of distributed space-based observation systems. However, existing distributed remote sensing models often rely on centralized training, resulting in data leakage,…

Machine Learning · Computer Science 2025-04-08 Xiaohe Li , Haohua Wu , Jiahao Li , Zide Fan , Kaixin Zhang , Xinming Li , Yunping Ge , Xinyu Zhao

Confidence calibration -- the problem of predicting probability estimates representative of the true correctness likelihood -- is important for classification models in many applications. We discover that modern neural networks, unlike…

Machine Learning · Computer Science 2017-08-04 Chuan Guo , Geoff Pleiss , Yu Sun , Kilian Q. Weinberger

The main premise of federated learning (FL) is that machine learning model updates are computed locally to preserve user data privacy. This approach avoids by design user data to ever leave the perimeter of their device. Once the updates…

Machine Learning · Computer Science 2023-09-15 Simon Queyrut , Valerio Schiavoni , Pascal Felber

Post-training of large language models is essential for adapting pre-trained language models (PLMs) to align with human preferences and downstream tasks. While PLMs typically exhibit well-calibrated confidence, post-trained language models…

Machine Learning · Computer Science 2025-11-26 Beier Luo , Shuoyuan Wang , Sharon Li , Hongxin Wei

Deep learning models have demonstrated exceptional performance across a wide range of computer vision tasks. However, their performance often degrades significantly when faced with distribution shifts, such as domain or dataset changes.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Samuel Barbeau , Pedram Fekri , David Osowiechi , Ali Bahri , Moslem Yazdanpanah , Masih Aminbeidokhti , Christian Desrosiers

The main premise of federated learning is that machine learning model updates are computed locally, in particular to preserve user data privacy, as those never leave the perimeter of their device. This mechanism supposes the general model,…

Machine Learning · Computer Science 2023-08-09 Simon Queyrut , Yérom-David Bromberg , Valerio Schiavoni

Federated learning is a technique that allows multiple entities to collaboratively train models using their data without compromising data privacy. However, despite its advantages, federated learning can be susceptible to false data…

Machine Learning · Computer Science 2024-01-17 Or Shalom , Amir Leshem , Waheed U. Bajwa

With extensive studies on backdoor attack and detection, still fundamental questions are left unanswered regarding the limits in the adversary's capability to attack and the defender's capability to detect. We believe that answers to these…

Cryptography and Security · Computer Science 2022-10-14 Di Tang , Rui Zhu , XiaoFeng Wang , Haixu Tang , Yi Chen

Beyond assigning the correct class, an activity recognition model should also be able to determine, how certain it is in its predictions. We present the first study of how welthe confidence values of modern action recognition architectures…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Alina Roitberg , Monica Haurilet , Manuel Martinez , Rainer Stiefelhagen

The effectiveness of large language models (LLMs) is not only measured by their ability to generate accurate outputs but also by their calibration-how well their confidence scores reflect the probability of their outputs being correct.…

Machine Learning · Computer Science 2024-10-01 Johnathan Xie , Annie S. Chen , Yoonho Lee , Eric Mitchell , Chelsea Finn

Deep Neural Networks have significantly impacted many computer vision tasks. However, their effectiveness diminishes when test data distribution (target domain) deviates from the one of training data (source domain). In situations where…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Andrea Maracani , Lorenzo Rosasco , Lorenzo Natale

Current backdoor attacks against federated learning (FL) strongly rely on universal triggers or semantic patterns, which can be easily detected and filtered by certain defense mechanisms such as norm clipping, comparing parameter…

Machine Learning · Computer Science 2023-10-02 Yanqi Qiao , Dazhuang Liu , Congwen Chen , Rui Wang , Kaitai Liang

We introduce a framework for calibrating machine learning models so that their predictions satisfy explicit, finite-sample statistical guarantees. Our calibration algorithms work with any underlying model and (unknown) data-generating…

Machine Learning · Computer Science 2022-10-03 Anastasios N. Angelopoulos , Stephen Bates , Emmanuel J. Candès , Michael I. Jordan , Lihua Lei

Thomson scattering (TS) diagnostics provide reliable, minimally perturbative measurements of fundamental plasma parameters, such as electron density ($n_e$) and electron temperature ($T_e$). Deep neural networks can provide accurate…

Recently, test-time adaptation (TTA) has been proposed as a promising solution for addressing distribution shifts. It allows a base model to adapt to an unforeseen distribution during inference by leveraging the information from the batch…

Machine Learning · Computer Science 2023-02-07 Tong Wu , Feiran Jia , Xiangyu Qi , Jiachen T. Wang , Vikash Sehwag , Saeed Mahloujifar , Prateek Mittal

Spatio-temporal forecasting is crucial in many domains, such as transportation, meteorology, and energy. However, real-world scenarios frequently present challenges such as signal anomalies, noise, and distributional shifts. Existing…

Machine Learning · Computer Science 2025-10-30 Wei Chen , Yuxuan Liang

Federated Learning (FL) has emerged as a leading paradigm for privacy-preserving distributed machine learning, yet the distributed nature of FL introduces unique security challenges, notably the threat of backdoor attacks. Existing backdoor…

Cryptography and Security · Computer Science 2025-06-27 Chengcheng Zhu , Ye Li , Bosen Rao , Jiale Zhang , Yunlong Mao , Sheng Zhong

Federated learning performs distributed model training using local data hosted by agents. It shares only model parameter updates for iterative aggregation at the server. Although it is privacy-preserving by design, federated learning is…

Machine Learning · Computer Science 2019-05-09 Yufei Han , Xiangliang Zhang

As a consequence of the high variability of load demand and renewable generation, long-term and high-resolution inputs are required for power system expansion planning, making the problem intractable in real-world applications. Time series…

Optimization and Control · Mathematics 2025-10-29 Ruiqi Zhang , Ensieh Sharifnia , Simon H. Tindemans