English
Related papers

Related papers: Great Models Think Alike: Improving Model Reliabil…

200 papers

Large Deep Learning models are often compressed before being deployed in a resource-constrained environment. Can we trust the prediction of compressed models just as we trust the prediction of the original large model? Existing work has…

Computation and Language · Computer Science 2025-08-20 Rohit Raj Rai , Chirag Kothari , Siddhesh Shelke , Amit Awekar

Calibration is commonly evaluated by comparing model confidence with its empirical correctness, implicitly treating reliability as a function of the confidence score alone. However, this view can hide substantial structure: models may be…

Machine Learning · Computer Science 2026-05-14 Katarzyna Kobalczyk , Mihaela van der Schaar

We study the understanding of deep neural networks from the scope in which they are trained on. While the accuracy of these models is usually impressive on the aggregate level, they still make mistakes, sometimes on cases that appear to be…

Machine Learning · Computer Science 2023-12-12 Roozbeh Yousefzadeh

To develop rigorous knowledge about ML models -- and the systems in which they are embedded -- we need reliable measurements. But reliable measurement is fundamentally challenging, and touches on issues of reproducibility, scalability,…

Machine Learning · Computer Science 2024-08-13 A. Feder Cooper

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Trustworthy machine learning is driving a large number of ML community works in order to improve ML acceptance and adoption. The main aspect of trustworthy machine learning are the followings: fairness, uncertainty, robustness,…

Machine Learning · Computer Science 2022-07-08 Gregory Scafarto , Nicolas Posocco , Antoine Bonnefoy

Systems design processes are increasingly reliant on simulation models to inform design decisions. A pervasive issue within the systems engineering community is trusting in the models used to make decisions about complex systems. This work…

Computational Engineering, Finance, and Science · Computer Science 2025-08-05 Edward Louis , Gregory Mocko , Evan Taylor

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Model checking is essential to evaluate the adequacy of statistical models and the validity of inferences drawn from them. Particularly, hierarchical models such as latent Gaussian models (LGMs) pose unique challenges as it is difficult to…

Methodology · Statistics 2023-07-25 Rafael Cabral , David Bolin , Håvard Rue

We introduce Harmonic Robustness, a powerful and intuitive method to test the robustness of any machine-learning model either during training or in black-box real-time inference monitoring without ground-truth labels. It is based on…

Machine Learning · Computer Science 2024-04-30 Nicholas S. Kersting , Yi Li , Aman Mohanty , Oyindamola Obisesan , Raphael Okochu

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, with different models excelling in distinct domains and specific abilities. Effectively combining the predictions of multiple LLMs is crucial for…

Computation and Language · Computer Science 2025-08-01 Jizhou Guo

The trustworthiness of Large Language Models (LLMs) refers to the extent to which their outputs are reliable, safe, and ethically aligned, and it has become a crucial consideration alongside their cognitive performance. In practice,…

Computation and Language · Computer Science 2024-12-24 Aaron J. Li , Satyapriya Krishna , Himabindu Lakkaraju

Machine learning-based Deepfake detection models have achieved impressive results on benchmark datasets, yet their performance often deteriorates significantly when evaluated on out-of-distribution data. In this work, we investigate an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haroon Wahab , Hassan Ugail , Lujain Jaleel

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems from game playing and robotics have been solved with deep model-free methods. Unfortunately, the sample…

Machine Learning · Computer Science 2021-07-20 Aske Plaat , Walter Kosters , Mike Preuss

Supervised deep learning models require significant amount of labeled data to achieve an acceptable performance on a specific task. However, when tested on unseen data, the models may not perform well. Therefore, the models need to be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Akshit Achara , Ram Krishna Pandey

We address the problem of finding reliable dense correspondences between a pair of images. This is a challenging task due to strong appearance differences between the corresponding scene elements and ambiguities generated by repetitive…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Ignacio Rocco , Mircea Cimpoi , Relja Arandjelović , Akihiko Torii , Tomas Pajdla , Josef Sivic

Deep learning has played a major role in the interpretation of dermoscopic images for detecting skin defects and abnormalities. However, current deep learning solutions for dermatological lesion analysis are typically limited in providing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Gun-Hee Lee , Han-Bin Ko , Seong-Whan Lee

As AI becomes more capable, we entrust it with more general and consequential tasks. The risks from failure grow more severe with increasing task scope. It is therefore important to understand how extremely capable AI models will fail: Will…

Artificial Intelligence · Computer Science 2026-04-13 Alexander Hägele , Aryo Pradipta Gema , Henry Sleight , Ethan Perez , Jascha Sohl-Dickstein

In this paper we study leveraging confidence information induced by adversarial training to reinforce adversarial robustness of a given adversarially trained model. A natural measure of confidence is $\|F({\bf x})\|_\infty$ (i.e. how…

Machine Learning · Computer Science 2018-10-16 Xi Wu , Uyeong Jang , Jiefeng Chen , Lingjiao Chen , Somesh Jha

Empirical research plays a fundamental role in the machine learning domain. At the heart of impactful empirical research lies the development of clear research hypotheses, which then shape the design of experiments. The execution of…

Machine Learning · Computer Science 2024-05-29 Daniel Vranješ , Oliver Niggemann