English
Related papers

Related papers: Beyond Accuracy: Ensuring Correct Predictions With…

200 papers

Pretraining with expert demonstrations have been found useful in speeding up the training process of deep reinforcement learning algorithms since less online simulation data is required. Some people use supervised learning to speed up the…

Artificial Intelligence · Computer Science 2018-02-12 Xiaoqin Zhang , Huimin Ma

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

In the era of increasingly complex AI models for time series forecasting, progress is often measured by marginal improvements on benchmark leaderboards. However, this approach suffers from a fundamental flaw: standard evaluation metrics…

Machine Learning · Computer Science 2026-05-28 Wanjin Feng , Yuan Yuan , Jingtao Ding , Yong Li

Physical reasoning requires forward prediction: the ability to forecast what will happen next given some initial world state. We study the performance of state-of-the-art forward-prediction models in the complex physical-reasoning tasks of…

Machine Learning · Computer Science 2021-03-31 Rohit Girdhar , Laura Gustafson , Aaron Adcock , Laurens van der Maaten

While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although research efforts…

Machine Learning · Computer Science 2022-12-08 Yuying Zhao , Yu Wang , Tyler Derr

Deep learning crime predictive tools use past crime data and additional behavioral datasets to forecast future crimes. Nevertheless, these tools have been shown to suffer from unfair predictions across minority racial and ethnic groups.…

Computers and Society · Computer Science 2024-06-14 Jiahui Wu , Vanessa Frias-Martinez

Machine learning models achieve state-of-the-art performance on many supervised learning tasks. However, prior evidence suggests that these models may learn to rely on shortcut biases or spurious correlations (intuitively, correlations that…

Machine Learning · Computer Science 2021-08-31 Sindhu C. M. Gowda , Shalmali Joshi , Haoran Zhang , Marzyeh Ghassemi

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

Multistage stochastic programming provides a modeling framework for sequential decision-making problems that involve uncertainty. One typically overlooked aspect of this methodology is how uncertainty is incorporated into modeling.…

Optimization and Control · Mathematics 2021-09-24 Juyoung Wang , Mucahit Cevik , Merve Bodur

Explaining the predictions of AI models is paramount in safety-critical applications, such as in legal or medical domains. One form of explanation for a prediction is an extractive rationale, i.e., a subset of features of an instance that…

Computation and Language · Computer Science 2020-12-21 Lei Sha , Oana-Maria Camburu , Thomas Lukasiewicz

Devising efficient algorithms to solve continuously-varying strongly convex optimization programs is key in many applications, from control systems to signal processing and machine learning. In this context, solving means to find and track…

Optimization and Control · Mathematics 2020-01-09 Andrea Simonetto

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

Current multi-modal models exhibit a notable misalignment with the human visual system when identifying objects that are visually assimilated into the background. Our observations reveal that these multi-modal models cannot distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ruolin Shen , Xiaozhong Ji , Kai WU , Jiangning Zhang , Yijun He , HaiHua Yang , Xiaobin Hu , Xiaoyu Sun

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

Within the last few years, there has been a move towards using statistical models in conjunction with neural networks with the end goal of being able to better answer the question, "what do our models know?". From this trend, classical…

Machine Learning · Computer Science 2021-12-03 Achintya Gopal

Deep learning is a topic of considerable current interest. The availability of massive data collections and powerful software resources has led to an impressive amount of results in many application areas that reveal essential but hidden…

Machine Learning · Computer Science 2023-01-31 Gianluigi Pillonetto , Aleksandr Aravkin , Daniel Gedon , Lennart Ljung , Antônio H. Ribeiro , Thomas B. Schön

Dealing with uncertainty is essential for efficient reinforcement learning. There is a growing literature on uncertainty estimation for deep learning from fixed datasets, but many of the most popular approaches are poorly-suited to…

Machine Learning · Statistics 2018-11-16 Ian Osband , John Aslanides , Albin Cassirer

Automated mental health prediction using textual data has shown promising results with deep learning and large language models. However, deploying these models in high-stakes real-world settings remains challenging, as existing approaches…

Computation and Language · Computer Science 2026-05-07 Yucheng Ruan , Ling Huang , Qika Lin , Kai He , Mengling Feng

An important feature of pervasive, intelligent assistance systems is the ability to dynamically adapt to the current needs of their users. Hence, it is critical for such systems to be able to recognize those goals and needs based on…

Artificial Intelligence · Computer Science 2023-01-16 Nils Wilken , Lea Cohausz , Johannes Schaum , Stefan Lüdtke , Heiner Stuckenschmidt