English
Related papers

Related papers: A Framework for Improving the Reliability of Black…

200 papers

Modern neural network architectures have achieved remarkable accuracies but remain highly dependent on their training data, often lacking interpretability in their learned mappings. While effective on large datasets, they tend to overfit on…

Machine Learning · Computer Science 2025-03-19 Pavia Bera , Sanjukta Bhanja

Simulation-Based Inference (SBI) is an approach to statistical inference where simulations from an assumed model are used to construct estimators and confidence sets. SBI is often used when the likelihood is intractable and to construct…

Methodology · Statistics 2025-08-05 Lorenzo Tomaselli , Valérie Ventura , Larry Wasserman

Existing studies in black-box optimization for machine learning suffer from low generalizability, caused by a typically selective choice of problem instances used for training and testing different optimization algorithms. Among other…

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

Latent variable time-series models are among the most heavily used tools from machine learning and applied statistics. These models have the advantage of learning latent structure both from noisy observations and from the temporal ordering…

Machine Learning · Statistics 2015-11-24 Evan Archer , Il Memming Park , Lars Buesing , John Cunningham , Liam Paninski

Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it…

Machine Learning · Computer Science 2024-01-24 Sebastian W. Ober

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

In this work, we propose a self-improving artificial intelligence system to enhance the safety performance of reinforcement learning (RL)-based autonomous driving (AD) agents using black-box verification methods. RL algorithms have become…

Artificial Intelligence · Computer Science 2025-07-21 Resul Dagdanov , Halil Durmus , Nazim Kemal Ure

The goal of selective prediction is to allow an a model to abstain when it may not be able to deliver a reliable prediction, which is important in safety-critical contexts. Existing approaches to selective prediction typically require…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Zaid Khan , Yun Fu

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model…

Methodology · Statistics 2024-09-05 Luca Maestrini , Robert G. Aykroyd , Matt P. Wand

With the advancements of computer architectures, the use of computational models proliferates to solve complex problems in many scientific applications such as nuclear physics and climate research. However, the potential of such models is…

Computation · Statistics 2021-07-05 Vojtech Kejzlar , Tapabrata Maiti

In this paper, we develop a stochastic set-valued optimization (SVO) framework tailored for robust machine learning. In the SVO setting, each decision variable is mapped to a set of objective values, and optimality is defined via set…

Optimization and Control · Mathematics 2026-03-19 Tommaso Giovannelli , Jingfu Tan , Luis Nunes Vicente

This paper introduces a variational approximation framework using direct optimization of what is known as the {\it scale invariant Alpha-Beta divergence} (sAB divergence). This new objective encompasses most variational objectives that use…

Machine Learning · Statistics 2018-05-22 Jean-Baptiste Regli , Ricardo Silva

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing…

Machine Learning · Computer Science 2023-09-12 Jed A. Duersch

Robustness is of central importance in machine learning and has given rise to the fields of domain generalization and invariant learning, which are concerned with improving performance on a test distribution distinct from but related to the…

Machine Learning · Computer Science 2020-12-03 Robert Adragna , Elliot Creager , David Madras , Richard Zemel

We study data-driven decision-making problems in the Bayesian framework, where the expectation in the Bayes risk is replaced by a risk-sensitive entropic risk measure. We focus on problems where calculating the posterior distribution is…

Optimization and Control · Mathematics 2021-09-13 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

Non-linear hierarchical models are commonly used in many disciplines. However, inference in the presence of non-nested effects and on large datasets is challenging and computationally burdensome. This paper provides two contributions to…

Methodology · Statistics 2021-10-22 Max Goplerud

Computer models play a crucial role in numerous scientific and engineering domains. To ensure the accuracy of simulations, it is essential to properly calibrate the input parameters of these models through statistical inference. While…

Applications · Statistics 2024-03-07 Dongkyu Derek Cho , Won Chang , Jaewoo Park

Mean-field variational inference (MFVI) is a widely used method for approximating high-dimensional probability distributions by product measures. This paper studies the stability properties of the mean-field approximation when the target…

Probability · Mathematics 2025-06-10 Shunan Sheng , Bohan Wu , Alberto González-Sanz , Marcel Nutz

Probabilistic state estimation is essential for robots navigating uncertain environments. Accurately and efficiently managing uncertainty in estimated states is key to robust robotic operation. However, nonlinearities in robotic platforms…

Robotics · Computer Science 2024-11-19 Min-Won Seo , Solmaz S. Kia