English
Related papers

Related papers: Distributionally Robust Skeleton Learning of Discr…

200 papers

We present a novel $Q$-learning algorithm tailored to solve distributionally robust Markov decision problems where the corresponding ambiguity set of transition probabilities for the underlying Markov decision process is a Wasserstein ball…

Machine Learning · Computer Science 2024-06-21 Ariel Neufeld , Julian Sester

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

Methodology · Statistics 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to…

Machine Learning · Computer Science 2025-11-04 Shuyao Li , Ilias Diakonikolas , Jelena Diakonikolas

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

We investigate the problem of risk averse robot path planning using the deep reinforcement learning and distributionally robust optimization perspectives. Our problem formulation involves modelling the robot as a stochastic linear dynamical…

Robotics · Computer Science 2022-11-07 Cem Alpturk , Venkatraman Renganathan

Bayesian networks are one of the most widely used classes of probabilistic models for risk management and decision support because of their interpretability and flexibility in including heterogeneous pieces of information. In any applied…

Methodology · Statistics 2024-07-08 Manuele Leonelli , Jim Q. Smith , Sophia K. Wright

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

Bayesian networks, with structure given by a directed acyclic graph (DAG), are a popular class of graphical models. However, learning Bayesian networks from discrete or categorical data is particularly challenging, due to the large…

Methodology · Statistics 2018-02-06 Jiaying Gu , Fei Fu , Qing Zhou

Learning in uncertain, noisy, or adversarial environments is a challenging task for deep neural networks (DNNs). We propose a new theoretically grounded and efficient approach for robust learning that builds upon Bayesian estimation and…

Machine Learning · Computer Science 2021-11-12 Giuseppina Carannante , Dimah Dera , Ghulam Rasool , Nidhal C. Bouaynaya , Lyudmila Mihaylova

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

When the historical data are limited, the conditional probabilities associated with the nodes of Bayesian networks are uncertain and can be empirically estimated. Second order estimation methods provide a framework for both estimating the…

Machine Learning · Statistics 2022-08-09 Conrad D. Hougen , Lance M. Kaplan , Federico Cerutti , Alfred O. Hero

Optimal transport has recently proved to be a useful tool in various machine learning applications needing comparisons of probability measures. Among these, applications of distributionally robust optimization naturally involve Wasserstein…

Optimization and Control · Mathematics 2023-03-24 Waïss Azizian , Franck Iutzeler , Jérôme Malick

Bayesian neural networks with latent variables are scalable and flexible probabilistic models: They account for uncertainty in the estimation of the network weights and, by making use of latent variables, can capture complex noise patterns…

Machine Learning · Statistics 2018-06-19 Stefan Depeweg , José Miguel Hernández-Lobato , Finale Doshi-Velez , Steffen Udluft

Distribution regression has recently attracted much interest as a generic solution to the problem of supervised learning where labels are available at the group level, rather than at the individual level. Current approaches, however, do not…

Machine Learning · Statistics 2021-01-18 Ho Chung Leon Law , Danica J. Sutherland , Dino Sejdinovic , Seth Flaxman

Gaussian Bayesian networks (a.k.a. linear Gaussian structural equation models) are widely used to model causal interactions among continuous variables. In this work, we study the problem of learning a fixed-structure Gaussian Bayesian…

Data Structures and Algorithms · Computer Science 2022-10-19 Arnab Bhattacharyya , Davin Choo , Rishikesh Gajjala , Sutanu Gayen , Yuhao Wang

We consider data-driven approaches that integrate a machine learning prediction model within distributionally robust optimization (DRO) given limited joint observations of uncertain parameters and covariates. Our framework is flexible in…

Optimization and Control · Mathematics 2022-05-26 Rohit Kannan , Güzin Bayraksan , James R. Luedtke

We present a distributionally robust PAC-Bayesian framework for certifying the performance of learning-based finite-horizon controllers. While existing PAC-Bayes control literature typically assumes bounded losses and matching training and…

Machine Learning · Computer Science 2026-04-14 Domagoj Herceg , Duarte Antunes

Data integration and sharing maximally enhance the potential for novel and meaningful discoveries. However, it is a non-trivial task as integrating data from multiple sources can put sensitive information of study participants at risk. To…

Cryptography and Security · Computer Science 2020-05-25 Yeongjae Gil , Xiaoqian Jiang , Miran Kim , Junghye Lee

We study the {\em robust proper learning} of univariate log-concave distributions (over continuous and discrete domains). Given a set of samples drawn from an unknown target distribution, we want to compute a log-concave hypothesis…

Data Structures and Algorithms · Computer Science 2016-06-10 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Machine learning models deployed on medical imaging tasks must be equipped with out-of-distribution detection capabilities in order to avoid erroneous predictions. It is unsure whether out-of-distribution detection models reliant on deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Sebastian G. Popescu , David J. Sharp , James H. Cole , Konstantinos Kamnitsas , Ben Glocker