中文
相关论文

相关论文: Learning Credal Ensembles via Distributionally Rob…

200 篇论文

A statistical learning approach for parametric PDEs related to Uncertainty Quantification is derived. The method is based on the minimization of an empirical risk on a selected model class and it is shown to be applicable to a broad range…

数值分析 · 数学 2020-01-07 Martin Eigel , Reinhold Schneider , Philipp Trunschke , Sebastian Wolf

Recently, (Blanchet, Kang, and Murhy 2016, and Blanchet, and Kang 2017) showed that several machine learning algorithms, such as square-root Lasso, Support Vector Machines, and regularized logistic regression, among many others, can be…

机器学习 · 统计学 2020-02-25 Jose Blanchet , Yang Kang , Fan Zhang , Karthyek Murthy

The calibration of predictive distributions has been widely studied in deep learning, but the same cannot be said about the more specific epistemic uncertainty as produced by Deep Ensembles, Bayesian Deep Networks, or Evidential Deep…

机器学习 · 计算机科学 2024-07-18 Mohammed Fellaji , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro

The goal of this paper is to develop distributionally robust optimization (DRO) estimators, specifically for multidimensional Extreme Value Theory (EVT) statistics. EVT supports using semi-parametric models called max-stable distributions…

机器学习 · 统计学 2024-08-02 Patrick Kuiper , Ali Hasan , Wenhao Yang , Yuting Ng , Hoda Bidkhori , Jose Blanchet , Vahid Tarokh

Bayesian deep learning plays an important role especially for its ability evaluating epistemic uncertainty (EU). Due to computational complexity issues, approximation methods such as variational inference (VI) have been used in practice to…

机器学习 · 统计学 2022-10-12 Futoshi Futami , Tomoharu Iwata , Naonori Ueda , Issei Sato , Masashi Sugiyama

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

机器学习 · 统计学 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

Most research designing novel predictive models, or employing existing ones, assumes that training and testing data are independent and identically distributed. In practice, the data encountered at serving time often deviate from the…

机器学习 · 计算机科学 2026-03-30 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

Data-driven approaches to predict-then-optimize decision-making problems seek to mitigate the risk of uncertainty region misspecification in safety-critical settings. Current approaches, however, suffer from considering overly conservative…

统计方法学 · 统计学 2023-10-17 Yash Patel , Sahana Rayan , Ambuj Tewari

Epistemic uncertainty in neural networks is commonly modeled using two second-order paradigms: distribution-based representations, which rely on posterior parameter distributions, and set-based representations based on credal sets (convex…

机器学习 · 计算机科学 2026-02-27 Kaizheng Wang , Yunjia Wang , Fabio Cuzzolin , David Moens , Hans Hallez , Siu Lun Chau

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

机器学习 · 计算机科学 2024-11-07 Erfan Hajihashemi , Yanning Shen

For many practical, high-risk applications, it is essential to quantify uncertainty in a model's predictions to avoid costly mistakes. While predictive uncertainty is widely studied for neural networks, the topic seems to be under-explored…

机器学习 · 计算机科学 2021-04-05 Andrey Malinin , Liudmila Prokhorenkova , Aleksei Ustimenko

It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability…

最优化与控制 · 数学 2022-05-09 Yueyao Li , Wenxun Xing

Modern machine learning models may be susceptible to learning spurious correlations that hold on average but not for the atypical group of samples. To address the problem, previous approaches minimize the empirical worst-group risk. Despite…

机器学习 · 计算机科学 2023-03-13 Soumya Suvra Ghosal , Yixuan Li

Uncertainty quantification and robustness to distribution shifts are important goals in machine learning and artificial intelligence. Although Bayesian Neural Networks (BNNs) allow for uncertainty in the predictions to be assessed,…

机器学习 · 计算机科学 2024-10-23 Michele Caprio , Souradeep Dutta , Kuk Jin Jang , Vivian Lin , Radoslav Ivanov , Oleg Sokolsky , Insup Lee

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

机器学习 · 统计学 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

Text embeddings are essential components in modern NLP pipelines. Although numerous embedding models have been proposed, no single model consistently dominates across domains and tasks. This variability motivates the use of ensemble…

机器学习 · 计算机科学 2026-02-13 Sungjun Lim , Kangjun Noh , Youngjun Choi , Heeyoung Lee , Kyungwoo Song

Brain vessel segmentation of MR scans is a critical step in the diagnosis of cerebrovascular diseases. Due to the fine vessel structure, manual vessel segmentation is time consuming. Therefore, automatic deep learning (DL) based…

图像与视频处理 · 电气工程与系统科学 2025-03-31 Omini Rathore , Richard Paul , Abigail Morrison , Hanno Scharr , Elisabeth Pfaehler

Quantifying model uncertainty is critical for understanding prediction reliability, yet distinguishing between aleatoric and epistemic uncertainty remains challenging. We extend recent work from classification to regression to provide a…

Estimating uncertainty in deep learning models is critical for reliable decision-making in high-stakes applications such as medical imaging. Prior research has established that the difference between an input sample and its reconstructed…

机器学习 · 计算机科学 2026-01-28 Xinran Xu , Li Rong Wang , Xiuyi Fan

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning with fundamental…

机器学习 · 统计学 2021-08-23 Ruidi Chen , Ioannis Ch. Paschalidis