中文
相关论文

相关论文: Optimal Uncertainty Size in Distributionally Robus…

200 篇论文

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

机器学习 · 统计学 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

Nonparametric estimation of a mixing distribution based on data coming from a mixture model is a challenging problem. Beyond estimation, there is interest in uncertainty quantification, e.g., confidence intervals for features of the mixing…

统计方法学 · 统计学 2019-06-14 Vaidehi Dixit , Ryan Martin

We present a methodology for predictable and safe covariance steering control of uncertain nonlinear stochastic processes. The systems under consideration are subject to general uncertainties, which include unbounded random disturbances…

系统与控制 · 电气工程与系统科学 2025-09-08 Aditya Gahlawat , Vivek Khatana , Duo Wang , Sambhu H. Karumanchi , Naira Hovakimyan , Petros Voulgaris

In linear regression we wish to estimate the optimum linear least squares predictor for a distribution over $d$-dimensional input points and real-valued responses, based on a small sample. Under standard random design analysis, where the…

机器学习 · 统计学 2022-06-08 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

Descriptive statistics for parametric models are currently highly sensative to departures, gross errors, and/or random errors. Here, leveraging the structures of parametric distributions and their central moment kernel distributions, a…

统计理论 · 数学 2024-09-11 Li Tuobang

When climate forecasts are highly uncertain, the optimal mean squared error strategy is to ignore them. When climate forecasts are highly certain, the optimal mean squared error strategy is to use them as is. In between these two extremes…

大气与海洋物理 · 物理学 2009-12-23 Stephen Jewson , Ed Hawkins

This work presents a distributionally robust Kalman filter to address uncertainties in noise covariance matrices and predicted covariance estimates. We adopt a distributionally robust formulation using bicausal optimal transport to…

最优化与控制 · 数学 2025-06-18 Bingyan Han

We introduce a fine-grained framework for uncertainty quantification of predictive models under distributional shifts. This framework distinguishes the shift in covariate distributions from that in the conditional relationship between the…

统计方法学 · 统计学 2025-05-20 Jiahao Ai , Zhimei Ren

We study the problem of high-dimensional covariance estimation under the constraint that the partial correlations are nonnegative. The sign constraints dramatically simplify estimation: the Gaussian maximum likelihood estimator is well…

统计理论 · 数学 2020-07-31 Jake A. Soloff , Adityanand Guntuboyina , Michael I. Jordan

We propose a novel, succinct, and effective approach for distribution prediction to quantify uncertainty in machine learning. It incorporates adaptively flexible distribution prediction of $\mathbb{P}(\mathbf{y}|\mathbf{X}=x)$ in regression…

机器学习 · 计算机科学 2023-06-21 Xing Yan , Yonghua Su , Wenxuan Ma

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

机器学习 · 统计学 2020-12-07 Ainesh Bakshi , Adarsh Prasad

We study the empirical likelihood approach to construct confidence intervals for the optimal value and the optimality gap of a given solution, henceforth quantify the statistical uncertainty of sample average approximation, for optimization…

统计方法学 · 统计学 2016-10-25 Henry Lam , Enlu Zhou

In this article we study the problem of quantifying the uncertainty in an experiment with a technical system. We propose new density estimates which combine observed data of the technical system and simulated data from an (imperfect)…

统计理论 · 数学 2020-12-21 Sebastian Kersting , Michael Kohler

Gaussian process regression is used throughout statistics and machine learning for prediction and uncertainty quantification. A Gaussian process is specified by its mean and covariance functions. Many covariance functions, including…

统计理论 · 数学 2025-10-28 Toni Karvonen , François Bachoc

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

In this paper, we consider the chance constrained based uncertain portfolio optimization problem in which the uncertain parameters are stochastic in nature. The primary goal of the work is to formulate the uncertain problem into a…

最优化与控制 · 数学 2023-11-09 Pulak Swain , Akshay Kumar Ojha

Robust mean estimation is the problem of estimating the mean $\mu \in \mathbb{R}^d$ of a $d$-dimensional distribution $D$ from a list of independent samples, an $\epsilon$-fraction of which have been arbitrarily corrupted by a malicious…

计算复杂性 · 计算机科学 2019-06-05 Samuel B. Hopkins , Jerry Li

We benchmark the robustness of maximum likelihood based uncertainty estimation methods to outliers in training data for regression tasks. Outliers or noisy labels in training data results in degraded performances as well as incorrect…

机器学习 · 计算机科学 2022-02-09 Deebul S. Nair , Nico Hochgeschwender , Miguel A. Olivares-Mendez

We derive a maximum a posteriori estimator for the linear observation model, where the signal and noise covariance matrices are both uncertain. The uncertainties are treated probabilistically by modeling the covariance matrices with prior…

For many applications it is critical to know the uncertainty of a neural network's predictions. While a variety of neural network parameter estimation methods have been proposed for uncertainty estimation, they have not been rigorously…

机器学习 · 计算机科学 2019-12-05 Nabeel Seedat , Christopher Kanan