中文
相关论文

相关论文: High Dimensional Robust $M$-Estimation: Arbitrary …

200 篇论文

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

机器学习 · 统计学 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

We consider a general statistical learning problem where an unknown fraction of the training data is corrupted. We develop a robust learning method that only requires specifying an upper bound on the corrupted data fraction. The method…

机器学习 · 统计学 2020-02-10 Muhammad Osama , Dave Zachariah , Peter Stoica

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

统计理论 · 数学 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

This paper considers the problem of recovery of a low-rank matrix in the situation when most of its entries are not observed and a fraction of observed entries are corrupted. The observations are noisy realizations of the sum of a low rank…

统计理论 · 数学 2016-07-05 Olga Klopp , Karim Lounici , Alexandre B. Tsybakov

High-dimensional data subject to heavy-tailed phenomena and heterogeneity are commonly encountered in various scientific fields and bring new challenges to the classical statistical methods. In this paper, we combine the asymmetric square…

统计理论 · 数学 2019-10-02 Jun Zhao , Guan'ao Yan , Yi Zhang

We introduce a criterion, resilience, which allows properties of a dataset (such as its mean or best low rank approximation) to be robustly computed, even in the presence of a large fraction of arbitrary additional data. Resilience is a…

机器学习 · 计算机科学 2017-11-28 Jacob Steinhardt , Moses Charikar , Gregory Valiant

Distributed gradient descent algorithms have come to the fore in modern machine learning, especially in parallelizing the handling of large datasets that are distributed across several workers. However, scant attention has been paid to…

信号处理 · 电气工程与系统科学 2025-02-06 Shuche Wang , Vincent Y. F. Tan

We consider (robust) inference in the context of a factor model for tensor-valued sequences. We study the consistency of the estimated common factors and loadings space when using estimators based on minimising quadratic loss functions.…

统计方法学 · 统计学 2023-08-29 Matteo Barigozzi , Yong He , Lingxiao Li , Lorenzo Trapani

We introduce a new criterion, the Rank Selection Criterion (RSC), for selecting the optimal reduced rank estimator of the coefficient matrix in multivariate response regression models. The corresponding RSC estimator minimizes the Frobenius…

统计理论 · 数学 2011-10-18 Florentina Bunea , Yiyuan She , Marten H. Wegkamp

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

最优化与控制 · 数学 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang

In various practical situations, we encounter data from stochastic processes which can be efficiently modelled by an appropriate parametric model for subsequent statistical analyses. Unfortunately, the most common estimation and inference…

统计方法学 · 统计学 2022-04-12 Rohan Hore , Abhik Ghosh

Big data can easily be contaminated by outliers or contain variables with heavy-tailed distributions, which makes many conventional methods inadequate. To address this challenge, we propose the adaptive Huber regression for robust…

统计理论 · 数学 2018-10-11 Qiang Sun , Wenxin Zhou , Jianqing Fan

We consider a stochastic linear bandit problem in which the rewards are not only subject to random noise, but also adversarial attacks subject to a suitable budget $C$ (i.e., an upper bound on the sum of corruption magnitudes across the…

机器学习 · 统计学 2020-10-29 Ilija Bogunovic , Arpan Losalka , Andreas Krause , Jonathan Scarlett

We establish a collection of closed-loop guarantees and propose a scalable optimization algorithm for distributionally robust model predictive control (DRMPC) applied to linear systems, convex constraints, and quadratic costs. Via standard…

最优化与控制 · 数学 2024-11-13 Robert D. McAllister , Peyman Mohajerin Esfahani

We study high-dimensional least-squares regression within a subgaussian statistical learning framework with heterogeneous noise. It includes $s$-sparse and $r$-low-rank least-squares regression when a fraction $\epsilon$ of the labels are…

统计理论 · 数学 2023-11-01 Philip Thompson

We develop a constructive approach to estimating sparse, high-dimensional linear regression models. The approach is a computational algorithm motivated from the KKT conditions for the $\ell_0$-penalized least squares solutions. It generates…

统计计算 · 统计学 2017-01-19 Jian Huang , Yuling Jiao , Yanyan Liu , Xiliang Lu

The distributionally robust Markov Decision Process (MDP) approach asks for a distributionally robust policy that achieves the maximal expected total reward under the most adversarial distribution of uncertain parameters. In this paper, we…

系统与控制 · 计算机科学 2018-10-10 Zhi Chen , Pengqian Yu , William B. Haskell

This paper investigates model robustness in reinforcement learning (RL) to reduce the sim-to-real gap in practice. We adopt the framework of distributionally robust Markov decision processes (RMDPs), aimed at learning a policy that…

机器学习 · 计算机科学 2025-09-09 Laixi Shi , Gen Li , Yuting Wei , Yuxin Chen , Matthieu Geist , Yuejie Chi

The growing demand for personalized decision-making has led to a surge of interest in estimating the Conditional Average Treatment Effect (CATE). Various types of CATE estimators have been developed with advancements in machine learning and…

机器学习 · 计算机科学 2024-11-04 Yiyan Huang , Cheuk Hang Leung , Siyi Wang , Yijun Li , Qi Wu

We study the problem of robust mean estimation and introduce a novel Hamming distance-based measure of distribution shift for coordinate-level corruptions. We show that this measure yields adversary models that capture more realistic…

机器学习 · 计算机科学 2021-06-14 Zifan Liu , Jongho Park , Theodoros Rekatsinas , Christos Tzamos