English
Related papers

Related papers: Robust mean change point testing in high-dimension…

200 papers

High-dimensional data subject to heavy-tailed phenomena and heterogeneity are commonly encountered in various scientific fields and bring new challenges to the classical statistical methods. In this paper, we combine the asymmetric square…

Statistics Theory · Mathematics 2019-10-02 Jun Zhao , Guan'ao Yan , Yi Zhang

High-dimensional covariance estimation is notoriously sensitive to outliers. While statistically optimal estimators exist for general heavy-tailed distributions, they often rely on computationally expensive techniques like semidefinite…

Machine Learning · Statistics 2026-01-06 Even He

Statistical modeling of high dimensional extremes remains challenging and has generally been limited to moderate dimensions. Understanding structural relationships among variables at their extreme levels is crucial both for constructing…

Methodology · Statistics 2026-01-01 Mihyun Kim , Jeongjin Lee

Exploring noise distributions beyond Gaussian in diffusion models remains an open challenge. While Gaussian-based models succeed within a unified SDE framework, recent studies suggest that heavy-tailed noise distributions, like…

Machine Learning · Computer Science 2025-06-18 Dario Shariatian , Umut Simsekli , Alain Durmus

Deep neural network training often involves stochastic optimization, meaning each run will produce a different model. This implies that hyperparameters of the training process, such as the random seed itself, can potentially have…

Machine Learning · Statistics 2025-04-17 Sinjini Banerjee , Tim Marrinan , Reilly Cannon , Tony Chiang , Anand D. Sarwate

We propose a two-sample test for high-dimensional means that requires neither distributional nor correlational assumptions, besides some weak conditions on the moments and tail properties of the elements in the random vectors. This…

Methodology · Statistics 2019-04-17 Kaijie Xue , Fang Yao

We investigate stable recovery guarantees for phase retrieval under two realistic and challenging noise models: the Poisson model and the heavy-tailed model. Our analysis covers both nonconvex least squares (NCVX-LS) and convex least…

Statistics Theory · Mathematics 2025-10-02 Gao Huang , Song Li , Deanna Needell

In high-dimensional statistics, the Lasso is a cornerstone method for simultaneous variable selection and parameter estimation. However, its reliance on the squared loss function renders it highly sensitive to outliers and heavy-tailed…

Machine Learning · Statistics 2025-11-20 The Tien Mai

In this paper we introduce a robust to outliers Wilcoxon change-point testing procedure, for distinguishing between short-range dependent time series with a change in mean at unknown time and stationary long-range dependent time series. We…

Methodology · Statistics 2020-07-07 Carina Gerstenberger

We study the problem of detecting a change in the mean of one-dimensional Gaussian process data. This problem is investigated in the setting of increasing domain (customarily employed in time series analysis) and in the setting of fixed…

Statistics Theory · Mathematics 2017-04-11 Hossein Keshavarz , Clayton Scott , XuanLong Nguyen

We survey some of the recent advances in mean estimation and regression function estimation. In particular, we describe sub-Gaussian mean estimators for possibly heavy-tailed data both in the univariate and multivariate settings. We focus…

Statistics Theory · Mathematics 2019-06-12 Gabor Lugosi , Shahar Mendelson

In this paper, we provide novel optimal (or near optimal) convergence rates for a clipped version of the stochastic subgradient method. We consider nonsmooth convex problems over possibly unbounded domains, under heavy-tailed noise that…

Optimization and Control · Mathematics 2025-04-21 Daniela Angela Parletta , Andrea Paudice , Saverio Salzo

This paper proposes a novel test method for high-dimensional mean testing regard for the temporal dependent data. Comparison to existing methods, we establish the asymptotic normality of the test statistic without relying on restrictive…

Methodology · Statistics 2025-12-01 Yuchen Hu , Xiaoyi Wang , Long Feng

This paper studies the minimax detection of a small submatrix of elevated mean in a large matrix contaminated by additive Gaussian noise. To investigate the tradeoff between statistical performance and computational cost from a…

Statistics Theory · Mathematics 2015-06-04 Zongming Ma , Yihong Wu

We study the multivariate nonparametric change point detection problem, where the data are a sequence of independent $p$-dimensional random vectors whose distributions are piecewise-constant with Lipschitz densities changing at unknown…

Statistics Theory · Mathematics 2020-06-26 Oscar Hernan Madrid Padilla , Yi Yu , Daren Wang , Alessandro Rinaldo

A weakly dependent time series regression model with multivariate covariates and univariate observations is considered, for which we develop a procedure to detect whether the nonparametric conditional mean function is stable in time against…

Statistics Theory · Mathematics 2019-01-25 Maria Mohr , Natalie Neumeyer

Recent studies have shown that heavy tails can emerge in stochastic optimization and that the heaviness of the tails have links to the generalization error. While these studies have shed light on interesting aspects of the generalization…

Machine Learning · Statistics 2023-02-14 Anant Raj , Melih Barsbey , Mert Gürbüzbalaban , Lingjiong Zhu , Umut Şimşekli

Consider the communication-constrained problem of nonparametric function estimation, in which each distributed terminal holds multiple i.i.d. samples. Under certain regularity assumptions, we characterize the minimax optimal rates for all…

Machine Learning · Computer Science 2025-01-15 Deheng Yuan , Tao Guo , Zhongyi Huang

Insurance data can be asymmetric with heavy tails, causing inadequate adjustments of the usually applied models. To deal with this issue, hierarchical models for collective risk with heavy-tails of the claims distributions that take also…

Applications · Statistics 2021-01-26 Pamela M. Chiroque-Solano , Fernando A. S. Moura

This paper introduces the partial Gini covariance, a novel dependence measure that addresses the challenges of high-dimensional inference with heavy-tailed errors, often encountered in fields like finance, insurance, climate, and biology.…

Methodology · Statistics 2024-11-21 Yilin Zhang , Songshan Yang , Yunan Wu , Lan Wang