English
Related papers

Related papers: Robustness and accuracy of methods for high dimens…

200 papers

We consider the performance of the bootstrap in high-dimensions for the setting of linear regression, where $p<n$ but $p/n$ is not close to zero. We consider ordinary least-squares as well as robust regression methods and adopt a minimalist…

Methodology · Statistics 2016-08-03 Noureddine El Karoui , Elizabeth Purdom

The last decade has seen a number of advances in computationally efficient algorithms for statistical methods subject to robustness constraints. An estimator may be robust in a number of different ways: to contamination of the dataset, to…

Machine Learning · Statistics 2025-09-08 Gautam Kamath

We propose a new testing procedure about the tail weight parameter of multivariate Student $t$ distributions by having recourse to the Le Cam methodology. Our test is asymptotically as efficient as the classical likelihood ratio test, but…

Methodology · Statistics 2014-04-10 Christophe Ley , Anouk Neven

Heavy-tailed distributions are widely used in robust mixture modelling due to possessing thick tails. As a computationally tractable subclass of the stable distributions, sub-Gaussian $\alpha$-stable distribution received much interest in…

Machine Learning · Statistics 2017-01-25 Mahdi Teimouri , Saeid Rezakhah , Adel Mohammdpour

It is of importance to develop statistical techniques to analyze high-dimensional data in the presence of both complex dependence and possible outliers in real-world applications such as imaging data analyses. We propose a new robust…

Methodology · Statistics 2021-10-01 Bingyuan Liu , Qi Zhang , Lingzhou Xue , Peter X. K. Song , Jian Kang

Signal temporal logic (STL) is a powerful tool for describing complex behaviors for dynamical systems. Among many approaches, the control problem for systems under STL task constraints is well suited for learning-based solutions, because…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Peter Varnai , Dimos V. Dimarogonas

The Student-$t$ distribution is widely used in statistical modeling of datasets involving outliers since its longer-than-normal tails provide a robust approach to hand such data. Furthermore, data collected over time may contain censored or…

We study the empirical version of halfspace depths with the objective of establishing a connection between the rates of convergence and the tail behaviour of the corresponding underlying distributions. The intricate interplay between the…

Statistics Theory · Mathematics 2025-06-03 Sibsankar Singha , Marie Kratz , Sreekar Vadlamani

Heckman selection model is the most popular econometric model in analysis of data with sample selection. However, selection models with Normal errors cannot accommodate heavy tails in the error distribution. Recently, Marchenko and Genton…

Computation · Statistics 2014-01-08 Peng Ding

Strict stationarity is a common assumption used in the time series literature in order to derive asymptotic distributional results for second-order statistics, like sample autocovariances and sample autocorrelations. Focusing on weak…

Statistics Theory · Mathematics 2023-02-28 Yunyi Zhang , Efstathios Paparoditis , Dimitris N. Politis

In a broad class of reinforcement learning applications, stochastic rewards have heavy-tailed distributions, which lead to infinite second-order moments for stochastic (semi)gradients in policy evaluation and direct policy optimization. In…

Machine Learning · Computer Science 2023-06-21 Semih Cayci , Atilla Eryilmaz

A robust estimator is proposed for the parameters that characterize the linear regression problem. It is based on the notion of shrinkages, often used in Finance and previously studied for outlier detection in multivariate data. A thorough…

Methodology · Statistics 2020-02-07 Elisa Cabana , Rosa E. Lillo , Henry Laniado

In decision making problems for continuous state and action spaces, linear dynamical models are widely employed. Specifically, policies for stochastic linear systems subject to quadratic cost functions capture a large number of applications…

Machine Learning · Computer Science 2019-04-23 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

We consider the task of heavy-tailed statistical estimation given streaming $p$-dimensional samples. This could also be viewed as stochastic optimization under heavy-tailed distributions, with an additional $O(p)$ space complexity…

Machine Learning · Computer Science 2022-02-28 Che-Ping Tsai , Adarsh Prasad , Sivaraman Balakrishnan , Pradeep Ravikumar

We develop an econometric framework integrating heavy-tailed Student's $t$ distributions with behavioral probability weighting while preserving infinite divisibility. Using 432{,}752 observations across 86 assets (2004--2024), we…

Mathematical Finance · Quantitative Finance 2025-11-21 Akash Deep , Svetlozar T. Rachev , Frank J. Fabozzi

Robust Bayesian linear regression is a classical but essential statistical tool. Although novel robustness properties of posterior distributions have been proved recently under a certain class of error distributions, their sufficient…

Methodology · Statistics 2025-09-23 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

Machine learning has demonstrated remarkable prediction accuracy over i.i.d data, but the accuracy often drops when tested with data from another distribution. In this paper, we aim to offer another view of this problem in a perspective…

Machine Learning · Computer Science 2022-06-20 Haohan Wang , Zeyi Huang , Hanlin Zhang , Yong Jae Lee , Eric Xing

Let $T$ be the Student one- or two-sample $t$-, $F$-, or Welch statistic. Now release the underlying assumptions of normality, independence and identical distribution and consider a more general case where one only assumes that the vector…

Statistics Theory · Mathematics 2014-10-23 Dmitrii Zholud

Real data often contain anomalous cases, also known as outliers. These may spoil the resulting analysis but they may also contain valuable information. In either case, the ability to detect such anomalies is essential. A useful tool for…

Machine Learning · Statistics 2021-01-13 Peter J. Rousseeuw , Mia Hubert

Adversarial robustness is a critical challenge in deploying deep neural networks for real-world applications. While adversarial training is a widely recognized defense strategy, most existing studies focus on balanced datasets, overlooking…

Machine Learning · Computer Science 2025-03-24 Wang YuHang , Junkang Guo , Aolei Liu , Kaihao Wang , Zaitong Wu , Zhenyu Liu , Wenfei Yin , Jian Liu