English
Related papers

Related papers: On general notions of depth for regression

200 papers

We introduce a novel projection depth for data lying in a general Hilbert space, called the regularized projection depth, with a focus on functional data. By regularizing projection directions, the proposed depth does not suffer from the…

Methodology · Statistics 2025-12-24 Filip Bočinec , Stanislav Nagy , Hyemin Yeon

Statistical depth functions are a standard tool in nonparametric statistics to extend order-based univariate methods to the multivariate setting. Since there is no universally accepted total order for fuzzy data (even in the univariate…

Statistics Theory · Mathematics 2024-01-05 Luis González-De La Fuente , Alicia Nieto-Reyes , Pedro Terán

The computation of the Tukey depth, also called halfspace depth, is very demanding, even in low dimensional spaces, because it requires the consideration of all possible one-dimensional projections. In this paper we propose a random depth…

Computation · Statistics 2007-07-03 J. A. Cuesta-Albertos , A. Nieto-Reyes

Sliced inverse regression is one of the most popular sufficient dimension reduction methods. Originally, it was designed for independent and identically distributed data and recently extend to the case of serially and spatially dependent…

Methodology · Statistics 2021-07-07 Christoph Muehlmann , Hannu Oja , Klaus Nordhausen

There is emerging interest in performing regression between distributions. In contrast to prediction on single instances, these machine learning methods can be useful for population-based studies or on problems that are inherently…

Machine Learning · Computer Science 2019-06-03 Connie Kou , Hwee Kuan Lee , Jorge Sanz , Teck Khim Ng

Data depths are score functions that quantify in an unsupervised fashion how central is a point inside a distribution, with numerous applications such as anomaly detection, multivariate or functional data analysis, arising across various…

Machine Learning · Statistics 2025-07-14 Arturo Castellanos , Pavlo Mozharovskyi

Zuo (2019) (Z19) addressed the computation of the projection regression depth (PRD) and its induced median (the maximum depth estimator). Z19 achieved the exact computation of PRD via a modified version of regular univariate sample median,…

Methodology · Statistics 2021-01-19 Yijun Zuo

Many functional datasets are observed sparsely and irregularly. Ordering such data is challenging because only limited information is available from each observation, while the underlying trajectories remain infinite-dimensional. This paper…

Methodology · Statistics 2026-05-21 Hyemin Yeon , Xiongtao Dai , Sara Lopez-Pintado

The least squares of depth-trimmed (LST) residuals regression, proposed and studied in Zuo and Zuo (2023), serves as a robust alternative to the classic least squares (LS) regression as well as a strong competitor to the renowned robust…

Applications · Statistics 2025-01-28 Yijun Zuo , Hanwen Zuo

We develop a novel exploratory tool for non-Euclidean object data based on data depth, extending the celebrated Tukey's depth for Euclidean data. The proposed metric halfspace depth, applicable to data objects in a general metric space,…

Methodology · Statistics 2021-09-02 Xiongtao Dai , Sara Lopez-Pintado

Tukey's depth offers a powerful tool for nonparametric inference and estimation, but also encounters serious computational and methodological difficulties in modern statistical data analysis. This paper studies how to generalize and compute…

Methodology · Statistics 2023-05-04 Yiyuan She , Shao Tang , Jingze Liu

Neural multivariate regression underpins a wide range of domains, including control, robotics, and finance, yet the geometry of its learned representations remains poorly characterized. While neural collapse has been shown to benefit…

Machine Learning · Computer Science 2026-05-11 George Andriopoulos , Zixuan Dong , Bimarsha Adhikari , Keith Ross

In this Element and its accompanying Element, Matias D. Cattaneo, Nicolas Idrobo, and Rocio Titiunik provide an accessible and practical guide for the analysis and interpretation of Regression Discontinuity (RD) designs that encourages the…

Methodology · Statistics 2019-11-22 Matias D. Cattaneo , Nicolas Idrobo , Rocio Titiunik

Robust estimation of location is a fundamental problem in statistics, particularly in scenarios where data contamination by outliers or model misspecification is a concern. In univariate settings, methods such as the sample median and…

Statistics Theory · Mathematics 2025-05-07 Alejandro Cholaquidis , Ricardo Fraiman , Leonardo Moreno , Gonzalo Perera

The basic framework of depth completion is to predict a pixel-wise dense depth map using very sparse input data. In this paper, we try to solve this problem in a more effective way, by reformulating the regression-based depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Byeong-Uk Lee , Kyunghyun Lee , In So Kweon

Tukey's halfspace depth can be seen as a stochastic program and as such it is not guarded against optimizer's curse, so that a limited training sample may easily result in a poor out-of-sample performance. We propose a generalized halfspace…

Optimization and Control · Mathematics 2024-05-13 Jevgenijs Ivanovs , Pavlo Mozharovskyi

A key attribute that drives the unprecedented success of modern Recurrent Neural Networks (RNNs) on learning tasks which involve sequential data, is their ability to model intricate long-term temporal dependencies. However, a well…

Machine Learning · Computer Science 2020-03-24 Alon Ziv

Deep learning revolutionized data science, and recently its popularity has grown exponentially, as did the amount of papers employing deep networks. Vision tasks, such as human pose estimation, did not escape from this trend. There is a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Stéphane Lathuilière , Pablo Mesejo , Xavier Alameda-Pineda , Radu Horaud

Robust estimation under Huber's $\epsilon$-contamination model has become an important topic in statistics and theoretical computer science. Statistically optimal procedures such as Tukey's median and other estimators based on depth…

Machine Learning · Statistics 2019-02-27 Chao Gao , Jiyi Liu , Yuan Yao , Weizhi Zhu

The goal of this paper is to provide a theory linear regression based entirely on approximations. It will be argued that the standard linear regression model based theory whether frequentist or Bayesian has failed and that this failure is…

Methodology · Statistics 2024-02-16 Laurie Davies