English
Related papers

Related papers: Dimensionality Reduction for Tukey Regression

200 papers

We propose a minimum distance estimation method for robust regression in sparse high-dimensional settings. The traditional likelihood-based estimators lack resilience against outliers, a critical issue when dealing with high-dimensional…

Methodology · Statistics 2013-07-12 Aurélie C. Lozano , Nicolai Meinshausen

In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric. The main…

Machine Learning · Computer Science 2015-09-16 Qi Qian , Rong Jin , Lijun Zhang , Shenghuo Zhu

Dimension reduction is a technique used to transform data from a high-dimensional space into a lower-dimensional space, aiming to retain as much of the original information as possible. This approach is crucial in many disciplines like…

Data Structures and Algorithms · Computer Science 2024-07-24 Roberto Bruno

Bayesian inverse problems use observed data to update a prior probability distribution for an unknown state or parameter of a scientific system to a posterior distribution conditioned on the data. In many applications, the unknown parameter…

Numerical Analysis · Mathematics 2026-05-12 Josie König , Elizabeth Qian , Melina A. Freitag

With the recent surge in big data analytics for hyper-dimensional data there is a renewed interest in dimensionality reduction techniques for machine learning applications. In order for these methods to improve performance gains and…

Machine Learning · Computer Science 2023-01-20 J. Derek Tucker , Matthew T. Martinez , Jose M. Laborde

We study the fundamental problem of fixed design {\em multidimensional segmented regression}: Given noisy samples from a function $f$, promised to be piecewise linear on an unknown set of $k$ rectangles, we want to recover $f$ up to a…

Data Structures and Algorithms · Computer Science 2020-03-26 Ilias Diakonikolas , Jerry Li , Anastasia Voloshinov

We establish a lower bound on the eluder dimension of generalised linear model classes, showing that standard eluder dimension-based analysis cannot lead to first-order regret bounds. To address this, we introduce a localisation method for…

Machine Learning · Computer Science 2026-04-21 Alireza Bakhtiari , Alex Ayoub , Samuel Robertson , David Janz , Csaba Szepesvári

Different unsupervised models for dimensionality reduction like PCA, LLE, Shannon's mapping, tSNE, UMAP, etc. work on different principles, hence, they are difficult to compare on the same ground. Although they are usually good for…

Methodology · Statistics 2024-05-10 Subhrajyoty Roy

Is there a natural way to order data in dimension greater than one? The approach based on the notion of data depth, often associated with John Tukey, is among the most popular. Tukey's depth has found applications in robust statistics,…

Statistics Theory · Mathematics 2026-01-13 Stanislav Minsker , Yinan Shen

Dimensionality reduction has always been one of the most significant and challenging problems in the analysis of high-dimensional data. In the context of time series analysis, our focus is on the estimation and inference of conditional mean…

Methodology · Statistics 2023-12-05 S. Yaser Samadi , Tharindu P. De Alwis

Partial differential equations (PDEs) with uncertain or random inputs have been considered in many studies of uncertainty quantification. In forward uncertainty quantification, one is interested in analyzing the stochastic response of the…

Numerical Analysis · Mathematics 2023-12-19 Philipp A. Guth , Vesa Kaarnioja

We present a study on how to effectively reduce the dimensions of the $k$-means clustering problem, so that provably accurate approximations are obtained. Four algorithms are presented, two \textit{feature selection} and two \textit{feature…

Machine Learning · Computer Science 2020-07-28 Neophytos Charalambides

Fully convolutional deep neural networks carry out excellent potential for fast and accurate image segmentation. One of the main challenges in training these networks is data imbalance, which is particularly problematic in medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Seyed Sadegh Mohseni Salehi , Deniz Erdogmus , Ali Gholipour

Determining the representativeness of a point within a data cloud has recently become a desirable task in multivariate analysis. The concept of statistical depth function, which reflects centrality of an arbitrary point, appears to be…

Computation · Statistics 2016-03-02 Pavlo Mozharovskyi

We study the temporal-spatial regularity properties of tamed Euler approximations for L\'evy-driven SDEs with superlinearly growing drift and diffusion coefficients. We first introduce a novel tamed Euler-type scheme and establish its…

Numerical Analysis · Mathematics 2026-04-28 Yan Ding , Sizhou Wu , Ying Zhang

The purpose of this thesis is to develop new theories on high-dimensional structured signal recovery under a rather weak assumption on the measurements that only a finite number of moments exists. High-dimensional recovery has been one of…

Statistics Theory · Mathematics 2020-03-06 Xiaohan Wei

The $k$-dimensional coding schemes refer to a collection of methods that attempt to represent data using a set of representative $k$-dimensional vectors, and include non-negative matrix factorization, dictionary learning, sparse coding,…

Machine Learning · Statistics 2016-04-26 Tongliang Liu , Dacheng Tao , Dong Xu

We investigate an application of the Tukey's methodology in Theil's regression to obtain a confidence interval for the true slope in the straight line regression model with not necessarily normal errors. This specific approach is…

Methodology · Statistics 2016-09-12 Róbert Tóth , Ján Somorčík

Given data in $\mathbb{R}^{p}$, a Tukey $\kappa$-trimmed region is the set of all points that have at least Tukey depth $\kappa$ w.r.t. the data. As they are visual, affine equivariant and robust, Tukey regions are useful tools in…

Computation · Statistics 2018-11-09 Xiaohui Liu , Karl Mosler , Pavlo Mozharovskyi

Sufficient dimension reduction aims for reduction of dimensionality of a regression without loss of information by replacing the original predictor with its lower-dimensional subspace. Partial (sufficient) dimension reduction arises when…

Methodology · Statistics 2019-09-27 Lu Li , Kai Tan , Xuerong Meggie Wen , Zhou Yu