English
Related papers

Related papers: Sufficient dimension reduction for regression with…

200 papers

Low-dimensional embeddings for data from disparate sources play critical roles in multi-modal machine learning, multimedia information retrieval, and bioinformatics. In this paper, we propose a supervised dimensionality reduction method…

Machine Learning · Computer Science 2021-01-15 Yanjun Li , Bihan Wen , Hao Cheng , Yoram Bresler

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

The arrangement of network nodes in hyperbolic spaces has become a widely studied problem, motivated by numerous results suggesting the existence of hidden metric spaces behind the structure of complex networks. Although several methods…

Physics and Society · Physics 2023-02-06 Bianka Kovács , Gergely Palla

Regression with random data objects is becoming increasingly common in modern data analysis. Unfortunately, this novel regression method is not immune to the trouble caused by unusual observations. A metric Cook's distance extending the…

Computation · Statistics 2024-07-08 Abdul-Nasah Soale

Datasets with non-trivial large scale topology can be hard to embed in low-dimensional Euclidean space with existing dimensionality reduction algorithms. We propose to model topologically complex datasets using vector bundles, in such a way…

Computational Geometry · Computer Science 2023-03-17 Luis Scoccola , Jose A. Perea

In this paper, we address the problem of predicting a response variable in the context of both, spatially correlated and high-dimensional data. To reduce the dimensionality of the predictor variables, we apply the sufficient dimension…

Methodology · Statistics 2025-02-06 Liliana Forzani , Rodrigo García Arancibia , Antonella Gieco , Pamela Llop , Anne Yao

In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding…

Machine Learning · Computer Science 2021-11-30 Michaël Fanuel , Antoine Aspeel , Jean-Charles Delvenne , Johan A. K. Suykens

The Fr\'echet regression is a useful method for modeling random objects in a general metric space given Euclidean covariates. However, the conventional approach could be sensitive to outlying objects in the sense that the distance from the…

Computation · Statistics 2026-01-21 Hao Li , Shonosuke Sugasawa , Shota Katayama

Non-Euclidean data that are indexed with a scalar predictor such as time are increasingly encountered in data applications, while statistical methodology and theory for such random objects are not well developed yet. To address the need for…

Methodology · Statistics 2021-08-24 Zhenhua Lin , Hans-Georg Müller

Sufficient dimension reduction methods often require stringent conditions on the joint distribution of the predictor, or, when such conditions are not satisfied, rely on marginal transformation or reweighting to fulfill them approximately.…

Statistics Theory · Mathematics 2009-04-27 Bing Li , Yuexiao Dong

Random objects are complex non-Euclidean data taking value in general metric space, possibly devoid of any underlying vector space structure. Such data are getting increasingly abundant with the rapid advancement in technology. Examples…

Methodology · Statistics 2023-10-13 Satarupa Bhattacharjee , Bing Li , Lingzhou Xue

We present a novel framework for variable selection in Fr\'echet regression with responses in general metric spaces, a setting increasingly relevant for analyzing non-Euclidean data such as probability distributions and covariance matrices.…

Statistics Theory · Mathematics 2025-09-18 Haoyi Yang , Satarupa Bhattacharjee , Lingzhou Xue , Bing Li

Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging results in many computer vision tasks.$L2$-normalization in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Xuefei Zhe , Shifeng Chen , Hong Yan

This is a tutorial and survey paper on various methods for Sufficient Dimension Reduction (SDR). We cover these methods with both statistical high-dimensional regression perspective and machine learning approach for dimensionality…

Methodology · Statistics 2021-10-20 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

A novel general framework is proposed in this paper for dimension reduction in regression to fill the gap between linear and fully nonlinear dimension reduction. The main idea is to transform first each of the raw predictors monotonically,…

Methodology · Statistics 2014-01-03 Tao Wang , Xu Guo , Peirong Xu , Lixing Zhu

Having a large number of covariates can have a negative impact on the quality of causal effect estimation since confounding adjustment becomes unreliable when the number of covariates is large relative to the samples available. Propensity…

Methodology · Statistics 2020-09-15 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu

This paper models categorical data with two or multiple responses, focusing on the interactions between responses. We propose an efficient iterative procedure based on sufficient dimension reduction. We study the theoretical guarantees of…

Methodology · Statistics 2022-10-24 Yuehan Yang

This paper introduces a novel uncertainty quantification framework for regression models where the response takes values in a separable metric space, and the predictors are in a Euclidean space. The proposed algorithms can efficiently…

Statistics Theory · Mathematics 2024-05-09 Gábor Lugosi , Marcos Matabuena

The development and use of dimension reduction methods is prevalent in modern statistical literature. This paper reviews a class of dimension reduction techniques which aim to simultaneously select relevant predictors and find clusters…

Methodology · Statistics 2022-02-18 Suchit Mehrotra

We consider dimension reduction for regression or classification in which the predictors are matrix- or array-valued. This type of predictor arises when measurements are obtained for each combination of two or more underlying variables--for…

Statistics Theory · Mathematics 2010-02-26 Bing Li , Min Kyung Kim , Naomi Altman