English
Related papers

Related papers: Extrinsic local regression on manifold-valued data

200 papers

In this paper, we target the problem of sufficient dimension reduction with symmetric positive definite matrices valued responses. We propose the intrinsic minimum average variance estimation method and the intrinsic outer product gradient…

Methodology · Statistics 2023-02-28 B. Chen , S. Dai , Z. Yu

Distributional regression aims to estimate the full conditional distribution of a target variable, given covariates. Popular methods include linear and tree-ensemble based quantile regression. We propose a neural network-based…

Methodology · Statistics 2024-07-08 Xinwei Shen , Nicolai Meinshausen

We introduce the setting of continuous index learning, in which a function of many variables varies only along a small number of directions at each point. For efficient estimation, it is beneficial for a learning algorithm to adapt, near…

Machine Learning · Statistics 2026-02-10 Alex Kokot , Anand Hemmady , Vydhourie Thiyageswaran , Marina Meila

Statistical inference for spatial processes from partially realized or scattered data has seen voluminous developments in diverse areas ranging from environmental sciences to business and economics. Inference on the associated rates of…

Statistics Theory · Mathematics 2026-01-06 Didong Li , Aritra Halder , Sudipto Banerjee

Over-parameterized models like deep nets and random forests have become very popular in machine learning. However, the natural goals of continuity and differentiability, common in regression models, are now often ignored in modern…

Machine Learning · Computer Science 2023-10-16 Mingxuan Han , Varun Shankar , Jeff M Phillips , Chenglong Ye

Invoking the manifold assumption in machine learning requires knowledge of the manifold's geometry and dimension, and theory dictates how many samples are required. However, in applications data are limited, sampling may not be uniform, and…

Machine Learning · Computer Science 2023-03-02 Luciano Dyballa , Steven W. Zucker

Amidst the growing interest in nonparametric regression, we address a significant challenge in Gaussian processes(GP) applied to manifold-based predictors. Existing methods primarily focus on low dimensional constrained domains for heat…

Optimization and Control · Mathematics 2024-02-01 Ke Ye , Mu Niu , Pokman Cheung , Zhenwen Dai , Yuan Liu

Manifold learning has been successfully applied to a variety of medical imaging problems. Its use in real-time applications requires fast projection onto the low-dimensional space. To this end, out-of-sample extensions are applied by…

Computer Vision and Pattern Recognition · Computer Science 2013-03-29 George H. Chen , Christian Wachinger , Polina Golland

We consider the problem of reconstructing an embedding of a compact connected Riemannian manifold in a Euclidean space up to an almost isometry, given the information on intrinsic distances between points from its ``sufficiently large''…

Optimization and Control · Mathematics 2024-01-26 Nikita Puchkin , Vladimir Spokoiny , Eugene Stepanov , Dario Trevisan

Locally weighted regression was created as a nonparametric learning method that is computationally efficient, can learn from very large amounts of data and add data incrementally. An interesting feature of locally weighted regression is…

Machine Learning · Computer Science 2014-02-05 Franziska Meier , Philipp Hennig , Stefan Schaal

Causal inference is central to statistics and scientific discovery, enabling researchers to identify cause-and-effect relationships beyond associations. While traditionally studied within Euclidean spaces, contemporary applications…

Methodology · Statistics 2025-07-01 Satarupa Bhattacharjee , Bing Li , Xiao Wu , Lingzhou Xue

We present a new framework for statistical inference on Riemannian manifolds that achieves high-order accuracy, addressing the challenges posed by non-Euclidean parameter spaces frequently encountered in modern data science. Our approach…

Statistics Theory · Mathematics 2026-02-03 Chengzhu Huang , Anru R. Zhang

This report concerns the problem of dimensionality reduction through information geometric methods on statistical manifolds. While there has been considerable work recently presented regarding dimensionality reduction for the purposes of…

Machine Learning · Statistics 2008-09-30 Kevin M. Carter , Raviv Raich , Alfred O. Hero

It is becoming increasingly common for researchers to consider incorporating external information from large studies to improve the accuracy of statistical inference instead of relying on a modestly sized dataset collected internally. With…

Methodology · Statistics 2021-07-20 Tian Gu , Jeremy M. G. Taylor , Bhramar Mukherjee

Nonlinear manifold learning from unorganized data points is a very challenging unsupervised learning and data visualization problem with a great variety of applications. In this paper we present a new algorithm for manifold learning and…

Machine Learning · Computer Science 2016-08-31 Zhenyue Zhang , Hongyuan Zha

Modeling data using manifold values is a powerful concept with numerous advantages, particularly in addressing nonlinear phenomena. This approach captures the intrinsic geometric structure of the data, leading to more accurate descriptors…

Numerical Analysis · Mathematics 2025-07-08 Wael Mattar , Nir Sharon

Given an m-dimensional compact submanifold $\mathbf{M}$ of Euclidean space $\mathbf{R}^s$, the concept of mean location of a distribution, related to mean or expected vector, is generalized to more general $\mathbf{R}^s$-valued functionals…

Statistics Theory · Mathematics 2007-08-07 Harrie Hendriks , Zinoviy Landsman

We extend decision tree and random forest algorithms to product space manifolds: Cartesian products of Euclidean, hyperspherical, and hyperbolic manifolds. Such spaces have extremely expressive geometries capable of representing many…

Machine Learning · Computer Science 2025-05-08 Philippe Chlenski , Quentin Chu , Itsik Pe'er

We reveal the phenomenon that ``naive'' multivariate local polynomial regression can adapt to local smooth lower dimensional structure in the sense that it achieves the optimal convergence rate for nonparametric estimation of regression…

Statistics Theory · Mathematics 2009-09-29 Peter J. Bickel , Bo Li

Manifold-learning techniques are routinely used in mining complex spatiotemporal data to extract useful, parsimonious data representations/parametrizations; these are, in turn, useful in nonlinear model identification tasks. We focus here…