English
Related papers

Related papers: Random Forest Weighted Local Fr\'echet Regression …

200 papers

Over-parameterized models like deep nets and random forests have become very popular in machine learning. However, the natural goals of continuity and differentiability, common in regression models, are now often ignored in modern…

Machine Learning · Computer Science 2023-10-16 Mingxuan Han , Varun Shankar , Jeff M Phillips , Chenglong Ye

Non-Euclidean data that are indexed with a scalar predictor such as time are increasingly encountered in data applications, while statistical methodology and theory for such random objects are not well developed yet. To address the need for…

Methodology · Statistics 2021-08-24 Zhenhua Lin , Hans-Georg Müller

Global Fr\'echet regression is addressed from the observation of a strictly stationary bivariate curve process, evaluated in a finite--dimensional compact differentiable Riemannian manifold, with bounded positive smooth sectional curvature.…

Statistics Theory · Mathematics 2025-02-14 A. Torres-Signes , M. P. Frías , M. D. Ruiz-Medina

An increasing array of biomedical and computer vision applications requires the predictive modeling of complex data, for example images and shapes. The main challenge when predicting such objects lies in the fact that they do not comply to…

Machine Learning · Statistics 2017-02-17 Dimosthenis Tsagkrasoulis , Giovanni Montana

Classical methods for quantile regression fail in cases where the quantile of interest is extreme and only few or no training data points exceed it. Asymptotic results from extreme value theory can be used to extrapolate beyond the range of…

Methodology · Statistics 2024-01-23 Nicola Gnecco , Edossa Merga Terefe , Sebastian Engelke

The random forest (RF) algorithm has become a very popular prediction method for its great flexibility and promising accuracy. In RF, it is conventional to put equal weights on all the base learners (trees) to aggregate their predictions.…

Machine Learning · Statistics 2023-05-18 Xinyu Chen , Dalei Yu , Xinyu Zhang

With the increasing availability of non-Euclidean data objects, statisticians are faced with the task of developing appropriate statistical methods for their analysis. For regression models in which the predictors lie in $\mathbb{R}^p$ and…

Methodology · Statistics 2023-03-24 Aritra Ghosal , Wendy Meiring , Alexander Petersen

With the rapid development of data collection techniques, complex data objects that are not in the Euclidean space are frequently encountered in new statistical applications. Fr\'echet regression model (Peterson & M\"uller 2019) provides a…

Methodology · Statistics 2022-12-08 Qi Zhang , Lingzhou Xue , Bing Li

Across many scientific disciplines, multiple observations are collected from the same experimental units, and in modern datasets these observations often arise as non-Euclidean random objects. In such settings, the incorporation of random…

Machine Learning · Statistics 2026-05-05 Marcos Matabuena , Mateo Cámara

Fr\'echet regression has emerged as a useful tool for modeling non-Euclidean response variables associated with Euclidean covariates. In this work, we propose a global Fr\'echet regression estimation method that incorporates low-rank…

Methodology · Statistics 2025-05-09 Kyunghee Han , Hsin-Hsiung Huang

Random forests are one of the most popular machine learning methods due to their accuracy and variable importance assessment. However, random forests only provide variable importance in a global sense. There is an increasing need for such…

Methodology · Statistics 2021-03-25 Joshua Daniel Loyal , Ruoqing Zhu , Yifan Cui , Xin Zhang

Regression with distribution-valued responses and Euclidean predictors has gained increasing scientific relevance. While methodology for univariate distributional data has advanced rapidly in recent years, multivariate distributions, which…

Methodology · Statistics 2026-03-10 Junyoung Park , Irina Gaynanova

Fr\'echet regression extends classical regression methods to non-Euclidean metric spaces, enabling the analysis of data relationships on complex structures such as manifolds and graphs. This work establishes a rigorous theoretical analysis…

Machine Learning · Statistics 2025-02-05 Masanari Kimura , Howard Bondell

Assume we are given a set of items from a general metric space, but we neither have access to the representation of the data nor to the distances between data points. Instead, suppose that we can actively choose a triplet of items (A,B,C)…

Machine Learning · Statistics 2018-06-19 Siavash Haghiri , Damien Garreau , Ulrike von Luxburg

Single index models provide an effective dimension reduction tool in regression, especially for high dimensional data, by projecting a general multivariate predictor onto a direction vector. We propose a novel single-index model for…

Methodology · Statistics 2023-07-13 Satarupa Bhattacharjee , Hans-Georg Müller

We propose the orthogonal random forest, an algorithm that combines Neyman-orthogonality to reduce sensitivity with respect to estimation error of nuisance parameters with generalized random forests (Athey et al., 2017)--a flexible…

Machine Learning · Computer Science 2019-09-27 Miruna Oprescu , Vasilis Syrgkanis , Zhiwei Steven Wu

The present paper solves the problem of local linear approximation of the Fr\'echet conditional mean in an extrinsic and intrinsic way from time correlated bivariate curve data evaluated in a manifold (see Torres et al, 2025, on global…

Statistics Theory · Mathematics 2025-10-06 M. D. Ruiz-Medina , A. Torres-Signes

Local Polynomial Regression (LPR) is a widely used nonparametric method for modeling complex relationships due to its flexibility and simplicity. It estimates a regression function by fitting low-degree polynomials to localized subsets of…

Methodology · Statistics 2025-07-22 Yaniv Shulman

Linear regression is widely used to model relationships between responses and predictors. In modern applications, one encounters data where the responses are non-Euclidean random objects situated in a metric space, paired with Euclidean…

Methodology · Statistics 2026-05-20 Wookyeong Song , Paromita Dubey , Hans-Georg Müller , Alexander Petersen

To consider model uncertainty in global Fr\'{e}chet regression and improve density response prediction, we propose a frequentist model averaging method. The weights are chosen by minimizing a cross-validation criterion based on Wasserstein…

Methodology · Statistics 2023-09-06 Xingyu Yan , Xinyu Zhang , Peng Zhao