English
Related papers

Related papers: Dimension Reduction for Spatially Correlated Data:…

200 papers

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

This paper introduces a robust estimation strategy for the spatial functional linear regression model using dimension reduction methods, specifically functional principal component analysis (FPCA) and functional partial least squares…

Methodology · Statistics 2024-10-28 Ufuk Beyaztas , Abhijit Mandal , Han Lin Shang

We propose a novel and computationally efficient approach for nonparametric conditional density estimation in high-dimensional settings that achieves dimension reduction without imposing restrictive distributional or functional form…

Econometrics · Economics 2025-10-14 Jianhua Mei , Fu Ouyang , Thomas T. Yang

This is a tutorial and survey paper on various methods for Sufficient Dimension Reduction (SDR). We cover these methods with both statistical high-dimensional regression perspective and machine learning approach for dimensionality…

Methodology · Statistics 2021-10-20 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Predict a new response from a covariate is a challenging task in regression, which raises new question since the era of high-dimensional data. In this paper, we are interested in the inverse regression method from a theoretical viewpoint.…

Statistics Theory · Mathematics 2018-07-10 Emilie Devijver , Emeline Perthame

In an ever-increasing interest for Machine Learning (ML) and a favorable data development context, we here propose an original methodology for data-based prediction of two-dimensional physical fields. Polynomial Chaos Expansion (PCE),…

Computational Physics · Physics 2021-02-03 Rem-Sophia Mouradi , Cédric Goeury , Olivier Thual , Fabrice Zaoui , Pablo Tassi

Best linear unbiased prediction is well known for its wide range of applications including small area estimation. While the theory is well established for mixed linear models and under normality of the error and mixing distributions, the…

Statistics Theory · Mathematics 2007-06-13 Soumendra N. Lahiri , Tapabrata Maiti , Myron Katzoff , Van Parsons

Small area estimators that ignore the sampling design lack design consistency when the sampling mechanism is complex and may be severely biased under informative designs. Existing procedures that account for the survey weights under…

Methodology · Statistics 2026-03-12 William Acero , Domingo Morales , Isabel Molina

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

A powerful and flexible approach to structured prediction consists in embedding the structured objects to be predicted into a feature space of possibly infinite dimension by means of output kernels, and then, solving a regression problem in…

Machine Learning · Statistics 2020-11-03 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

Dimension reduction lies at the heart of many statistical methods. In regression, dimension reduction has been linked to the notion of sufficiency whereby the relation of the response to a set of predictors is explained by a lower…

Methodology · Statistics 2020-06-02 Hyung Park , Eva Petkova , Thaddeus Tarpey , R. Todd Ogden

The coefficients in a second order parabolic linear stochastic partial differential equation (SPDE) are estimated from multiple spatially localised measurements. Assuming that the spatial resolution tends to zero and the number of…

Statistics Theory · Mathematics 2024-07-26 Randolf Altmeyer , Anton Tiepner , Martin Wahl

We address the challenge of correlated predictors in high-dimensional GLMs, where regression coefficients range from sparse to dense, by proposing a data-driven random projection method. This is particularly relevant for applications where…

Methodology · Statistics 2025-12-30 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

Dimension reduction, widely used in science, maps high-dimensional data into low-dimensional space. We investigate a basic mathematical model underlying the techniques of stochastic neighborhood embedding (SNE) and its popular variant…

Machine Learning · Statistics 2025-03-26 Ben Weinkove

Across many scientific fields, measurements often represent the number of times an event occurs. For example, a document can be represented by word occurrence counts, neural activity by spike counts per time window, or online communication…

Machine Learning · Statistics 2026-04-21 Noga Mudrik , Adam S. Charles

This work aims at making a comprehensive contribution in the general area of parametric inference for discretely observed diffusion processes. Established approaches for likelihood-based estimation invoke a time-discretisation scheme for…

Methodology · Statistics 2024-01-30 Yuga Iguchi , Alexandros Beskos , Matthew M. Graham

Neural Posterior Estimation (NPE) enables rapid parameter inference for complex simulators with intractable likelihoods. NPE trains an inference network to estimate a probability density over parameters given data, typically assumed to be…

Machine Learning · Computer Science 2026-05-14 Jan Boelts , Cornelius Schröder , Jonas Beck , Jakob H. Macke , Michael Deistler , Daniel Gedon

High-dimensional imaging is becoming increasingly relevant in many fields from astronomy and cultural heritage to systems biology. Visual exploration of such high-dimensional data is commonly facilitated by dimensionality reduction.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Alexander Vieth , Anna Vilanova , Boudewijn Lelieveldt , Elmar Eisemann , Thomas Höllt

We endeavour to estimate numerous multi-dimensional means of various probability distributions on a common space based on independent samples. Our approach involves forming estimators through convex combinations of empirical means derived…

Machine Learning · Statistics 2025-03-11 Gilles Blanchard , Jean-Baptiste Fermanian , Hannah Marienwald