English
Related papers

Related papers: High-Dimensional Density Estimation via SCA: An Ex…

200 papers

Dimension reduction is often an important step in the analysis of high-dimensional data. PCA is a popular technique to find the best low-dimensional approximation of high-dimensional data. However, classical PCA is very sensitive to…

Computation · Statistics 2019-01-14 Holger Cevallos-Valdiviezo , Stefan Van Aelst

We consider the dimensionality-reduction problem (finding a subspace approximation of observed data) for contaminated data in the high dimensional regime, where the number of observations is of the same magnitude as the number of variables…

Machine Learning · Statistics 2010-05-14 Huan Xu , Constantine Caramanis , Shie Mannor

This study proposes a radically alternate approach for extracting quantitative information from schlieren images. The method uses a scaled, derivative enhanced Gaussian process model to obtain true density estimates from two corresponding…

Fluid Dynamics · Physics 2022-08-23 Bryn Noel Ubald , Pranay Seshadri , Andrew Duncan

The availability of reliable, high-resolution climate and weather data is important to inform long-term decisions on climate adaptation and mitigation and to guide rapid responses to extreme events. Forecasting models are limited by…

We introduce a novel two-step approach for estimating a probability density function (pdf) given its samples, with the second and important step coming from a geometric formulation. The procedure involves obtaining an initial estimate of…

Methodology · Statistics 2017-12-14 Sutanoy Dasgupta , Debdeep Pati , Anuj Srivastava

This work proposes a sampling-based (non-intrusive) approach within the context of low-rank separated representations to tackle the issue of curse-of-dimensionality associated with the solution of models, e.g., PDEs/ODEs, with…

Mathematical Physics · Physics 2013-06-20 Alireza Doostan , AbdoulAhad Validi , Gianluca Iaccarino

As part of a project to develop more accurate estimates of the risks due to tropical cyclones, we describe a non-parametric method for the statistical simulation of the location of tropical cyclone genesis. The method avoids the use of…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Tim Hall , Stephen Jewson

We propose two ways of estimating the current source density (CSD) from measurements of voltage on a Cartesian grid with missing recording points using the inverse CSD method. The simplest approach is to substitute local averages (LA) in…

Quantitative Methods · Quantitative Biology 2009-03-16 Daniel K. Wojcik , Szymon Leski

High-dimensional astronomical data cubes provide a wealth of spectral and structural information that can be used to study astrophysical and chemical processes. The complexity and sheer size of these datasets pose significant challenges in…

Instrumentation and Methods for Astrophysics · Physics 2025-12-18 Haley N. Scolati , Ryan A. Loomis , Anthony J. Remijan , Kin Long Kelvin Lee

A stylized feature of high-dimensional data is that many variables have heavy tails, and robust statistical inference is critical for valid large-scale statistical inference. Yet, the existing developments such as Winsorization,…

Statistics Theory · Mathematics 2022-11-24 Jianqing Fan , Zhipeng Lou , Mengxin Yu

This article focuses on the robust principal component analysis (PCA) of high-dimensional data with elliptical distributions. We investigate the PCA of the sample spatial-sign covariance matrix in both nonsparse and sparse contexts,…

Methodology · Statistics 2025-07-08 Ping Zhao , Hongfei Wang , Long Feng

In several application domains, high-dimensional observations are collected and then analysed in search for naturally occurring data clusters which might provide further insights about the nature of the problem. In this paper we describe a…

Machine Learning · Statistics 2012-03-07 Brian McWilliams , Giovanni Montana

Multidimensional data is often associated with uncertainties that are not well-described by normal distributions. In this work, we describe how such distributions can be projected to a low-dimensional space using uncertainty-aware principal…

Machine Learning · Statistics 2026-01-15 Daniel Klötzl , Ozan Tastekin , David Hägele , Marina Evers , Daniel Weiskopf

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

Econometrics · Economics 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

Particularly important to hurricane risk assessment for coastal regions is finding accurate approximations of return probabilities of maximum windspeeds. Since extremes in maximum windspeed have a direct relationship to minimums in the…

Dynamical Systems · Mathematics 2021-11-23 Meagan Carney , Holger Kantz , Matthew Nicol

High-dimensional multivariate spatial-temporal data arise frequently in a wide range of applications; however, there are relatively few statistical methods that can simultaneously deal with spatial, temporal and variable-wise dependencies…

Methodology · Statistics 2020-02-05 Elynn Y. Chen , Xin Yun , Rong Chen , Qiwei Yao

Parameter estimation is one of the most important tasks in statistics, and is key to helping people understand the distribution behind a sample of observations. Traditionally parameter estimation is done either by closed-form solutions…

Machine Learning · Computer Science 2024-03-04 Xiaoxin Yin , David S. Yin

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

We propose a method for the unsupervised clustering of hyperspectral images based on spatially regularized spectral clustering with ultrametric path distances. The proposed method efficiently combines data density and geometry to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Shukun Zhang , James M. Murphy

We describe results from the second stage of a project to build a statistical model for hurricane tracks. In the first stage we modelled the unconditional mean track. We now attempt to model the unconditional variance of fluctuations around…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Tim Hall , Stephen Jewson