English
Related papers

Related papers: Adaptive Discrete Smoothing for High-Dimensional a…

200 papers

We study nonparametric clustering of smooth random curves on the basis of the L2 gradient flow associated to a pseudo-density functional and we show that the clustering is well-defined both at the population and at the sample level. We…

Statistics Theory · Mathematics 2020-10-22 Mattia Ciollaro , Christopher R. Genovese , Daren Wang

An efficient method for obtaining low-density hyperplane separators in the unsupervised context is proposed. Low density separators can be used to obtain a partition of a set of data based on their allocations to the different sides of the…

Machine Learning · Statistics 2021-08-10 David P. Hofmeyr

How to find a natural grouping of a large real data set? Clustering requires a balance between abstraction and representation. To identify clusters, we need to abstract from superfluous details of individual objects. But we also need a rich…

Machine Learning · Computer Science 2026-01-19 Claudia Plant , Lena G. M. Bauer , Christian Böhm

In many complex applications, data heterogeneity and homogeneity exist simultaneously. Ignoring either one will result in incorrect statistical inference. In addition, coping with complex data that are non-Euclidean becomes more common. To…

Methodology · Statistics 2021-05-28 Zixuan Han , Tao Li , Jinhong You

High-fidelity numerical simulations of chaotic, high dimensional nonlinear dynamical systems are computationally expensive, necessitating the development of efficient surrogate models. Most surrogate models for such systems are…

Machine Learning · Computer Science 2026-03-16 Dibyajyoti Chakraborty , Hojin Kim , Romit Maulik

Detecting arbitrarily shaped clusters in high-dimensional noisy data is challenging for current clustering methods. We introduce SHADE (Structure-preserving High-dimensional Analysis with Density-based Exploration), the first deep…

Machine Learning · Computer Science 2024-10-10 Anna Beer , Pascal Weber , Lukas Miklautz , Collin Leiber , Walid Durani , Christian Böhm , Claudia Plant

Debiased machine learning estimators for smooth functionals in nonparametric models can exhibit substantial variability and instability, often leading practitioners to instead rely on parametric or semiparametric working models. Such…

Methodology · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke , Mark van der Laan

Density level sets can be estimated using plug-in methods, excess mass algorithms or a hybrid of the two previous methodologies. The plug-in algorithms are based on replacing the unknown density by some nonparametric estimator, usually the…

Statistics Theory · Mathematics 2016-11-26 A. Rodríguez-Casal , P. Saavedra-Nieves

Clustering aims to group unlabelled samples based on their similarities. It has become a significant tool for the analysis of high-dimensional data. However, most of the clustering methods merely generate pseudo labels and thus are unable…

Artificial Intelligence · Computer Science 2023-06-21 Tianyi Huang , Shenghui Cheng , Stan Z. Li , Zhengjun Zhang

The smoothing spline is one of the most popular curve-fitting methods, partly because of empirical evidence supporting its effectiveness and partly because of its elegant mathematical formulation. However, there are two obstacles that…

Statistics Theory · Mathematics 2012-09-11 Yu Ryan Yue , Daniel Simpson , Finn Lindgren , Håvard Rue

Density Estimation is one of the central areas of statistics whose purpose is to estimate the probability density function underlying the observed data. It serves as a building block for many tasks in statistical inference, visualization,…

Machine Learning · Statistics 2019-04-02 Zhipeng Wang , David W. Scott

This paper studies the high-dimensional quantile regression problem under the transfer learning framework, where possibly related source datasets are available to make improvements on the estimation or prediction based solely on the target…

Methodology · Statistics 2023-05-03 Yijiao Zhang , Zhongyi Zhu

This paper presents a novel algorithm, based upon the dependent Dirichlet process mixture model (DDPMM), for clustering batch-sequential data containing an unknown number of evolving clusters. The algorithm is derived via a low-variance…

Machine Learning · Computer Science 2013-11-04 Trevor Campbell , Miao Liu , Brian Kulis , Jonathan P. How , Lawrence Carin

In Astronomy, Survival Analysis and Epidemiology, among many other fields, doubly truncated data often appear. Double truncation generally induces a sampling bias, so ordinary estimators may be inconsistent. In this paper, smoothing spline…

Methodology · Statistics 2026-01-15 David Bamio , Jacobo de Uña-Álvarez

This paper constructs individual-specific density forecasts for a panel of firms or households using a dynamic linear model with common and heterogeneous coefficients as well as cross-sectional heteroskedasticity. The panel considered in…

Econometrics · Economics 2021-10-06 Laura Liu

Model-assisted estimators have attracted a lot of attention in the last three decades. These estimators attempt to make an efficient use of auxiliary information available at the estimation stage. A working model linking the survey variable…

Methodology · Statistics 2022-08-23 Mehdi Dagdoug , Camelia Goga , David Haziza

This paper constructs an ensemble-based sampling smoother for four-dimensional data assimilation using a Hybrid/Hamiltonian Monte-Carlo approach. The smoother samples efficiently from the posterior probability density of the solution at the…

Numerical Analysis · Computer Science 2015-05-19 Ahmed Attia , Vishwas Rao , Adrian Sandu

We explore clustering the softmax predictions of deep neural networks and introduce a novel probabilistic clustering method, referred to as k-sBetas. In the general context of clustering discrete distributions, the existing methods focused…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Florent Chiaroni , Malik Boudiaf , Amar Mitiche , Ismail Ben Ayed

A frequently occurring challenge in experimental and numerical observation is how to resolve features, such as spectral peaks - with center, width, height - and derivatives from measured data with unavoidable noise. Therefore, we develop a…

Data Analysis, Statistics and Probability · Physics 2025-10-03 Bert Mulder , Ad Lagendijk , Willem L. Vos

This paper proposes a post-model selection inference procedure, called targeted undersmoothing, designed to construct uniformly valid confidence sets for a broad class of functionals of sparse high-dimensional statistical models. These…

Statistics Theory · Mathematics 2018-06-08 Christian Hansen , Damian Kozbur , Sanjog Misra