English
Related papers

Related papers: Composition Estimation via Shrinkage

200 papers

Compositional data, representing proportions constrained to the simplex, arise in diverse fields such as geosciences, ecology, genomics, and microbiome research. Existing nonparametric density estimation methods often rely on…

Methodology · Statistics 2025-10-10 Jiajin Xie , Yong Wang , Eduardo García-Portugués

We study algorithms for estimating the statistical leverage scores of rectangular dense or sparse matrices of arbitrary rank. Our approach is based on combining rank revealing methods with compositions of dense and sparse randomized…

Data Structures and Algorithms · Computer Science 2022-03-08 Aleksandros Sobczyk , Efstratios Gallopoulos

A method to estimate an acoustic field from discrete microphone measurements is proposed. A kernel-interpolation-based method using the kernel function formulated for sound field interpolation has been used in various applications. The…

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

We consider the problem of approximating a two-dimensional shape contour (or curve segment) using discrete assembly systems, which allow to build geometric structures based on limited sets of node and edge types subject to edge length and…

Computational Geometry · Computer Science 2021-02-03 Andreas M. Tillmann , Leif Kobbelt

State-of-the-art machine learning methods exhibit limited compositional generalization. At the same time, there is a lack of realistic benchmarks that comprehensively measure this ability, which makes it challenging to find and evaluate…

We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than…

Machine Learning · Computer Science 2026-03-02 Karthik Elamvazhuthi , Abhijith Jayakumar , Andrey Y. Lokhov

We present a novel framework for the reconstruction of 1D composite signals assumed to be a mixture of two additive components, one sparse and the other smooth, given a finite number of linear measurements. We formulate the reconstruction…

Signal Processing · Electrical Eng. & Systems 2021-03-25 Thomas Debarre , Shayan Aziznejad , Michael Unser

In this paper we consider the problem of linear unmixing hidden random variables defined over the simplex with additive Gaussian noise, also known as probabilistic simplex component analysis (PRISM). Previous solutions to tackle this…

Signal Processing · Electrical Eng. & Systems 2023-07-26 Nerya Granot , Tzvi Diskin , Nicolas Dobigeon , Ami Wiesel

Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work,…

Information Theory · Computer Science 2017-01-11 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri

Model selection based on classical information criteria, such as BIC, is generally computationally demanding, but its properties are well studied. On the other hand, model selection based on parameter shrinkage by $\ell_1$-type penalties is…

Machine Learning · Statistics 2013-07-10 Kun Zhang , Heng Peng , Laiwan Chan , Aapo Hyvarinen

We introduce two a posteriori error estimators for N\'ed\'elec finite element discretizations of the curl-curl problem. These estimators pertain to a new Prager-Synge identity and an associated equilibration procedure. They are reliable and…

Numerical Analysis · Mathematics 2021-08-24 T. Chaumont-Frelet

Some prominent discretisation methods such as finite elements provide a way to approximate a function of $d$ variables from $n$ values it takes on the nodes $x_i$ of the corresponding mesh. The accuracy is $n^{-s_a/d}$ in $L^2$-norm, where…

Numerical Analysis · Mathematics 2024-07-19 Camille Pouchol , Marc Hoffmann

Penalized estimation principle is fundamental to high-dimensional problems. In the literature, it has been extensively and successfully applied to various models with only structural parameters. As a contrast, in this paper, we apply this…

Statistics Theory · Mathematics 2017-08-03 Jianqing Fan , Runlong Tang , Xiaofeng Shi

In many practical applications, such as fraud detection, credit risk modeling or medical decision making, classification models for assigning instances to a predefined set of classes are required to be both precise as well as interpretable.…

Machine Learning · Statistics 2021-09-27 Jakob Raymaekers , Wouter Verbeke , Tim Verdonck

This paper investigates the property of the penalized estimating equations when both the mean and association structures are modelled. To select variables for the mean and association structures sequentially, we propose a hierarchical…

Statistics Theory · Mathematics 2012-08-23 Xin Gao , Grace Y. Yi

In this technical report, we consider conditional density estimation with a maximum likelihood approach. Under weak assumptions, we obtain a theoretical bound for a Kullback-Leibler type loss for a single model maximum likelihood estimate.…

Statistics Theory · Mathematics 2012-07-11 Serge Cohen , Erwan Le Pennec

The restricted polynomially-tilted pairwise interaction (RPPI) distribution gives a flexible model for compositional data. It is particularly well-suited to situations where some of the marginal distributions of the components of a…

Methodology · Statistics 2023-05-15 Janice L. Scealy , Kassel L. Hingee , John T. Kent , Andrew T. A. Wood

We consider the problem of simultaneous variable selection and estimation in additive, partially linear models for longitudinal/clustered data. We propose an estimation procedure via polynomial splines to estimate the nonparametric…

Statistics Theory · Mathematics 2013-02-04 Shujie Ma , Qiongxia Song , Li Wang

Attaining reliable profile gradients is of utmost relevance for many physical systems. In most situations, the estimation of gradient can be inaccurate due to noise. It is common practice to first estimate the underlying system and then…

Data Analysis, Statistics and Probability · Physics 2021-05-31 Kushani De Silva , Carlo Cafaro , Adom Giffin