English
Related papers

Related papers: Noisy Independent Factor Analysis Model for Densit…

200 papers

This invited paper proposes and discusses several Bayesian attempts at nonparametric and semiparametric density estimation. The main categories of these ideas are as follows: 1) Build a nonparametric prior around a given parametric model.…

Statistics Theory · Mathematics 2026-04-23 Nils Lid Hjort

We consider estimation of a deterministic unknown parameter vector in a linear model with non-Gaussian noise. In the Gaussian case, dimensionality reduction via a linear matched filter provides a simple low dimensional sufficient statistic…

Applications · Statistics 2013-11-05 Jakob Vovnoboy , Ami Wiesel

The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data.…

Machine Learning · Statistics 2017-07-28 Hiroaki Sasaki , Michael U. Gutmann , Hayaru Shouno , Aapo Hyvärinen

Independent component analysis (ICA) is a cornerstone of modern data analysis. Its goal is to recover a latent random vector S with independent components from samples of X=AS where A is an unknown mixing matrix. Critically, all existing…

Machine Learning · Statistics 2018-04-04 Nilin Abrahamsen , Philippe Rigollet

We present an optimization framework for learning a fair classifier in the presence of noisy perturbations in the protected attributes. Compared to prior work, our framework can be employed with a very general class of linear and…

Machine Learning · Computer Science 2021-02-17 L. Elisa Celis , Lingxiao Huang , Vijay Keswani , Nisheeth K. Vishnoi

The matched filter (MF) is one of the most popular and reliable techniques to the detect signals of known structure and amplitude smaller than the level of the contaminating noise. Under the assumption of stationary Gaussian noise, MF…

Instrumentation and Methods for Astrophysics · Physics 2017-08-30 Roberto Vio , Clara Verges , Paola Andreani

Many important problems are characterized by the eigenvalues of a large matrix. For example, the difficulty of many optimization problems, such as those arising from the fitting of large models in statistics and machine learning, can be…

New problems arise when the standard theory of joint detection and estimation is applied to a set of signals drawn from a continuous family; decision thresholds must be determined as a function of the continuous parameter x characterizing…

Statistics Theory · Mathematics 2014-07-17 D. Michael Milder , Robert G. Lindgren , Morris M. Berman

We study an unbiased estimator for the density of a sum of random variables that are simulated from a computer model. A numerical study on examples with copula dependence is conducted where the proposed estimator performs favourably in…

Statistics Theory · Mathematics 2018-09-19 Patrick J. Laub , Robert Salomone , Zdravko I. Botev

This paper deals with the parametric inference for integrated signals embedded in an additive Gaussian noise and observed at deterministic discrete instants which are not necessarily equidistant. The unknown parameter is multidimensional…

Statistics Theory · Mathematics 2019-03-18 Dominique Dehay , Khalil El Waled , Vincent Monsan

Independent Component Analysis (ICA) recently has attracted attention in the statistical literature as an alternative to elliptical models. Whereas k-dimensional elliptical densities depend on one single unspecified radial density, however,…

Methodology · Statistics 2013-12-17 Marc Hallin , Chintan Mehta

Independent component analysis (ICA) is a widely used BSS method that can uniquely achieve source recovery, subject to only scaling and permutation ambiguities, through the assumption of statistical independence on the part of the latent…

Machine Learning · Statistics 2018-01-29 Zois Boukouvalas

This paper introduces a novel statistical framework for independent component analysis (ICA) of multivariate data. We propose methodology for estimating and testing the existence of mutually independent components for a given dataset, and a…

Methodology · Statistics 2013-06-21 David S. Matteson , Ruey S. Tsay

The model interpretation is essential in many application scenarios and to build a classification model with a ease of model interpretation may provide useful information for further studies and improvement. It is common to encounter with a…

Machine Learning · Statistics 2019-01-07 Wan-Ping Nicole Chen , Yuan-chin Ivan Chang

The matched filter (MF) is widely used to detect signals hidden within the noise. If the noise is Gaussian, its performances are well-known and describable in an elegant analytical form. The treatment of non-Gaussian noises is often…

Instrumentation and Methods for Astrophysics · Physics 2018-08-08 Roberto Vio , Paola Andreani

We are interested in consistent estimation of the mixing matrix in the ICA model, when the error distribution is close to (but different from) Gaussian. In particular, we consider $n$ independent samples from the ICA model $X = A\epsilon$,…

Statistics Theory · Mathematics 2014-08-26 Alexander Sokol , Marloes H. Maathuis , Benjamin Falkeborg

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

Nonparametric density estimation is an unsupervised learning problem. In this work we propose a two-step procedure that casts the density estimation problem in the first step into a supervised regression problem. The advantage is that we…

Statistics Theory · Mathematics 2024-06-04 Thijs Bos , Johannes Schmidt-Hieber

This paper addresses the estimation of uncertain distributed diffusion coefficients in elliptic systems based on noisy measurements of the model output. We formulate the parameter identification problem as an infinite dimensional…

Optimization and Control · Mathematics 2015-06-11 Jeff Borggaard , Hans-Werner van Wyk

Density regression provides a flexible strategy for modeling the distribution of a response variable $Y$ given predictors $\mathbf{X}=(X_1,\ldots,X_p)$ by letting that the conditional density of $Y$ given $\mathbf{X}$ as a completely…

Statistics Theory · Mathematics 2016-01-07 Weining Shen , Subhashis Ghosal