English
Related papers

Related papers: Generalized multi-view model: Adaptive density est…

200 papers

Sampling from discrete distributions is a ubiquitous task in machine learning, recently revisited by the emergence of discrete diffusion models. While Langevin algorithms constitute the state of the art for continuous spaces, discrete…

Statistics Theory · Mathematics 2026-02-18 Armand Gissler , Saeed Saremi , Francis Bach

The authors consider the problem of estimating the density $g$ of independent and identically distributed variables $X\_i$, from a sample $Z\_1, ..., Z\_n$ where $Z\_i=X\_i+\sigma\epsilon\_i$, $i=1, ..., n$, $\epsilon$ is a noise…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Yves Rozenholc , Marie-Luce Taupin

Recent work suggests that some auto-encoder variants do a good job of capturing the local manifold structure of the unknown data generating density. This paper contributes to the mathematical understanding of this phenomenon and helps…

Machine Learning · Computer Science 2012-07-03 Yoshua Bengio , Guillaume Alain , Salah Rifai

Flexibly modeling how an entire density changes with covariates is an important but challenging generalization of mean and quantile regression. While existing methods for density regression primarily consist of covariate-dependent discrete…

Methodology · Statistics 2021-12-24 Vittorio Orlandi , Jared Murray , Antonio Linero , Alexander Volfovsky

Analysis of random censored life-time data along with some related stochastic covariables is of great importance in many applied sciences like medical research, population studies and planning etc. The parametric estimation technique…

Statistics Theory · Mathematics 2019-05-09 Abhik Ghosh , Ayanendranath Basu

In this paper, we study properties of penalized and structured M-estimators of multivariate scatter, based on geodesically convex but not necessarily smooth penalty functions. Existence and uniqueness conditions for these penalized and…

Methodology · Statistics 2026-03-31 Mengxi Yi , David Tyler

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

Statistics Theory · Mathematics 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

This paper is devoted to the estimation of the common marginal density function of weakly dependent processes. The accuracy of estimation is measured using pointwise risks. We propose a datadriven procedure using kernel rules. The bandwidth…

Statistics Theory · Mathematics 2016-04-04 Karine Bertin , Nicolas Klutchnikoff

For the sparse vector model, we consider estimation of the target vector, of its L2-norm and of the noise variance. We construct adaptive estimators and establish the optimal rates of adaptive estimation when adaptation is considered with…

Statistics Theory · Mathematics 2020-03-04 Laëtitia Comminges , Olivier Collier , Mohamed Ndaoud , Alexandre B. Tsybakov

In the measurement-constrained problems, despite the availability of large datasets, we may be only affordable to observe the labels on a small portion of the large dataset. This poses a critical question that which data points are most…

Statistics Theory · Mathematics 2024-11-22 Jingyi Duan , Yang Ning

High-dimensional classification has become an increasingly important problem. In this paper we propose a "Multivariate Adaptive Stochastic Search" (MASS) approach which first reduces the dimension of the data space and then applies a…

Applications · Statistics 2010-10-08 Tian Siva Tian , Gareth M. James , Rand R. Wilcox

For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. Using the Feldman-Hajek theorem, we analyse the prior-to-posterior…

Statistics Theory · Mathematics 2025-04-07 Giuseppe Carere , Han Cheng Lie

A $d$-dimensional nonparametric additive regression model with dependent observations is considered. Using the marginal integration technique and wavelets methodology, we develop a new adaptive estimator for a component of the additive…

Statistics Theory · Mathematics 2012-08-07 Christophe Chesneau , Jalal M. Fadili , Bertrand Maillot

Parameter-dependent models arise in many contexts such as uncertainty quantification, sensitivity analysis, inverse problems or optimization. Parametric or uncertainty analyses usually require the evaluation of an output of a model for many…

Numerical Analysis · Mathematics 2018-10-22 Anthony Nouy

The $\beta$ ensembles are a class of eigenvalue probability densities which generalise the invariant ensembles of classical random matrix theory. In the case of the Gaussian and Laguerre weights, the corresponding eigenvalue densities are…

Mathematical Physics · Physics 2018-12-20 Peter J. Forrester , Allan K. Trinh

We suppose that a L\'evy process is observed at discrete time points. Starting from an asymptotically minimax family of estimators for the continuous part of the L\'evy Khinchine characteristics, i.e., the covariance, we derive a…

Statistics Theory · Mathematics 2020-12-01 Katerina Papagiannouli

Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical…

Machine Learning · Statistics 2025-10-02 Dehao Dai , Jianqing Fan , Yihong Gu , Debarghya Mukherjee

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

Optimization and Control · Mathematics 2018-01-19 Koulik Khamaru , Rahul Mazumder

We show that when a high-dimensional data matrix is the sum of a low-rank matrix and a random error matrix with independent entries, the low-rank component can be consistently estimated by solving a convex minimization problem. We develop a…

Econometrics · Economics 2019-11-14 Jushan Bai , Junlong Feng

This paper proposes a novel method for testing observability in Gaussian models using discrete density approximations (deterministic samples) of (multivariate) Gaussians. Our notion of observability is defined by the existence of the…

Systems and Control · Electrical Eng. & Systems 2022-08-19 Ariane Hanebeck , Claudia Czado