English
Related papers

Related papers: Parametric inference in the large data limit using…

200 papers

This paper introduces a Bayesian framework to detect multiple signals embedded in noisy observations from a sensor array. For various states of knowledge on the communication channel and the noise at the receiving sensors, a marginalization…

Information Theory · Computer Science 2009-09-08 Romain Couillet , Merouane Debbah

In this paper we derive information theoretic performance bounds to sensing and reconstruction of sparse phenomena from noisy projections. We consider two settings: output noise models where the noise enters after the projection and input…

Information Theory · Computer Science 2011-12-22 Shuchin Aeron , Venkatesh Saligrama , Manqi Zhao

In this paper we show how nuisance parameter marginalized posteriors can be inferred directly from simulations in a likelihood-free setting, without having to jointly infer the higher-dimensional interesting and nuisance parameter posterior…

Cosmology and Nongalactic Astrophysics · Physics 2019-07-17 Justin Alsing , Benjamin Wandelt

When modelling time series, it is common to decompose observed variation into a "signal" process, the process of interest, and "noise", representing nuisance factors that obfuscate the signal. To separate signal from noise, assumptions must…

Methodology · Statistics 2020-11-11 Richard Creswell , Ben Lambert , Chon Lok Lei , Martin Robinson , David Gavaghan

When classical particle filtering algorithms are used for maximum likelihood parameter estimation in nonlinear state-space models, a key challenge is that estimates of the likelihood function and its derivatives are inherently noisy. The…

Computation · Statistics 2017-11-30 Andreas Svensson , Fredrik Lindsten , Thomas B. Schön

Statistical inference on histograms and frequency counts plays a central role in categorical data analysis. Moving beyond classical methods that directly analyze labeled frequencies, we introduce a framework that models the multiset of…

Statistics Theory · Mathematics 2025-11-10 Yun Ma , Pengkun Yang

State estimation or filtering serves as a fundamental task to enable intelligent decision-making in applications such as autonomous vehicles, robotics, healthcare monitoring, smart grids, intelligent transportation, and predictive…

Machine Learning · Computer Science 2025-06-16 Aamir Hussain Chughtai

Network-linked data, where multivariate observations are interconnected by a network, are becoming increasingly prevalent in fields such as sociology and biology. These data often exhibit inherent noise and complex relational structures,…

Methodology · Statistics 2025-09-11 Jianxiang Wang , Can M. Le , Tianxi Li

We investigate the problem of transforming an input sequence into a high-dimensional output sequence in order to transcribe polyphonic audio music into symbolic notation. We introduce a probabilistic model based on a recurrent neural…

Machine Learning · Computer Science 2012-12-11 Nicolas Boulanger-Lewandowski , Yoshua Bengio , Pascal Vincent

This paper offers a qualitative insight into the convergence of Bayesian parameter inference in a setup which mimics the modeling of the spread of a disease with associated disease measurements. Specifically, we are interested in the…

Statistics Theory · Mathematics 2022-12-08 Samuel Bronstein , Stefan Engblom , Robin Marin

We theoretically investigate the phenomena of generalization and memorization in diffusion models. Empirical studies suggest that these phenomena are influenced by model complexity and the size of the training dataset. In our experiments,…

Machine Learning · Computer Science 2025-10-09 Anand Jerry George , Rodrigo Veiga , Nicolas Macris

This paper shows that the problem of testing hypotheses in moment condition models without any assumptions about identification may be considered as a problem of testing with an infinite-dimensional nuisance parameter. We introduce a…

Statistics Theory · Mathematics 2014-09-24 Isaiah Andrews , Anna Mikusheva

We consider the high-dimensional inference problem where the signal is a low-rank symmetric matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large…

Probability · Mathematics 2017-03-31 Marc Lelarge , Léo Miolane

Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate complex multivariate…

Methodology · Statistics 2019-06-25 Jean Feng , Noah Simon

Unbinned likelihood fits aim at maximizing the information one can extract from experimental data, yet their application in realistic statistical analyses is often hindered by the computational cost of profiling systematic uncertainties.…

High Energy Physics - Phenomenology · Physics 2026-02-16 Davide Valsecchi , Mauro Donegà , Rainer Wallny

Extracting meaning from uncertain, noisy data is a fundamental problem across time series analysis, pattern recognition, and language modeling. This survey presents a unified mathematical framework that connects classical estimation theory,…

Machine Learning · Computer Science 2025-08-22 Mohammed Elmusrati

In many data analysis applications the following scenario is commonplace: we are given a point set that is supposed to sample a hidden ground truth $K$ in a metric space, but it got corrupted with noise so that some of the data points lie…

Computational Geometry · Computer Science 2017-03-28 Mickaël Buchet , Tamal K. Dey , Jiayuan Wang , Yusu Wang

Impulse response estimation in high noise and in-the-wild settings, with minimal control of the underlying data distributions, is a challenging problem. We propose a novel framework for parameterizing and estimating impulse responses based…

Sound · Computer Science 2022-02-08 Alexander Richard , Peter Dodds , Vamsi Krishna Ithapu

Model-independent searches in particle physics aim at completing our knowledge of the universe by looking for new possible particles not predicted by the current theories. Such particles, referred to as signal, are expected to behave as a…

Applications · Statistics 2019-05-31 Alessandro Casa , Giovanna Menardi

The asymptotic variance of the maximum likelihood estimate is proved to decrease when the maximization is restricted to a subspace that contains the true parameter value. Maximum likelihood estimation allows a systematic fitting of…

Statistics Theory · Mathematics 2018-01-31 Marie Turčičová , Jan Mandel , Kryštof Eben