English
Related papers

Related papers: Mixed Noise and Posterior Estimation with Conditio…

200 papers

Pel-recursive motion estimation isa well-established approach. However, in the presence of noise, it becomes an ill-posed problem that requires regularization. In this paper, motion vectors are estimated in an iterative fashion by means of…

Computer Vision and Pattern Recognition · Computer Science 2014-03-31 Vania Vieira Estrela , Marcos Henrique da Silva Bassani

Bayesian inference provides a natural way of incorporating prior beliefs and assigning a probability measure to the space of hypotheses. Current solutions rely on iterative routines like Markov Chain Monte Carlo (MCMC) sampling and…

Machine Learning · Computer Science 2025-02-11 Sarthak Mittal , Niels Leif Bracher , Guillaume Lajoie , Priyank Jaini , Marcus Brubaker

When recovering an unknown signal from noisy measurements, the computational difficulty of performing optimal Bayesian MMSE (minimum mean squared error) inference often necessitates the use of maximum a posteriori (MAP) inference, a special…

Machine Learning · Statistics 2016-09-23 Madhu Advani , Surya Ganguli

The Expectation-Maximization (EM) algorithm is one of the most popular methods used to solve the problem of parametric distribution-based clustering in unsupervised learning. In this paper, we propose to analyze a generalized EM (GEM)…

Optimization and Control · Mathematics 2021-05-19 Sarthak Chatterjee , Orlando Romero , Sérgio Pequito

In some situations, EM algorithm shows slow convergence problems. One possible reason is that standard procedures update the parameters simultaneously. In this paper we focus on finite mixture estimation. In this framework, we propose a…

Computation · Statistics 2012-01-31 Gilles Celeux , Stéphane Chrétien , Florence Forbes

This paper addresses the estimation of parameters of a Bayesian network from incomplete data. The task is usually tackled by running the Expectation-Maximization (EM) algorithm several times in order to obtain a high log-likelihood…

Machine Learning · Computer Science 2015-03-19 Giorgio Corani , Cassio P. De Campos

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

In this paper, we consider the problem of automatic modulation classification with multiple sensors in the presence of unknown time offset, phase offset and received signal amplitude. We develop a novel hybrid maximum likelihood (HML)…

Other Computer Science · Computer Science 2015-02-05 O. Ozdemir , T. Wimalajeewa , B. Dulek , P. K. Varshney , W. Su

In this letter, we employ and design the expectation--conditional maximization either (ECME) algorithm, a generalisation of the EM algorithm, for solving the maximum likelihood direction finding problem of stochastic sources, which may be…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Ming-yan Gong , Bin Lyu

This paper considers estimating the parameters in a regime-switching stochastic differential equation(SDE) driven by Normal Inverse Gaussian(NIG) noise. The model under consideration incorporates a continuous-time finite state Markov chain…

Computation · Statistics 2024-12-10 Yuzhong Cheng , Hiroki Masuda

Bayesian inference for hierarchical models can be very challenging. MCMC methods have difficulty scaling to large models with many observations and latent variables. While variational inference (VI) and reweighted wake-sleep (RWS) can be…

Machine Learning · Statistics 2025-03-12 Thomas Heap , Sam Bowyer , Laurence Aitchison

Structural identification and damage detection can be generalized as the simultaneous estimation of input forces, physical parameters, and dynamical states. Although Kalman-type filters are efficient tools to address this problem, the…

Applications · Statistics 2022-10-04 Daniz Teymouri , Omid Sedehi , Lambros S. Katafygiotis , Costas Papadimitriou

Neural Posterior Estimation (NPE) enables rapid parameter inference for complex simulators with intractable likelihoods. NPE trains an inference network to estimate a probability density over parameters given data, typically assumed to be…

Machine Learning · Computer Science 2026-05-14 Jan Boelts , Cornelius Schröder , Jonas Beck , Jakob H. Macke , Michael Deistler , Daniel Gedon

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian…

Machine Learning · Statistics 2023-03-28 Pierre Houdouin , Esa Ollila , Frederic Pascal

Diffusion models recently proved to be remarkable priors for Bayesian inverse problems. However, training these models typically requires access to large amounts of clean data, which could prove difficult in some settings. In this work, we…

Machine Learning · Computer Science 2025-11-04 François Rozet , Gérôme Andry , François Lanusse , Gilles Louppe

In this paper, the use of the Generalized Beta Mixture (GBM) and Horseshoe distributions as priors in the Bayesian Compressive Sensing framework is proposed. The distributions are considered in a two-layer hierarchical model, making the…

Information Theory · Computer Science 2014-11-11 Zahra Sabetsarvestani , Hamidreza Amindavar

The expectation--maximization (EM) algorithm updates all of the parameter estimates simultaneously, which is not applicable to direction of arrival (DOA) estimation in unknown nonuniform noise. In this work, we present several efficient…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Ming-yan Gong , Bin Lyu

Multiplicative noise arises in inverse problems when, for example, uncertainty on measurements is proportional to the size of the measurement itself. The likelihood that arises is hence more complicated than that from additive noise. We…

Statistics Theory · Mathematics 2019-11-01 Matthew M. Dunlop

We provide a general theory of the expectation-maximization (EM) algorithm for inferring high dimensional latent variable models. In particular, we make two contributions: (i) For parameter estimation, we propose a novel high dimensional EM…

Machine Learning · Statistics 2015-01-28 Zhaoran Wang , Quanquan Gu , Yang Ning , Han Liu

This paper studies the problem of estimation from relative measurements in a graph, in which a vector indexed over the nodes has to be reconstructed from pairwise measurements of differences between its components associated to nodes…

Systems and Control · Computer Science 2018-07-27 Chiara Ravazzi , Nelson P. K. Chan , Paolo Frasca