English
Related papers

Related papers: Noisy Expectation-Maximization: Applications and G…

200 papers

We present a new framework for analysing the Expectation Maximization (EM) algorithm. Drawing on recent advances in the theory of gradient flows over Euclidean-Wasserstein spaces, we extend techniques from alternating minimization in…

Machine Learning · Statistics 2025-11-21 Rocco Caprio , Adam M Johansen

Blind estimation of intersymbol interference channels based on the Baum-Welch (BW) algorithm, a specific implementation of the expectation-maximization (EM) algorithm for training hidden Markov models, is robust and does not require labeled…

Signal Processing · Electrical Eng. & Systems 2025-04-15 Chin-Hung Chen , Boris Karanov , Ivana Nikoloska , Wim van Houtum , Yan Wu , Alex Alvarado

The beneficial role of noise-injection in learning is a consolidated concept in the field of artificial neural networks, suggesting that even biological systems might take advantage of similar mechanisms to optimize their performance. The…

Disordered Systems and Neural Networks · Physics 2024-06-04 Marco Benedetti , Enrico Ventura

Expectation maximization (EM) algorithm is to find maximum likelihood solution for models having latent variables. A typical example is Gaussian Mixture Model (GMM) which requires Gaussian assumption, however, natural images are highly…

Machine Learning · Computer Science 2018-12-04 Wentian Zhao , Shaojie Wang , Zhihuai Xie , Jing Shi , Chenliang Xu

We introduce the spiked mixture model (SMM) to address the problem of estimating a set of signals from many randomly scaled and noisy observations. Subsequently, we design a novel expectation-maximization (EM) algorithm to recover all…

Machine Learning · Statistics 2026-01-26 Paul-Louis Delacour , Sander Wahls , Jeffrey M. Spraggins , Lukasz Migas , Raf Van de Plas

We propose a Bayesian expectation-maximization (EM) algorithm for reconstructing Markov-tree sparse signals via belief propagation. The measurements follow an underdetermined linear model where the regression-coefficient vector is the sum…

Machine Learning · Statistics 2013-08-27 Zhao Song , Aleksandar Dogandzic

The joint training of speech enhancement and speaker embedding networks for speaker recognition is widely adopted under noisy acoustic environments. While effective, this paradigm often fails to leverage the generalization and robustness…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Chong-Xin Gan , Peter Bell , Man-Wai Mak , Zhe Li , Zezhong Jin , Zilong Huang , Kong Aik Lee

We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on $n$ i.i.d. samples are known to have lower accuracy than the classical $n^{- \frac{1}{2}}$ error. We investigate…

Statistics Theory · Mathematics 2021-11-17 Raaz Dwivedi , Nhat Ho , Koulik Khamaru , Martin J. Wainwright , Michael I. Jordan , Bin Yu

In this paper we develop an Expectation Maximization(EM) algorithm to estimate the parameter of a Yule-Simon distribution. The Yule-Simon distribution exhibits the "rich get richer" effect whereby an 80-20 type of rule tends to dominate.…

Computation · Statistics 2020-11-17 Lucas Roberts , Denisa Roberts

It has been shown that injecting noise into the neural network weights during the training process leads to a better generalization of the resulting model. Noise injection in the distributed setup is a straightforward technique and it…

Machine Learning · Computer Science 2018-10-01 Linara Adilova , Nathalie Paul , Peter Schlicht

The aims of our research are to evaluate the prediction performance of the proposed neuro-fuzzy model with System Evaluation and Estimation of Resource Software Estimation Model (SEER-SEM) in software estimation practices and to apply the…

Software Engineering · Computer Science 2015-07-27 Wei Lin Du , Danny Ho , Luiz Fernando Capretz

Finite mixture models have been widely used for the modelling and analysis of data from heterogeneous populations. Maximum likelihood estimation of the parameters is typically carried out via the Expectation-Maximization (EM) algorithm. The…

Computation · Statistics 2016-06-08 Sharon X Lee , Kaleb L Lee , Geoffrey J McLachlan

Quantum advantage requires overcoming noise-induced degradation of quantum systems. Conventional methods for reducing noise such as error mitigation face scalability issues in deep circuits. Specifically, noise hampers the extraction of…

Quantum Physics · Physics 2023-12-05 Yonglong Ding , Ruyu Yang

We study the convergence rates of the EM algorithm for learning two-component mixed linear regression under all regimes of signal-to-noise ratio (SNR). We resolve a long-standing question that many recent results have attempted to tackle:…

Machine Learning · Statistics 2021-02-08 Jeongyeol Kwon , Nhat Ho , Constantine Caramanis

Speech emotion recognition (SER) often experiences reduced performance due to background noise. In addition, making a prediction on signals with only background noise could undermine user trust in the system. In this study, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Yu-Wen Chen , Julia Hirschberg , Yu Tsao

Quantum Error Mitigation (EM) is a collection of strategies to reduce errors on noisy intermediate scale quantum (NISQ) devices on which proper quantum error correction is not feasible. One of such strategies aimed at mitigating noise…

It is shown how expectation maximization (EM) may be viewed as a message passing algorithm in factor graphs. In particular, a general EM message computation rule is identified. As a factor graph tool, EM may be used to break cycles in a…

Information Theory · Computer Science 2009-10-16 Justin Dauwels , Andrew Eckford , Sascha Korl , Hans-Andrea Loeliger

Enhancing noisy speech is an important task to restore its quality and to improve its intelligibility. In traditional non-machine-learning (ML) based approaches the parameters required for noise reduction are estimated blindly from the…

Sound · Computer Science 2018-01-16 Robert Rehr , Timo Gerkmann

In this paper, we formulate a blind source separation (BSS) framework, which allows integrating U-Net based deep learning source separation network with probabilistic spatial machine learning expectation maximization (EM) algorithm for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-01 Sania Gul , Muhammad Salman Khan , Syed Waqar Shah

In this paper, we consider the problem of automatic modulation classification with multiple sensors in the presence of unknown time offset, phase offset and received signal amplitude. We develop a novel hybrid maximum likelihood (HML)…

Other Computer Science · Computer Science 2015-02-05 O. Ozdemir , T. Wimalajeewa , B. Dulek , P. K. Varshney , W. Su