English
Related papers

Related papers: Relaxation of the EM Algorithm via Quantum Anneali…

200 papers

We introduce quantum fluctuations into the simulated annealing process of optimization problems, aiming at faster convergence to the optimal state. Quantum fluctuations cause transitions between states and thus play the same role as thermal…

Statistical Mechanics · Physics 2009-10-31 Tadashi Kadowaki , Hidetoshi Nishimori

The Expectation Maximization (EM) algorithm is a key reference for inference in latent variable models; unfortunately, its computational cost is prohibitive in the large scale learning setting. In this paper, we propose an extension of the…

Machine Learning · Statistics 2020-11-26 Gersende Fort , Eric Moulines , Hoi-To Wai

The expectation-maximization (EM) algorithm is an iterative computational method to calculate the maximum likelihood estimators (MLEs) from the sample data. It converts a complicated one-time calculation for the MLE of the incomplete data…

Computation · Statistics 2016-08-08 Lingyao Meng

Quantum-phase-estimation algorithms are critical subroutines in many applications for quantum computers and in quantum-metrology protocols. These algorithms estimate the unknown strength of a unitary evolution. By using coherence or…

Quantum Physics · Physics 2023-03-06 Joseph G. Smith , Crispin H. W. Barnes , David R. M. Arvidsson-Shukur

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression,…

Machine Learning · Statistics 2015-06-25 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

Quantum annealing is a continuous-time heuristic quantum algorithm for solving or approximately solving classical optimization problems. The algorithm uses a schedule to interpolate between a driver Hamiltonian with an easy-to-prepare…

Quantum annealing is a generic solver of classical optimization problems that makes full use of quantum fluctuations. We consider work statistics given by a repetition of quantum annealing processes by employing the Jarzynski equality…

Disordered Systems and Neural Networks · Physics 2015-05-27 Masayuki Ohzeki , Hidestoshi Nishimori

We study Sinkhorn EM (sEM), a variant of the expectation maximization (EM) algorithm for mixtures based on entropic optimal transport. sEM differs from the classic EM algorithm in the way responsibilities are computed during the expectation…

Machine Learning · Statistics 2020-07-01 Gonzalo Mena , Amin Nejatbakhsh , Erdem Varol , Jonathan Niles-Weed

Finite-sum optimization has wide applications in machine learning, covering important problems such as support vector machines, regression, etc. In this paper, we initiate the study of solving finite-sum optimization problems by quantum…

Quantum Physics · Physics 2024-06-06 Yexin Zhang , Chenyi Zhang , Cong Fang , Liwei Wang , Tongyang Li

Quantum annealing is a promising method for solving combinational optimization problems and performing quantum chemical calculations. The main sources of errors in quantum annealing are the effects of decoherence and non-adiabatic…

Quantum Physics · Physics 2022-11-23 Takashi Imoto , Yuya Seki , Yuichiro Matsuzaki and , Shiro Kawabata

The standard quantum annealing algorithm tries to approach the ground state of a classical system by slowly decreasing the hopping rates of a quantum random walk in the configuration space of the problem, where the on-site energies are…

Disordered Systems and Neural Networks · Physics 2018-12-26 A. Ramezanpour

In this study, an efficient stochastic gradient-free method, the ensemble neural networks (ENN), is developed. In the ENN, the optimization process relies on covariance matrices rather than derivatives. The covariance matrices are…

Machine Learning · Statistics 2019-11-11 Yuntian Chen , Haibin Chang , Meng Jin , Dongxiao Zhang

Among various algorithms designed to exploit the specific properties of quantum computers with respect to classical ones, the quantum adiabatic algorithm is a versatile proposition to find the minimal value of an arbitrary cost function…

Statistical Mechanics · Physics 2013-01-29 Victor Bapst , Laura Foini , Florent Krzakala , Guilhem Semerjian , Francesco Zamponi

Recently we find several candidates of quantum algorithms that may be implementable in near-term devices for estimating the amplitude of a given quantum state, which is a core sub- routine in various computing tasks such as the Monte Carlo…

Quantum Physics · Physics 2021-10-12 Tomoki Tanaka , Yohichi Suzuki , Shumpei Uno , Rudy Raymond , Tamiya Onodera , Naoki Yamamoto

Evidential-EM (E2M) algorithm is an effective approach for computing maximum likelihood estimations under finite mixture models, especially when there is uncertain information about data. In this paper we present an extension of the E2M…

Artificial Intelligence · Computer Science 2015-01-08 Kuang Zhou , Arnaud Martin , Quan Pan

We consider the problem of sparse estimation in a factor analysis model. A traditional estimation procedure in use is the following two-step approach: the model is estimated by maximum likelihood method and then a rotation technique is…

Methodology · Statistics 2013-03-18 Kei Hirose , Michio Yamamoto

The Expectation-Maximization (EM) algorithm is a commonly used method for finding the maximum likelihood estimates of the parameters in a mixture model via coordinate ascent. A serious pitfall with the algorithm is that in the case of…

Computation · Statistics 2018-08-31 Adrian O'Hagan , Arthur White

Quantum error mitigation (QEM) has been proposed as a class of hardware-friendly error suppression techniques. While QEM has been primarily studied for mitigating errors in the estimation of expectation values of observables, recent works…

Quantum Physics · Physics 2025-11-18 Rion Shimazu , Suguru Endo , Shigeo Hakkaku , Shinobu Saito

We study the convergence behavior of the Expectation Maximization (EM) algorithm on Gaussian mixture models with an arbitrary number of mixture components and mixing weights. We show that as long as the means of the components are separated…

Statistics Theory · Mathematics 2018-10-10 Ruofei Zhao , Yuanzhi Li , Yuekai Sun

A maximum likelihood methodology for the parameters of models with an intractable likelihood is introduced. We produce a likelihood-free version of the stochastic approximation expectation-maximization (SAEM) algorithm to maximize the…

Methodology · Statistics 2018-01-17 Umberto Picchini