中文
相关论文

相关论文: Stochastic Interpretation for the Arimoto Algorith…

200 篇论文

Many quantum algorithms involve the evaluation of expectation values. Optimal strategies for estimating a single expectation value are known, requiring a number of state preparations that scales with the target error $\varepsilon$ as…

Equalisation Maximisation (EqM) is an algorithm for estimating parameters in auto-regressive (AR) models where some fraction of the data is missing. It has previously been shown that the EqM algorithm is a competitive alternative to…

统计计算 · 统计学 2013-08-22 Johan Dahlin , Fredrik Lindsten , Thomas B. Schön

Expectation Maximization (EM) is among the most popular algorithms for estimating parameters of statistical models. However, EM, which is an iterative algorithm based on the maximum likelihood principle, is generally only guaranteed to find…

统计理论 · 数学 2016-08-30 Ji Xu , Daniel Hsu , Arian Maleki

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

最优化与控制 · 数学 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

The performance of Gallager's error-correcting code is investigated via methods of statistical physics. In this approach, the transmitted codeword comprises products of the original message bits selected by two randomly-constructed sparse…

无序系统与神经网络 · 物理学 2009-10-31 Yoshiyuki Kabashima , Tatsuto Murayama , David Saad

A hybrid quantum-classical algorithm is a computational scheme in which quantum circuits are used to extract information that is then processed by a classical routine to guide subsequent quantum operations. These algorithms are especially…

量子物理 · 物理学 2025-09-03 Alon Levi , Ziv Ossi , Eliahu Cohen , Amit Te'eni

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

信息论 · 计算机科学 2012-08-15 Sundeep Rangan

Following [OW16], we continue our analysis of: (1) "Quantum tomography", i.e., learning a quantum state, i.e., the quantum generalization of learning a discrete probability distribution; (2) The distribution of Young diagrams output by the…

量子物理 · 物理学 2016-12-02 Ryan O'Donnell , John Wright

We propose a model selection approach for covariance estimation of a multi-dimensional stochastic process. Under very general assumptions, observing i.i.d replications of the process at fixed observation points, we construct an estimator of…

统计理论 · 数学 2009-09-29 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

We employ the methods of statistical physics to study the performance of Gallager type error-correcting codes. In this approach, the transmitted codeword comprises Boolean sums of the original message bits selected by two…

无序系统与神经网络 · 物理学 2009-10-31 David Saad , Yoshiyuki Kabashima , Tatsuto Murayama

In this paper, we introduce a distributed algorithm that optimizes the Gaussian signal covariance matrices of multi-antenna users transmitting to a common multi-antenna receiver under imperfect and possibly delayed channel state…

信息论 · 计算机科学 2015-02-06 Panayotis Mertikopoulos , Aris L. Moustakas

Quantization is a widely used compression method that effectively reduces redundancies in over-parameterized neural networks. However, existing quantization techniques for deep neural networks often lack a comprehensive error analysis due…

机器学习 · 计算机科学 2023-09-21 Jinjie Zhang , Rayan Saab

This work proposes a training algorithm based on adaptive random Fourier features (ARFF) with Metropolis sampling and resampling \cite{kammonen2024adaptiverandomfourierfeatures} for learning drift and diffusion components of stochastic…

机器学习 · 计算机科学 2025-07-22 Owen Douglas , Aku Kammonen , Anamika Pandey , Raúl Tempone

This paper concerns quasi-stochastic approximation (QSA) to solve root finding problems commonly found in applications to optimization and reinforcement learning. The general constant gain algorithm may be expressed as the…

最优化与控制 · 数学 2024-04-02 Caio Kalil Lauand , Sean Meyn

Suitable estimators for a class of Large Deviation approximations of rare event probabilities based on sample realizations of random processes have been proposed in our earlier work. These estimators are expressed as non-linear…

信息论 · 计算机科学 2016-05-04 Spyridon Vassilaras , Ioannis Ch. Paschalidis

Algorithms for learning distributions over weight-vectors, such as AROW were recently shown empirically to achieve state-of-the-art performance at various problems, with strong theoretical guaranties. Extending these algorithms to matrix…

机器学习 · 计算机科学 2012-06-22 Koby Crammer , Gal Chechik

We investigate the equidistribution of the eigenfunctions on quantum graphs in the high-energy limit. Our main result is an estimate of the deviations from equidistribution for large well-connected graphs. We use an exact field-theoretic…

混沌动力学 · 物理学 2009-11-13 S. Gnutzmann , J. P. Keating , F. Piotet

The performance of the quantum approximate optimization algorithm is evaluated by using three different measures: the probability of finding the ground state, the energy expectation value, and a ratio closely related to the approximation…

量子物理 · 物理学 2020-06-08 Madita Willsch , Dennis Willsch , Fengping Jin , Hans De Raedt , Kristel Michielsen

We derive critical noise levels for Gallager codes on asymmetric channels as a function of the input bias and the temperature. Using a statistical mechanics approach we study the space of codewords and the entropy in the various decoding…

无序系统与神经网络 · 物理学 2009-11-13 I. Neri , N. S. Skantzos , D. Bollé

We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite…

机器学习 · 计算机科学 2022-06-14 David H. Brookes , Akosua Busia , Clara Fannjiang , Kevin Murphy , Jennifer Listgarten