English
Related papers

Related papers: On Maximum a Posteriori Estimation of Hidden Marko…

200 papers

We consider the problem of jointly estimating the parameters as well as the structure of binary valued Markov Random Fields, in contrast to earlier work that focus on one of the two problems. We formulate the problem as a maximization of…

Machine Learning · Statistics 2008-11-11 M. Kolar , E. P. Xing

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Finite state space hidden Markov models are flexible tools to model phenomena with complex time dependencies: any process distribution can be approximated by a hidden Markov model with enough hidden states.We consider the problem of…

Statistics Theory · Mathematics 2021-02-16 Luc Lehéricy

In many safety-critical settings, probabilistic ML systems have to make predictions subject to algebraic constraints, e.g., predicting the most likely trajectory that does not cross obstacles. These real-world constraints are rarely convex,…

Machine Learning · Computer Science 2026-02-11 Leander Kurscheidt , Gabriele Masina , Roberto Sebastiani , Antonio Vergari

Bayesian methods to solve imaging inverse problems usually combine an explicit data likelihood function with a prior distribution that explicitly models expected properties of the solution. Many kinds of priors have been explored in the…

Machine Learning · Statistics 2025-02-04 Rémi Laumont , Valentin de Bortoli , Andrés Almansa , Julie Delon , Alain Durmus , Marcelo Pereyra

This paper provides performance bounds for compressed sensing in the presence of Poisson noise using expander graphs. The Poisson noise model is appropriate for a variety of applications, including low-light imaging and digital streaming,…

Information Theory · Computer Science 2009-11-25 Sina Jafarpour , Rebecca Willett , Maxim Raginsky , Robert Calderbank

We introduce an approximate search algorithm for fast maximum a posteriori probability estimation in probabilistic programs, which we call Bayesian ascent Monte Carlo (BaMC). Probabilistic programs represent probabilistic models with…

Artificial Intelligence · Computer Science 2015-04-28 David Tolpin , Frank Wood

We present a sampling-based Model Predictive Control (MPC) method that implements Model Predictive Path Integral (MPPI) as an \emph{Ising machine}, suitable for novel forms of probabilistic computing. By expressing the control problem as a…

Systems and Control · Electrical Eng. & Systems 2025-12-18 Lorin Werthen-Brabants , Pieter Simoens

This paper presents a new approach, called perturb-max, for high-dimensional statistical inference that is based on applying random perturbations followed by optimization. This framework injects randomness to maximum a-posteriori (MAP)…

Machine Learning · Computer Science 2017-06-01 Tamir Hazan , Francesco Orabona , Anand D. Sarwate , Subhransu Maji , Tommi Jaakkola

High-throughput characterization often requires estimating parameters and model dimension from experimental data of limited quantity and quality. Such data may result in an ill-posed inverse problem, where multiple sets of parameters and…

Quantum Physics · Physics 2026-04-08 Abigail N. Poteshman , Jiwon Yun , Tim H. Taminiau , Giulia Galli

Scalable high-quality MAP inference in arbitrary-order Markov Random Fields (MRFs) remains challenging. Approximate message-passing methods are often efficient but can degrade on dense or high-order instances, while exact solvers such as…

Machine Learning · Computer Science 2026-05-08 Yaomin Wang , Chaolong Ying , Xiaodong Luo , Tianshu Yu

We consider the problem of flexible modeling of higher order hidden Markov models when the number of latent states and the nature of the serial dependence, including the true order, are unknown. We propose Bayesian nonparametric methodology…

Methodology · Statistics 2019-02-06 Abhra Sarkar , David B. Dunson

This paper provides performance bounds for compressed sensing in the presence of Poisson noise using expander graphs. The Poisson noise model is appropriate for a variety of applications, including low-light imaging and digital streaming,…

Information Theory · Computer Science 2015-05-19 Maxim Raginsky , Sina Jafarpour , Zachary Harmany , Roummel Marcia , Rebecca Willett , Robert Calderbank

In this article we propose a maximal a posteriori (MAP) criterion for model selection in the motif discovery problem and investigate conditions under which the MAP asymptotically gives a correct prediction of model size. We also investigate…

Statistics Theory · Mathematics 2008-12-18 Mayetri Gupta

In the problem of matrix compressed sensing we aim to recover a low-rank matrix from few of its element-wise linear projections. In this contribution we analyze the asymptotic performance of a Bayes-optimal inference procedure for a model…

Information Theory · Computer Science 2017-01-04 Christophe Schülke , Philip Schniter , Lenka Zdeborová

In this work, we address the problem of estimating sparse communication channels in OFDM systems in the presence of carrier frequency offset (CFO) and unknown noise variance. To this end, we consider a convex optimization problem, including…

Information Theory · Computer Science 2013-11-15 Rodrigo Carvajal , Boris I. Godoy , Juan C. Agüero

We consider the approximation of expectations with respect to the distribution of a latent Markov process given noisy measurements. This is known as the smoothing problem and is often approached with particle and Markov chain Monte Carlo…

Computation · Statistics 2019-02-06 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

Finding an energy minimum in the Ising model is an exemplar objective, associated with many combinatorial optimization problems, that is computationally hard in general, but occurs in all areas of modern science. There are several numerical…

Quantum Physics · Physics 2019-07-17 A. Yavorsky , L. A. Markovich , E. A. Polyakov , A. N. Rubtsov

The problem of estimating a sparse channel, i.e. a channel with a few non-zero taps, appears in various areas of communications. Recently, we have developed an algorithm based on iterative alternating minimization which iteratively detects…

Information Theory · Computer Science 2013-08-27 Rad Niazadeh , Masoud Babaie-Zadeh , Christian Jutten

This paper presents a fast computational method, the Expectation Maximization algorithm, for Maximum Likelihood (ML) estimation in diffusion tensor imaging under the Rice noise model. We further extend the ML framework to the maximum a…

Computation · Statistics 2015-01-09 Jia Liu , Dario Gasbarra , Juha Railavo