English
Related papers

Related papers: MAP estimation via agreement on (hyper)trees: Mess…

200 papers

We consider the problem of learning underlying tree structure from noisy, mixed data obtained from a linear model. To achieve this, we use the expectation maximization algorithm combined with Chow-Liu minimum spanning tree algorithm. This…

Information Theory · Computer Science 2017-10-06 Navid Tafaghodi Khajavi

Many iterative and non-iterative methods have been developed for inverse problems associated with Ising models. Aiming to derive an accurate non-iterative method for the inverse problems, we employ the tree-reweighted approximation. Using…

Machine Learning · Statistics 2018-05-30 Takashi Sano

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

Information Theory · Computer Science 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

The Message-Passing Approach (MPA) is the state-of-the-art technique to obtain quasi-analytical predictions for percolation on real complex networks. Besides being intuitive and straightforward, it has the advantage of being mathematically…

Physics and Society · Physics 2019-06-26 Antoine Allard , Laurent Hébert-Dufresne

In unconstrained maximum a posteriori (MAP) and maximum likelihood estimation, the inverse of minus the merit-function Hessian matrix is an approximation of the estimate covariance matrix. In the Bayesian context of MAP estimation, it is…

Methodology · Statistics 2020-03-17 Dimas Abreu Archanjo Dutra

Scalable high-quality MAP inference in arbitrary-order Markov Random Fields (MRFs) remains challenging. Approximate message-passing methods are often efficient but can degrade on dense or high-order instances, while exact solvers such as…

Machine Learning · Computer Science 2026-05-08 Yaomin Wang , Chaolong Ying , Xiaodong Luo , Tianshu Yu

We establish numerical methods for solving the martingale optimal transport problem (MOT) - a version of the classical optimal transport with an additional martingale constraint on transport's dynamics. We prove that the MOT value can be…

Probability · Mathematics 2019-04-08 Gaoyue Guo , Jan Obloj

The posterior matching scheme, for feedback encoding of a message point lying on the unit interval over memoryless channels, maximizes mutual information for an arbitrary number of channel uses. However, it in general does not always…

Information Theory · Computer Science 2019-01-10 Diego A. Mesa , Rui Ma , Siva K. Gorantla , Todd P. Coleman

We consider sequences of finite weighted random graphs that converge locally to unimodular i.i.d. weighted random trees. When the weights are atomless, we prove that the matchings of maximal weight converge locally to a matching on the…

Probability · Mathematics 2025-03-31 Nathanaël Enriquez , Mike Liu , Laurent Ménard , Vianney Perchet

Peak estimation of hybrid systems aims to upper bound extreme values of a state function along trajectories, where this state function could be different in each subsystem. This finite-dimensional but nonconvex problem may be lifted into an…

Optimization and Control · Mathematics 2023-03-22 Jared Miller , Mario Sznaier

Distributed algorithms for solving coupled semidefinite programs (SDPs) commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper we show that in case the coupled…

Optimization and Control · Mathematics 2015-04-30 Sina Khoshfetrat Pakazad , Anders Hansson , Martin S. Andersen , Anders Rantzer

Lagrangian relaxation stands among the most efficient approaches for solving a Mixed Integer Linear Programs (MILP) with difficult constraints. Given any duals for these constraints, called Lagrangian Multipliers (LMs), it returns a bound…

Machine Learning · Computer Science 2024-10-21 Francesco Demelas , Joseph Le Roux , Mathieu Lacroix , Axel Parmentier

The question of what can be computed, and how efficiently, are at the core of computer science. Not surprisingly, in distributed systems and networking research, an equally fundamental question is what can be computed in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-01 Fabian Kuhn , Thomas Moscibroda , Roger Wattenhofer

We present algorithms that run in linear time on pointer machines for a collection of problems, each of which either directly or indirectly requires the evaluation of a function defined on paths in a tree. These problems previously had…

Data Structures and Algorithms · Computer Science 2007-05-23 Adam L. Buchsbaum , Loukas Georgiadis , Haim Kaplan , Anne Rogers , Robert E. Tarjan , Jeffery R. Westbrook

Research in reinforcement learning has produced algorithms for optimal decision making under uncertainty that fall within two main types. The first employs a Bayesian framework, where optimality improves with increased computational time.…

Machine Learning · Statistics 2011-09-22 Christos Dimitrakakis

We investigate the problem of best policy identification in discounted linear Markov Decision Processes in the fixed confidence setting under a generative model. We first derive an instance-specific lower bound on the expected number of…

Machine Learning · Computer Science 2022-08-12 Jerome Taupin , Yassir Jedra , Alexandre Proutiere

We study the problem of regression in a generalized linear model (GLM) with multiple signals and latent variables. This model, which we call a matrix GLM, covers many widely studied problems in statistical learning, including mixed linear…

Machine Learning · Statistics 2024-04-10 Nelvin Tan , Ramji Venkataramanan

We initiate a systematic study of utilizing predictions to improve over approximation guarantees of classic algorithms, without increasing the running time. We propose a systematic method for a wide class of optimization problems that ask…

Data Structures and Algorithms · Computer Science 2024-11-26 Antonios Antoniadis , Marek Eliáš , Adam Polak , Moritz Venzin

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber

Optimal planning with respect to learned neural network (NN) models in continuous action and state spaces using mixed-integer linear programming (MILP) is a challenging task for branch-and-bound solvers due to the poor linear relaxation of…

Artificial Intelligence · Computer Science 2019-07-29 Buser Say , Scott Sanner , Sylvie Thiébaux