English
Related papers

Related papers: A Generic Approach for Accelerating Belief Propaga…

200 papers

This paper addresses the problem of distributed optimization, where a network of agents represented as a directed graph (digraph) aims to collaboratively minimize the sum of their individual cost functions. Existing approaches for…

Optimization and Control · Mathematics 2023-07-06 Xiaomeng Chen , Wei Jiang , Themistoklis Charalambous , Ling Shi

The problem of low complexity, close to optimal, channel decoding of linear codes with short to moderate block length is considered. It is shown that deep learning methods can be used to improve a standard belief propagation decoder,…

Information Theory · Computer Science 2018-03-14 Eliya Nachmani , Elad Marciano , Loren Lugosch , Warren J. Gross , David Burshtein , Yair Beery

We consider a broad class of interference coordination and resource allocation problems for wireless links where the goal is to maximize the sum of functions of individual link rates. Such problems arise in the context of, for example,…

Networking and Internet Architecture · Computer Science 2010-08-03 Sundeep Rangan , Ritesh Madan

We propose a fast real-time state estimator based on the belief propagation algorithm for the power system state estimation. The proposed estimator is easy to distribute and parallelize, thus alleviating computational limitations and…

Information Theory · Computer Science 2017-08-15 Mirsad Cosovic , Dejan Vukobratovic

Diffusion Probabilistic Models (DPMs) have demonstrated exceptional capability of generating high-quality and diverse images, but their practical application is hindered by the intensive computational cost during inference. The DPM…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jen-Yuan Huang

Token reduction accelerates Multimodal Large Language Models (MLLMs) by reducing excessive tokens, but overlooks structural redundancy differences, where critical and redundant modules process identical token loads. For fine-grained…

Machine Learning · Computer Science 2025-11-14 Aoming Liu , Reuben Tan , Boqing Gong , Bryan A. Plummer

Diffusion models (DMs) have recently demonstrated remarkable success in modeling large-scale data distributions. However, many downstream tasks require guiding the generated content based on specific differentiable metrics, typically…

Machine Learning · Computer Science 2025-05-13 Hongkun Dou , Zeyu Li , Xingyu Jiang , Hongjue Li , Lijun Yang , Wen Yao , Yue Deng

Graph-based diffusion models have shown promising results in terms of generating high-quality solutions to NP-complete (NPC) combinatorial optimization (CO) problems. However, those models are often inefficient in inference, due to the…

Machine Learning · Computer Science 2023-08-24 Junwei Huang , Zhiqing Sun , Yiming Yang

Diffusion Policies have significantly advanced robotic manipulation tasks via imitation learning, but their application on resource-constrained mobile platforms remains challenging due to computational inefficiency and extensive memory…

Robotics · Computer Science 2025-08-04 Yiming Wu , Huan Wang , Zhenghao Chen , Jianxin Pang , Dong Xu

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

Artificial Intelligence · Computer Science 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2008-10-08 Ori Shental , Danny Bickson , Paul H. Siegel , Jack K. Wolf , Danny Dolev

Message-passing algorithms based on belief-propagation (BP) are successfully used in many applications including decoding error correcting codes and solving constraint satisfaction and inference problems. BP-based algorithms operate over…

Information Theory · Computer Science 2013-07-16 Guy Even , Nissim Halabi

We apply the Min-Sum message-passing protocol to solve the consensus problem in distributed optimization. We show that while the ordinary Min-Sum algorithm does not converge, a modified version of it known as Splitting yields convergence to…

Optimization and Control · Mathematics 2017-11-06 Patrick Rebeschini , Sekhar Tatikonda

Distributed Constraint Optimization Problems (DCOPs) are a frequently used framework in which a set of independent agents choose values from their respective discrete domains to maximize their utility. Although this formulation is typically…

Multiagent Systems · Computer Science 2021-10-18 K. M. Merajul Arefin , Mashrur Rashik , Saaduddin Mahmud , Md. Mosaddek Khan

The Finite State Projection (FSP) method approximates the Chemical Master Equation (CME) by restricting the dynamics to a finite subset of the (typically infinite) state space, enabling direct numerical solution with computable error…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Aditya Dendukuri , Shivkumar Chandrasekaran , Linda Petzold

Network pruning techniques, including weight pruning and filter pruning, reveal that most state-of-the-art neural networks can be accelerated without a significant performance drop. This work focuses on filter pruning which enables…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Xuanyu He , Yu-I Yang , Ran Song , Jiachen Pu , Conggang Hu , Feijun Jiang , Wei Zhang , Huanghao Ding

Recent advances in diffusion models show promising potential to accelerate nonconvex problem solving by leveraging their multimodality. However, most existing diffusion-based optimization approaches rely on supervised learning and lack a…

Machine Learning · Computer Science 2026-05-29 Shutong Ding , Yimiao Zhou , Ke Hu , Xi Yao , Junchi Yan , Xiaoying Tang , Ye Shi

Diffusion probabilistic models (DPMs) are widely adopted for their outstanding generative fidelity, yet their sampling is computationally demanding. Polynomial-based multistep samplers mitigate this cost by accelerating inference; however,…

Machine Learning · Computer Science 2026-03-17 Soochul Park , Yeon Ju Lee , SeongJin Yoon , Jiyub Shin , Juhee Lee , Seongwoon Jo

The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local…

Optimization and Control · Mathematics 2020-03-06 Francesco Farina , Giuseppe Notarstefano

In this paper we present and evaluate a search strategy called Decomposition Based Search (DBS) which is based on two steps: subproblem generation and subproblem solution. The generation of subproblems is done through value ranking and…

Artificial Intelligence · Computer Science 2007-05-23 W. J. van Hoeve , M. Milano