English
Related papers

Related papers: Efficient Message Passing for 0-1 ILPs with Binary…

200 papers

In this paper, we propose an information geometry (IG) framework to solve the standard linear regression problem. The proposed framework is an extension of the one for computing the mean of complex multivariate Gaussian distribution. By…

Information Theory · Computer Science 2024-08-14 Bingyan Liu , An-An Lu , Mingrui Fan , Jiyuan Yang , Xiqi Gao

This study focuses on the efficiency of message-passing-based decoding algorithms for polar and low-density parity-check (LDPC) codes. Both successive cancellation (SC) and belief propagation (BP) decoding algorithms are studied {in} the…

Information Theory · Computer Science 2023-04-24 Dawei Yin , Yuan Li , Xianbin Wang , Jiajie Tong , Huazi Zhang , Jun Wang , Guanghui Wang , Jun Chen , Guiying Yan , Zhiming Ma , Wen Tong

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. Message passing is…

Artificial Intelligence · Computer Science 2019-06-05 Andrea Montanari , Federico Ricci-Tersenghi , Guilhem Semerjian

In this paper we propose a new efficient message passing algorithm for decoding LDPC transmitted over a channel with strong phase noise. The algorithm performs approximate bayesian inference on a factor graph representation of the channel…

Information Theory · Computer Science 2012-04-13 Shachar Shayovitz , Dan Raphaeli

We consider the problem of reliable communication over non-binary insertion/deletion channels where symbols are randomly deleted from or inserted in the transmitted sequence and all symbols are corrupted by additive white Gaussian noise. To…

Information Theory · Computer Science 2012-04-17 Raman Yazdani , Masoud Ardakani

We tackle the problem of system identification, where we select inputs, observe the corresponding outputs from the true system, and optimize the parameters of our model to best fit the data. We propose a practical and computationally…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Alexandros E. Tzikas , Mykel J. Kochenderfer

We consider the problem of controlling a fully specified Markov decision process (MDP), also known as the planning problem, when the state space is very large and calculating the optimal policy is intractable. Instead, we pursue the more…

Optimization and Control · Mathematics 2019-01-09 Yasin Abbasi-Yadkori , Peter L. Bartlett , Xi Chen , Alan Malek

This paper proposes two approaches for inferencing binary codes in two-step (supervised, unsupervised) hashing. We first introduce an unified formulation for both supervised and unsupervised hashing. Then, we cast the learning of one bit as…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Thanh-Toan Do , Anh-Dzung Doan , Duc-Thanh Nguyen , Ngai-Man Cheung

In many applications, a combinatorial problem must be repeatedly solved with similar, but distinct parameters. Yet, the parameters $w$ are not directly observed; only contextual data $d$ that correlates with $w$ is available. It is tempting…

Machine Learning · Computer Science 2024-07-23 Daniel McKenzie , Samy Wu Fung , Howard Heaton

Many algorithms in verification and automated reasoning leverage some form of duality between proofs and refutations or counterexamples. In most cases, duality is only used as an intuition that helps in understanding the algorithms and is…

Programming Languages · Computer Science 2025-01-06 Takeshi Tsukada , Hiroshi Unno , Oded Padon , Sharon Shoham

A new algorithm for solving large-scale convex optimization problems with a separable objective function is proposed. The basic idea is to combine three techniques: Lagrangian dual decomposition, excessive gap and smoothing. The main…

Optimization and Control · Mathematics 2011-12-01 Tran Dinh Quoc , Carlo Savorgnan , Moritz Diehl

There has been growing interest in implementing massive MIMO systems by one-bit analog-to-digital converters (ADCs), which have the benefit of reducing the power consumption and hardware complexity. One-bit MIMO detection arises in such a…

Information Theory · Computer Science 2023-07-04 Cheng-Yang Yu , Mingjie Shao , Wei-Kun Chen , Ya-Feng Liu , Wing-Kin Ma

Constructing a minimal vertex cover of a graph can be seen as a prototype for a combinatorial optimization problem under hard constraints. In this paper, we develop and analyze message passing techniques, namely warning and survey…

Statistical Mechanics · Physics 2007-05-23 Martin Weigt , Haijun Zhou

We propose a novel iterative algorithm for solving a large sparse linear system. The method is based on the EM algorithm. If the system has a unique solution, the algorithm guarantees convergence with a geometric rate. Otherwise,…

Numerical Analysis · Mathematics 2018-08-03 Minwoo Chae , Stephen G. Walker

Discrete variational methods show excellent performance in numerical simulations of different mechanical systems. In this paper, we introduce an iterative procedure for the solution of discrete variational equations for boundary value…

Optimization and Control · Mathematics 2022-06-22 Sebastián J. Ferraro , David Martín de Diego , Rodrigo Takuro Sato Martín de Almagro

We propose a generic algorithmic building block to accelerate training of machine learning models on heterogeneous compute systems. Our scheme allows to efficiently employ compute accelerators such as GPUs and FPGAs for the training of…

Machine Learning · Computer Science 2017-11-08 Celestine Dünner , Thomas Parnell , Martin Jaggi

This paper presents an iteration method for solving linear particle transport problems in binary stochastic mixtures. It is based on nonlinear projection approach. The method is defined by a hierarchy of equations consisting of the…

Numerical Analysis · Mathematics 2026-03-18 Dmitriy Y. Anistratov

Several wireless networking problems are often posed as 0-1 mixed optimization problems, which involve binary variables (e.g., selection of access points, channels, and tasks) and continuous variables (e.g., allocation of bandwidth, power,…

Networking and Internet Architecture · Computer Science 2025-10-08 Kairong Ma , Yao Sun , Shuheng Hua , Muhammad Ali Imran , Walid Saad

In this letter, we develop an efficient linear programming (LP) decoding algorithm for low-density parity-check (LDPC) codes. We first relax the maximum likelihood (ML) decoding problem to a LP problem by using check-node decomposition.…

Information Theory · Computer Science 2019-01-24 Jing Bai , Yongchao Wang , Francis C. M. Lau

The paper considers the computation of L1 regularization paths in a state space setting, which includes L1 regularized Kalman smoothing, linear SVM, LASSO, and more. The paper proposes two new algorithms, which are duals of each other; the…

Machine Learning · Computer Science 2026-04-21 Yun-Peng Li , Hans-Andrea Loeliger