中文
相关论文

相关论文: Binary quantization using Belief Propagation with …

200 篇论文

Large language models (LLMs) have significantly advanced the field of natural language processing, while the expensive memory and computation consumption impede their practical deployment. Quantization emerges as one of the most effective…

Belief Propagation (BP) is a powerful algorithm for distributed inference in probabilistic graphical models, however it quickly becomes infeasible for practical compute and memory budgets. Many efficient, non-parametric forms of BP have…

分布式、并行与集群计算 · 计算机科学 2026-01-30 Tom Yates , Yuzhou Cheng , Ignacio Alzugaray , Danyal Akarca , Pedro A. M. Mediano , Andrew J. Davison

This paper proposes two approaches for reducing the impact of the error floor phenomenon when decoding quantum low-density parity-check codes with belief propagation based algorithms. First, a low-complexity syndrome-based linear…

信息论 · 计算机科学 2024-01-22 Sana Javed , Francisco Garcia-Herrero , Bane Vasic , Mark F. Flanagan

The histogram is an analysis tool in widespread use within many sciences, with high energy physics as a prime example. However, there exists an inherent bias in the choice of binning for the histogram, with different choices potentially…

数据分析、统计与概率 · 物理学 2014-05-21 Abram Krislock , Nathan Krislock

In this study, an optimization model for offline scheduling policy of low-density parity-check (LDPC) codes is proposed to improve the decoding efficiency of the belief propagation (BP). The optimization model uses the number of messages…

信息论 · 计算机科学 2024-08-07 Dongxu Chang , Zhiming Ma , Guanghui Wang , Guiying Yan , Dawei Yin

For the problem of binary linear classification and feature selection, we propose algorithmic approaches to classifier design based on the generalized approximate message passing (GAMP) algorithm, recently proposed in the context of…

信息论 · 计算机科学 2015-06-18 Justin Ziniel , Philip Schniter , Per Sederberg

Compared to the linear MIMO detectors, the Belief Propagation (BP) detector has shown greater capabilities in achieving near optimal performance and better nature to iteratively cooperate with channel decoders. Aiming at real applications,…

信息论 · 计算机科学 2022-06-28 Wenyue Zhou , Yifei Shen , Liping Li , Yongming Huang , Chuan Zhang , Xiaohu You

We argue the case for Gaussian Belief Propagation (GBP) as a strong algorithmic framework for the distributed, generic and incremental probabilistic estimation we need in Spatial AI as we aim at high performance smart robots and devices…

人工智能 · 计算机科学 2022-11-08 Andrew J. Davison , Joseph Ortiz

The belief propagation (BP) algorithm is widely applied to perform approximate inference on arbitrary graphical models, in part due to its excellent empirical properties and performance. However, little is known theoretically about when…

人工智能 · 计算机科学 2012-06-26 Alexander T. Ihler

We introduce a new paradigm for finite precision iterative decoding on low-density parity-check codes over the Binary Symmetric channel. The messages take values from a finite alphabet, and unlike traditional quantized decoders which are…

信息论 · 计算机科学 2012-07-23 Shiva Kumar Planjery , David Declercq , Ludovic Danjean , Bane Vasic

We study the performance of binary spatially-coupled low-density parity-check codes (SC-LDPC) when used with bit-interleaved coded-modulation (BICM) schemes. This paper considers the cases when transmission takes place over additive white…

信息论 · 计算机科学 2013-03-05 Arvind Yedla , Mostafa El-Khamy , Jungwon Lee , Inyup Kang

In many practical communication systems, one binary encoder/decoder pair is used to communicate over a set of parallel channels. Examples of this setup include multi-carrier transmission, rate-compatible puncturing of turbo-like codes, and…

A new coded modulation scheme is proposed. At the transmitter, the concatenation of a distribution matcher and a systematic binary encoder performs probabilistic signal shaping and channel coding. At the receiver, the output of a bitwise…

信息论 · 计算机科学 2015-04-23 Georg Böcherer , Patrick Schulte , Fabian Steiner

The recent success in constructing asymptotically good quantum low-density parity-check (QLDPC) codes makes this family of codes a promising candidate for error-correcting schemes in quantum computing. However, conventional belief…

信息论 · 计算机科学 2023-03-22 Sisi Miao , Alexander Schnerring , Haizheng Li , Laurent Schmalen

We study text summarization from the viewpoint of maximum coverage problem. In graph theory, the task of text summarization is regarded as maximum coverage problem on bipartite graph with weighted nodes. In recent study, belief-propagation…

计算与语言 · 计算机科学 2020-04-20 Hiroki Kitano , Koujin Takeda

Recent work has suggested that low-density generator matrix (LDGM) codes are likely to be effective for lossy source coding problems. We derive rigorous upper bounds on the effective rate-distortion function of LDGM codes for the binary…

信息论 · 计算机科学 2007-07-13 Emin Martinian , Martin J. Wainwright

This paper considers the noisy group testing problem where among a large population of items some are defective. The goal is to identify all defective items by testing groups of items, with the minimum possible number of tests. The focus of…

信息论 · 计算机科学 2021-10-20 Esmaeil Karimi , Anoosheh Heidarzadeh , Krishna R. Narayanan , Alex Sprintson

Belief propagation (BP) and the concave convex procedure (CCCP) are both methods that utilize the Bethe free energy as a cost function and solve information processing tasks. We have developed a new algorithm that also uses the Bethe free…

统计力学 · 物理学 2016-11-17 Masato Inoue , Miho Komiya , Yoshiyuki Kabashima

Belief-propagation (BP) decoders play a vital role in modern coding theory, but they are not suitable to decode quantum error-correcting codes because of a unique quantum feature called error degeneracy. Inspired by an exact mapping between…

量子物理 · 物理学 2019-05-29 Ye-Hua Liu , David Poulin

Binary Code Similarity Detection (BCSD) is not only essential for security tasks such as vulnerability identification but also for code copying detection, yet it remains challenging due to binary stripping and diverse compilation…

密码学与安全 · 计算机科学 2025-04-24 Li Zhou , Marc Dacier , Charalambos Konstantinou