English
Related papers

Related papers: An Modified Cole's Importance Sampling Method For …

200 papers

LDPC codes have attracted significant attention because of their superior performance close to the Shannon limit. Elementary trapping sets are the main cause of the error floor phenomenon in LDPC codes. We consider typical graphs related to…

Information Theory · Computer Science 2026-05-13 Ziyang Zhao , Haoran Xiong , Zicheng Ye , Guiying Yan

Speculative decoding emerges as a pivotal technique for enhancing the inference speed of Large Language Models (LLMs). Despite recent research aiming to improve prediction efficiency, multi-sample speculative decoding has been overlooked…

Computation and Language · Computer Science 2024-10-15 Yunsheng Ni , Chuanjian Liu , Yehui Tang , Kai Han , Yunhe Wang

In recent years, sequential importance sampling (SIS) has been well developed for sampling contingency tables with linear constraints. In this paper, we apply SIS procedure to 2-dimensional Ising models, which give observations of 0-1…

Computation · Statistics 2014-10-17 Jing Xi , Seth Sullivant

Large Language Models (LLMs) using Chain-of-Thought (CoT) prompting excel at complex reasoning but generate verbose thought processes with considerable redundancy, leading to increased inference costs and reduced efficiency. We introduce a…

Artificial Intelligence · Computer Science 2026-02-17 Zeju Li , Jianyuan Zhong , Ziyang Zheng , Xiangyu Wen , Zhijian Xu , Yingying Cheng , Fan Zhang , Qiang Xu

Elementary trapping sets (ETSs) are the main culprits of the performance of low-density parity-check (LDPC) codes in the error floor region. Due to their large quantities and complex structures, ETSs are difficult to analyze. This paper…

Information Theory · Computer Science 2025-11-14 Haoran Xiong , Guanghui Wang , Zhiming Ma , Guiying Yan

The reconstruction of sparse signals from a limited set of measurements poses a significant challenge as it necessitates a solution to an underdetermined system of linear equations. Compressed sensing (CS) deals with sparse signal…

Information Theory · Computer Science 2025-05-22 Salman Habib , Remi Chou , Taejoon Kim

In this paper, we study the graphical structure of elementary trapping sets (ETS) of variable-regular low-density parity-check (LDPC) codes. ETSs are known to be the main cause of error floor in LDPC coding schemes. For the set of LDPC…

Information Theory · Computer Science 2013-08-07 Mehdi Karimi , Amir H. Banihashemi

With the skyrocketing costs of GPUs and their virtual instances in the cloud, there is a significant desire to use CPUs for large language model (LLM) inference. KV cache update, often implemented as allocation, copying, and in-place…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Arun Ramachandran , Ramaswamy Govindarajan , Murali Annavaram , Prakash Raghavendra , Hossein Entezari Zarch , Lei Gao , Chaoyi Jiang

We show in this work that reinforcement learning can be successfully applied to decoding short to moderate length sparse graph-based channel codes. Specifically, we focus on low-density parity check (LDPC) codes, which for example have been…

Information Theory · Computer Science 2020-10-20 Salman Habib , Allison Beemer , Joerg Kliewer

This work addresses the estimation of rare-event quantities expressed as expectations of smooth observables of solutions to a broad class of McKean--Vlasov stochastic differential equations (MV-SDEs). Building on the double loop Monte Carlo…

Numerical Analysis · Mathematics 2026-01-08 Nadhir Ben Rached , Abdul-Lateef Haji-Ali , Shyam Mohan Subbiah Pillai , Raúl Tempone

Importance sampling (IS) is a technique that enables statistical estimation of output performance at multiple input distributions from a single nominal input distribution. IS is commonly used in Monte Carlo simulation for variance reduction…

Methodology · Statistics 2025-05-07 Yijuan Liang , Guangxin Jiang , Michael C. Fu

We construct $s$-interleaved linearized Reed--Solomon (ILRS) codes and variants and propose efficient decoding schemes that can correct errors beyond the unique decoding radius in the sum-rank metric. The proposed interpolation-based scheme…

Information Theory · Computer Science 2025-09-10 Hannes Bartz , Sven Puchinger

This paper presents an efficient algorithm for finding the dominant trapping sets of a low-density parity-check (LDPC) code. The algorithm can be used to estimate the error floor of LDPC codes or to be part of the apparatus to design LDPC…

Information Theory · Computer Science 2012-04-16 Mehdi Karimi , Amir H. Banihashemi

In this paper, we propose a characterization of elementary trapping sets (ETSs) for irregular low-density parity-check (LDPC) codes. These sets are known to be the main culprits in the error floor region of such codes. The characterization…

Information Theory · Computer Science 2016-12-01 Yoones Hashemi , Amir H. Banihashemi

Several methods exist today to accelerate Machine Learning(ML) or Deep-Learning(DL) model performance for training and inference. However, modern techniques that rely on various graph and operator parallelism methodologies rely on search…

Machine Learning · Computer Science 2023-08-23 Srinjoy Das , Lawrence Rauchwerger

Given that quantum error correction processes are unreliable, an efficient error syndrome extraction circuit should use fewer ancillary qubits, quantum gates, and measurements, while maintaining low circuit depth, to minimizing the circuit…

Quantum Physics · Physics 2025-07-14 Pei-Hao Liou , Ching-Yi Lai

The error correction performance of low-density parity-check (LDPC) codes under iterative message-passing decoding is degraded by the presence of certain harmful objects existing in their Tanner graph representation. Depending on the…

Information Theory · Computer Science 2019-04-16 Massimo Battaglioni , Franco Chiaraluce , Marco Baldi , David Mitchell

In real-world Tool-Integrated Reasoning (TIR) scenarios, where LLMs interleave reasoning with external tool calls, a major source of inefficiency is that the toolcalls create pauses between LLM requests and cause KV-Cache eviction, forcing…

Performance · Computer Science 2026-04-15 Qisheng Su , Shiting Huang , Zhen Fang , Ziyan Chen , Zehui Chen , Feng Zhao

In this paper, we propose to improve the performance of the channel estimation for LTE Downlink systems under the effect of the channel length. As LTE Downlink system is a MIMO-OFDMA based system, a cyclic prefix (CP) is inserted at the…

Networking and Internet Architecture · Computer Science 2012-01-11 Abdelhakim Khlifi , Ridha Bouallegue

A partially identified model, where the parameters can not be uniquely identified, often arises during statistical analysis. While researchers frequently use Bayesian inference to analyze the models, when Bayesian inference with an…

Computation · Statistics 2024-08-21 Seren Lee , Paul Gustafson