English
Related papers

Related papers: A Universal Systematic Method to Generate Error Pa…

200 papers

Accelerating the inference of large language models (LLMs) is a critical challenge in generative AI. Speculative decoding (SD) methods offer substantial efficiency gains by generating multiple tokens using a single target forward pass.…

Computation and Language · Computer Science 2025-06-12 Nadav Timor , Jonathan Mamou , Daniel Korat , Moshe Berchansky , Gaurav Jain , Oren Pereg , Moshe Wasserblat , David Harel

Low complexity joint estimation of synchronization impairments and channel in a single-user MIMO-OFDM system is presented in this letter. Based on a system model that takes into account the effects of synchronization impairments such as…

Information Theory · Computer Science 2013-04-30 Renu Jose , Sooraj K. Ambat , K. V. S. Hari

Estimating uncertainty from deep neural networks is a widely used approach for detecting out-of-distribution (OoD) samples, which typically exhibit high predictive uncertainty. However, conventional methods such as Monte Carlo (MC) Dropout…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 JinYoung Kim , DaeUng Jo , Kimin Yun , Jeonghyo Song , Youngjoon Yoo

In this paper, we propose an efficient decoding algorithm for short low-density parity check (LDPC) codes by carefully combining the belief propagation (BP) decoding and order statistic decoding (OSD) algorithms. Specifically, a modified BP…

Information Theory · Computer Science 2023-09-06 Weiyang Zhang , Chentao Yue , Yonghui Li , Branka Vucetic

Phase noise correction is crucial to exploit full advantage of orthogonal frequency division multiplexing (OFDM) in modern high-data-rate communications. OFDM channel estimation with simultaneous phase noise compensation has therefore drawn…

Information Theory · Computer Science 2017-04-25 Zhongju Wang , Prabhu Babu , Daniel P. Palomar

The zero-error channel capacity is the maximum asymptotic rate that can be reached with error probability exactly zero, instead of a vanishing error probability. The nature of this problem, essentially combinatorial rather than…

Information Theory · Computer Science 2020-01-13 Nicolas Charpenay , Maël Le Treust

Large language models (LLMs) have shown remarkable capabilities in code generation. However, the effects of hallucinations (e.g., output noise) make it particularly challenging for LLMs to generate high-quality code in one pass. In this…

Software Engineering · Computer Science 2024-09-11 Shuai Wang , Liang Ding , Li Shen , Yong Luo , Zheng He , Wei Yu , Dacheng Tao

This paper proposes novel spectrum sensing algorithms for cognitive radio networks. By assuming known transmitter pulse shaping filter, synchronous and asynchronous receiver scenarios have been considered. For each of these scenarios, the…

Optimization and Control · Mathematics 2013-12-31 Tadilo Endeshaw Bogale , Luc Vandendorpe

We propose a massive parallel decoding GRAND framework. The framework introduces two novelties: 1. A likelihood function for $M$-QAM demodulated signals that effectively reduces the symbol error pattern space from $\mathcal{O}(5^{N/\log_2…

Information Theory · Computer Science 2024-05-06 Danilo Gligoroski , Sahana Sridhar , Katina Kralevska

Stochastic gradient algorithm is a key ingredient of many machine learning methods, particularly appropriate for large-scale learning.However, a major caveat of large data is their incompleteness.We propose an averaged stochastic gradient…

Statistics Theory · Mathematics 2020-06-09 Julie Josse , Aude Sportisse , Claire Boyer , Aymeric Dieuleveut

We study wireless collaborative machine learning (ML), where mobile edge devices, each with its own dataset, carry out distributed stochastic gradient descent (DSGD) over-the-air with the help of a wireless access point acting as the…

Information Theory · Computer Science 2019-07-10 Mohammad Mohammadi Amiri , Tolga M. Duman , Deniz Gunduz

In the setting of a Gaussian channel without power constraints, proposed by Poltyrev, the codewords are points in an n-dimensional Euclidean space (an infinite constellation) and the tradeoff between their density and the error probability…

Information Theory · Computer Science 2013-02-28 Amir Ingber , Ram Zamir , Meir Feder

A fundamental problem in coding theory is the design of an efficient coding scheme that achieves the capacity of the additive white Gaussian (AWGN) channel. The main objective of this short note is to point out that by concatenating a…

Information Theory · Computer Science 2016-08-24 Shashank Vatedka , Navin Kashyap

A fundamental task in wireless communication is Channel Estimation: Compute the channel parameters a signal undergoes while traveling from a transmitter to a receiver. In the case of delay-Doppler channel, a widely used method is the…

Information Theory · Computer Science 2015-03-20 Alexander Fish , Shamgar Gurevich , Ronny Hadani , Akbar Sayeed , Oded Schwartz

This paper revisits the ordered statistics decoding (OSD). It provides a comprehensive analysis of the OSD algorithm by characterizing the statistical properties, evolution and the distribution of the Hamming distance and weighted Hamming…

Information Theory · Computer Science 2021-05-10 Chentao Yue , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

Research on machine learning for channel estimation, especially neural network solutions for wireless communications, is attracting significant current interest. This is because conventional methods cannot meet the present demands of the…

Signal Processing · Electrical Eng. & Systems 2022-01-26 Dianxin Luan , John Thompson

This paper proposes an off-grid channel estimation scheme for orthogonal time-frequency space (OTFS) systems adopting the sparse Bayesian learning (SBL) framework. To avoid channel spreading caused by the fractional delay and Doppler shifts…

Information Theory · Computer Science 2021-01-15 Zhiqiang Wei , Weijie Yuan , Shuangyang Li , Jinhong Yuan , Derrick Wing Kwan Ng

We propose a novel diffusion-based image generation method called the observation-guided diffusion probabilistic model (OGDM), which effectively addresses the tradeoff between quality control and fast sampling. Our approach reestablishes…

Machine Learning · Computer Science 2024-04-02 Junoh Kang , Jinyoung Choi , Sungik Choi , Bohyung Han

Data-parallel SGD is the de facto algorithm for distributed optimization, especially for large scale machine learning. Despite its merits, communication bottleneck is one of its persistent issues. Most compression schemes to alleviate this…

Neural and Evolutionary Computing · Computer Science 2024-02-07 Ashok Vardhan Makkuva , Marco Bondaschi , Thijs Vogels , Martin Jaggi , Hyeji Kim , Michael C. Gastpar

With fluid antenna system (FAS) gradually establishing itself as a possible enabling technology for next generation wireless communications, channel estimation for FAS has become a pressing issue. Existing methodologies however face…

Signal Processing · Electrical Eng. & Systems 2025-07-09 Zhen Chen , Jianqing Li , Xiu Yin Zhang , Kai-Kit Wong , Chan-Byoung Chae , Yangyang Zhang