English
Related papers

Related papers: On the Role of Feedback in LT Codes

200 papers

Large Language Models (LLMs) changed the way we design and interact with software systems. Their ability to process and extract information from text has drastically improved productivity in a number of routine tasks. Developers that want…

Machine Learning · Computer Science 2025-08-26 Federico Errica , Giuseppe Siracusano , Davide Sanvito , Roberto Bifulco

We consider the problem of coding over the multi-user Interference Channel (IC). It is well-known that aligning the interfering signals results in improved achievable rates in certain setups involving more than two users. We argue that in…

Information Theory · Computer Science 2016-02-18 F. Shirani , S. S. Pradhan

Large Language Models (LLMs) are highly sensitive to prompts, including additional context provided therein. As LLMs grow in capability, understanding their prompt-sensitivity becomes increasingly crucial for ensuring reliable and robust…

Computation and Language · Computer Science 2024-08-23 Sotiris Anagnostidis , Jannis Bulian

Today's robots are increasingly interacting with people and need to efficiently learn inexperienced user's preferences. A common framework is to iteratively query the user about which of two presented robot trajectories they prefer. While…

Robotics · Computer Science 2021-10-04 Nils Wilde , Erdem Bıyık , Dorsa Sadigh , Stephen L. Smith

Many multi-agent systems require inter-agent communication to properly achieve their goal. By learning the communication protocol alongside the action protocol using multi-agent reinforcement learning techniques, the agents gain the…

Machine Learning · Computer Science 2023-08-10 Astrid Vanneste , Thomas Somers , Simon Vanneste , Kevin Mets , Tom De Schepper , Siegfried Mercelis , Peter Hellinckx

Speculative decoding (SD) accelerates large language model (LLM) inference by using a smaller model to draft future tokens, which are then verified by the target LLM. This preserves generation quality by accepting only aligned tokens.…

Computation and Language · Computer Science 2026-04-08 Taehyeon Kim , Hojung Jung , Se-Young Yun

Multi-task learning (MTL) is a paradigm that simultaneously learns multiple tasks by sharing information at different levels, enhancing the performance of each individual task. While previous research has primarily focused on feature-level…

Machine Learning · Computer Science 2024-04-02 Xiangming Xi , Feng Gao , Jun Xu , Fangtai Guo , Tianlei Jin

Communication systems with low-resolution analog-to-digital-converters (ADCs) can exploit channel state information at the transmitter (CSIT) and receiver. This paper presents initial results on codebook design and performance analysis for…

Information Theory · Computer Science 2015-12-22 Jianhua Mo , Robert W. Heath

We present simple coding strategies, which are variants of the Schalkwijk-Kailath scheme, for communicating reliably over additive white noise channels in the presence of corrupted feedback. More specifically, we consider a framework…

Information Theory · Computer Science 2007-07-13 Nuno C Martins , Tsachy Weissman

Block diagonalization is a linear precoding technique for the multiple antenna broadcast (downlink) channel that involves transmission of multiple data streams to each receiver such that no multi-user interference is experienced at any of…

Information Theory · Computer Science 2016-11-17 Niranjay Ravindran , Nihar Jindal

Optimizing Register-Transfer Level (RTL) code is crucial for improving hardware PPA performance. Large Language Models (LLMs) offer new approaches for automatic RTL code generation and optimization. However, existing methods often lack…

Hardware Architecture · Computer Science 2025-01-13 Bowei Wang , Qi Xiong , Zeqing Xiang , Lei Wang , Renzhi Chen

As the mobile application landscape expands, wireless networks are tasked with supporting different connection profiles, including real-time traffic and delay-sensitive communications. Among many ensuing engineering challenges is the need…

Information Theory · Computer Science 2014-03-31 Fatemeh Hamidi-Sepehr , Jean-Francois Chamberland , Henry D. Pfister

Multiuser multiple-input multiple-output (MIMO) systems are a prime candidate for use in massive connection density in machine-type communication (MTC) networks. One of the key challenges of MTC networks is to obtain accurate channel state…

Information Theory · Computer Science 2019-04-25 Jiho Song , Byungju Lee , Song Noh , Jong-Ho Lee

We examine the benefits of user cooperation under compute-and-forward. Much like in network coding, receivers in a compute-and-forward network recover finite-field linear combinations of transmitters' messages. Recovery is enabled by linear…

Information Theory · Computer Science 2012-03-06 Matthew Nokleby , Behnaam Aazhang

We consider reversely-degraded secure-communication channels, for which the secrecy capacity is zero if there is no channel feedback. Specifically, we focus on a seeded modular code design for the block-fading Gaussian wiretap channel with…

Information Theory · Computer Science 2026-05-13 Yingyao Zhou , Natasha Devroye , Onur Günlü

Autoregressive transformers exhibit adaptive learning through in-context learning (ICL), which begs the question of how. Prior works have shown that transformers represent the ICL tasks as vectors in their representations. In this paper, we…

Computation and Language · Computer Science 2025-06-03 Seungwook Han , Jinyeop Song , Jeff Gore , Pulkit Agrawal

We consider the transmission of packets across a lossy end-to-end network path so as to achieve low in-order delivery delay. This can be formulated as a decision problem, namely deciding whether the next packet to send should be an…

Networking and Internet Architecture · Computer Science 2018-12-17 Pablo Garrido , Douglas Leith , Ramon Aguero

Transformer architectures have emerged as promising deep learning (DL) tools for modeling complex sequence-to-sequence interactions in channel decoding. However, current transformer-based decoders for error correction codes (ECCs)…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Hongzhi Zhu , Wei Xu , Xiaohu You

Recent studies have demonstrated outstanding capabilities of large language models (LLMs) in software engineering tasks, including code generation and comprehension. While LLMs have shown significant potential in assisting with coding, LLMs…

Software Engineering · Computer Science 2025-11-18 Jiawen Wen , Bangshuo Zhu , Huaming Chen

The paper presents original approach to concurrent optimization of the transmitting and receiving parts of adaptive communication systems (CS) with feedback channels. The results of research show a possibility and the way of designing the…

Information Theory · Computer Science 2010-08-10 Anatoliy Platonov