English
Related papers

Related papers: Channel Coding meets Sequence Design via Machine L…

200 papers

Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for training a…

Computation and Language · Computer Science 2025-06-19 Xuemei Tang , Jun Wang , Qi Su , Chu-ren Huang , Jinghang Gu

When a channel model is available, learning how to communicate on fading noisy channels can be formulated as the (unsupervised) training of an autoencoder consisting of the cascade of encoder, channel, and decoder. An important limitation…

Signal Processing · Electrical Eng. & Systems 2021-10-22 Sangwoo Park , Osvaldo Simeone , Joonhyuk Kang

Large language models (LLMs) excel at a range of tasks through in-context learning (ICL), where only a few task examples guide their predictions. However, prior research highlights that LLMs often overlook input-label mapping information in…

Computation and Language · Computer Science 2025-06-10 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Yancheng Yuan , Dacheng Tao

In the sixth generation (6G), ultra-reliable low-latency communications (URLLC) will be further developed to achieve TKu extreme connectivity. On the premise of ensuring the same rate and reliability, the spatial domain advantage of…

Information Theory · Computer Science 2025-04-02 Feng Ye , Xiaohu You , Jiamin Li , Chen Ji , Chuan Zhang

Recently, the Multilinear Compressive Learning (MCL) framework was proposed to efficiently optimize the sensing and learning steps when working with multidimensional signals, i.e. tensors. In Compressive Learning in general, and in MCL in…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

Multi-label classification (MLC) is an important class of machine learning problems that come with a wide spectrum of applications, each demanding a possibly different evaluation criterion. When solving the MLC problems, we generally expect…

Machine Learning · Computer Science 2019-10-08 Yao-Yuan Yang , Yi-An Lin , Hong-Min Chu , Hsuan-Tien Lin

While Separate Source-Channel Coding (SSCC) retains the practical benefits of modular system design, its effectiveness in noisy text transmission is fundamentally constrained by the fragility of autoregressive source decoding. In low-SNR…

Information Theory · Computer Science 2026-05-08 Ziqiong Wang , Rongpeng Li

In this paper, we consider a remote inference system, where a neural network is used to infer a time-varying target (e.g., robot movement), based on features (e.g., video clips) that are progressively received from a sensing node (e.g., a…

Information Theory · Computer Science 2024-06-25 Md Kamran Chowdhury Shisher , Bo Ji , I-Hong Hou , Yin Sun

We study the problem of multi-bit watermarking for large language models (LLMs). We introduce a block-autoregressive model inspired by multi-token prediction, in which the encoder has limited non-causal access to token distributions within…

Information Theory · Computer Science 2026-05-19 Sidong Guo , Tyler Kann , Teodora Baluta , Matthieu R. Bloch

Efficient constellation design is important for improving performance in communication systems. The problem of multidimensional constellation design has been studied extensively in the literature in the context of multidimensional coded…

Information Theory · Computer Science 2020-04-14 Bharath Shamasundar , A. Chockalingam

The wireless communication technologies have fundamentally revolutionized industrial operations. The operation of the automated equipment is conducted in a closed-loop manner, where the status of devices is collected and sent to the control…

Systems and Control · Electrical Eng. & Systems 2024-09-19 Zeyang Meng , Dingyou Ma , Zhiqing Wei , Ying Zhou , Zhiyong Feng

Error-correction codes are central for fault-tolerant information processing. Here we develop a rigorous framework to describe various coding models based on quantum resource theory of superchannels. We find, by treating codings as…

Quantum Physics · Physics 2024-09-17 Dong-Sheng Wang , Yuan-Dong Liu , Yun-Jiang Wang , Shunlong Luo

We present many new results related to reliable (interactive) communication over insertion-deletion channels. Synchronization errors, such as insertions and deletions, strictly generalize the usual symbol corruption errors and are much…

Information Theory · Computer Science 2018-03-22 Bernhard Haeupler , Amirbehshad Shahrasbi , Ellen Vitercik

Due to the lack of a feedback channel in the C-V2X sidelink, finding a suitable modulation and coding scheme (MCS) is a difficult task. However, recent use cases for vehicle-to-everything (V2X) communication with higher demands on data rate…

Machine Learning · Computer Science 2023-10-02 Asif Abdullah Rokoni , Daniel Schäufele , Martin Kasparick , Sławomir Stańczak

We consider a basic joint communication and sensing setup comprising a transmitter, a receiver and a sensor. The transmitter sends a codeword to the receiver through a discrete memoryless channel, and the receiver is interested in decoding…

Information Theory · Computer Science 2024-12-09 Han Wu , Hamdi Joudeh

Coded caching (CC) can transform cache memory at network devices into an active communication resource. Prior studies have shown that CC can significantly enhance the achievable Degrees of Freedom (DoF) in multi-input multi-output (MIMO)…

Information Theory · Computer Science 2026-03-09 Mohammad NaseriTehrani , MohammadJavad Salehi , Antti Tölli

Semantic communication (SemCom) is accelerating its momentum to catch up with the massive increase in users' demands in both quantity and quality, with the assistance of advanced deep learning (DL) techniques. Specifically, SemCom can…

Information Theory · Computer Science 2026-05-11 Loc X. Nguyen , Phuong-Nam Tran , Trung Thanh Pham , Avi Deb Raha , Eui-Nam Huh , Zhu Han , Choong Seon Hong

With the proliferation of deep learning techniques for wireless communication, several works have adopted learning-based approaches to solve the channel estimation problem. While these methods are usually promoted for their computational…

Information Theory · Computer Science 2022-11-22 Mohamed Akrout , Amal Feriani , Faouzi Bellili , Amine Mezghani , Ekram Hossain

To support interference-free quasi-synchronous code-division multiple-access (QS-CDMA) communication with low spectral density profile in a cognitive radio (CR) network, it is desirable to design a set of CDMA spreading sequences with…

Information Theory · Computer Science 2016-11-17 Su Hu , Zilong Liu , Yong Liang Guan , Wenhui Xiong , Guoan Bi , Shaoqian Li

We recently showed in [1] the superiority of certain structured coding matrices ensembles (such as partial row-orthogonal) for sparse superposition codes when compared with purely random matrices with i.i.d. entries, both…

Information Theory · Computer Science 2022-07-12 YuHao Liu , Teng Fu , Jean Barbier , TianQi Hou