English
Related papers

Related papers: Robust Information Bottleneck for Task-Oriented Co…

200 papers

Semantic communications is considered as a promising technology to increase the efficiency of next-generation communication systems, particularly targeting human-machine and machine-type communications. In contrast to the source-agnostic…

Information Theory · Computer Science 2023-07-20 Jialong Xu , Tze-Yang Tung , Bo Ai , Wei Chen , Yuxuan Sun , Deniz Gunduz

This paper investigates an information-theoretic model of secure semantic-aware communication. For this purpose, we consider the lossy joint source-channel coding (JSCC) of a memoryless semantic source transmitted over a memoryless wiretap…

Information Theory · Computer Science 2026-05-26 Denis Kozlov , Mahtab Mirmohseni , Rahim Tafazolli

This paper investigates a key challenge faced by joint source-channel coding (JSCC) in digital semantic communication (SemCom): the incompatibility between existing JSCC schemes that yield continuous encoded representations and digital…

Information Theory · Computer Science 2025-11-12 Yujie Zhou , Rulong Wang , Yong Xiao , Yingyu Li , Guangming Shi

The Information Bottleneck (IB) principle facilitates effective representation learning by preserving label-relevant information while compressing irrelevant information. However, its strong reliance on accurate labels makes it inherently…

Machine Learning · Computer Science 2025-12-12 Yi Huang , Qingyun Sun , Yisen Gao , Haonan Yuan , Xingcheng Fu , Jianxin Li

This paper studies task-oriented, otherwise known as goal-oriented, communications, in a setting where a transmitter communicates with multiple receivers, each with its own task to complete on a dataset, e.g., images, available at the…

Networking and Internet Architecture · Computer Science 2023-08-15 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

A joint source-channel coding (JSCC) scheme based on hybrid digital/analog coding is proposed for the transmission of correlated sources over discrete-memoryless two-way channels (DM-TWCs). The scheme utilizes the correlation between the…

Information Theory · Computer Science 2020-08-13 Jian-Jia Weng , Fady Alajaji , Tamás Linder

As a paradigm shift towards pervasive intelligence, semantic communication (SemCom) has shown great potentials to improve communication efficiency and provide user-centric services by delivering task-oriented semantic meanings. However, the…

Signal Processing · Electrical Eng. & Systems 2025-05-02 Hao Wei , Wen Wang , Wanli Ni , Wenjun Xu , Yongming Huang , Dusit Niyato , Ping Zhang

Cross-technology communication (CTC) is a promising technique that enables direct communications among incompatible wireless technologies without needing hardware modification. However, it has not been widely adopted in real-world…

Information Theory · Computer Science 2024-02-16 Shumin Yao , Xiaodong Xu , Hao Chen , Yaping Sun , Qinglin Zhao

This paper presents Hyper-VIB, a hypernetwork-enhanced information bottleneck (IB) approach designed to enable efficient task-oriented communications in 6G collaborative intelligent systems. Leveraging IB theory, our approach enables an…

Information Theory · Computer Science 2025-11-20 Jingchen Peng , Chaowen Deng , Yili Deng , Boxiang Ren , Lu Yang

In recent years, numerous data-intensive broadcasting applications have emerged at the wireless edge, calling for a flexible tradeoff between distortion, transmission rate, and processing complexity. While deep learning-based joint…

Information Theory · Computer Science 2026-03-24 Zijun Qin , Jingxuan Huang , Zesong Fei , Haichuan Ding , Yulin Shao , Xianhao Chen

Whenever communication takes place to fulfil a goal, an effective way to encode the source data to be transmitted is to use an encoding rule that allows the receiver to meet the requirements of the goal. A formal way to identify the…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Francesco Pezone , Sergio Barbarossa , Paolo Di Lorenzo

This work is concerned with robust distributed multi-view image transmission over a severe fading channel with imperfect channel state information (CSI), wherein the sources are slightly correlated. Since the signals are further distorted…

Signal Processing · Electrical Eng. & Systems 2026-04-15 Biao Dong , Bin Cao , Guan Gui , Qinyu Zhang

In recent years, the Transformer architecture has achieved outstanding performance across a wide range of tasks and modalities. Token is the unified input and output representation in Transformer-based models, which has become a fundamental…

Signal Processing · Electrical Eng. & Systems 2025-11-20 Jingkai Ying , Zhijin Qin , Yulong Feng , Liejun Wang , Xiaoming Tao

This paper presents an adaptive framework for edge inference based on a dynamically configurable transformer-powered deep joint source channel coding (DJSCC) architecture. Motivated by a practical scenario where a resource constrained edge…

Machine Learning · Computer Science 2025-05-26 Alessio Devoto , Jary Pomponi , Mattia Merluzzi , Paolo Di Lorenzo , Simone Scardapane

Information bottleneck is an information-theoretic principle of representation learning that aims to learn a maximally compressed representation that preserves as much information about labels as possible. Under this principle, two…

Information Theory · Computer Science 2023-11-08 Yuyan Ni , Yanyan Lan , Ao Liu , Zhiming Ma

Joint source-channel coding (JSCC) is an effective approach for semantic communication. However, current JSCC methods are difficult to integrate with existing communication network architectures, where application and network providers are…

Information Theory · Computer Science 2025-07-18 Wenzheng Kong , Wenyi Zhang

This paper investigates a multi-terminal source coding problem under a logarithmic loss fidelity which does not necessarily lead to an additive distortion measure. The problem is motivated by an extension of the Information Bottleneck…

Information Theory · Computer Science 2021-11-29 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Benefiting from large-scale pretrained vision language models (VLMs), the performance of visual question answering (VQA) has approached human oracles. However, finetuning such models on limited data often suffers from overfitting and poor…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jingjing Jiang , Ziyi Liu , Nanning Zheng

Deep learning based joint source-channel coding (JSCC) has demonstrated significant advancements in data reconstruction compared to separate source-channel coding (SSCC). This superiority arises from the suboptimality of SSCC when dealing…

Machine Learning · Computer Science 2023-08-23 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Multi-task learning (MTL) is an efficient way to improve the performance of related tasks by sharing knowledge. However, most existing MTL networks run on a single end and are not suitable for collaborative intelligence (CI) scenarios. In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Mengyang Wang , Zhicong Zhang , Jiahui Li , Mengyao Ma , Xiaopeng Fan