English
Related papers

Related papers: Adaptive Information Bottleneck Guided Joint Sourc…

200 papers

The semantic information of the image for intelligent tasks is hidden behind the pixels, and slight changes in the pixels will affect the performance of intelligent tasks. In order to preserve semantic information behind pixels for…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Qizheng Sun , Caili Guo , Yang Yang , Jiujiu Chen , Rui Tang , Chuanhong Liu

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

A scenario involving a source, a channel, and a destination, where the destination is interested in {\em both} reliably reconstructing the message transmitted by the source and estimating with a fidelity criterion the state of the channel,…

Information Theory · Computer Science 2011-08-30 Wenyi Zhang , Satish Vedantam , Urbashi Mitra

Collaborative edge sensing systems, particularly in collaborative perception systems in autonomous driving, can significantly enhance tracking accuracy and reduce blind spots with multi-view sensing capabilities. However, their limited…

Networking and Internet Architecture · Computer Science 2024-09-02 Zhengru Fang , Senkang Hu , Liyan Yang , Yiqin Deng , Xianhao Chen , Yuguang Fang

This paper presents a vision transformer (ViT) based joint source and channel coding (JSCC) scheme for wireless image transmission over multiple-input multiple-output (MIMO) systems, called ViT-MIMO. The proposed ViT-MIMO architecture, in…

Information Theory · Computer Science 2022-10-28 Haotian Wu , Yulin Shao , Chenghong Bian , Krystian Mikolajczyk , Deniz Gündüz

Semantic communication is proposed and expected to improve the efficiency of massive data transmission over sixth generation (6G) networks. However, existing image semantic communication schemes are primarily focused on optimizing…

Multimedia · Computer Science 2025-06-09 Zehao Chen , Xinfeng Wei , Haonan Tong , Zhaohui Yang , Changchuan Yin

The information bottleneck (IB) approach is popular to improve the generalization, robustness and explainability of deep neural networks. Essentially, it aims to find a minimum sufficient representation $\mathbf{t}$ by striking a trade-off…

Machine Learning · Computer Science 2024-04-30 Shujian Yu , Xi Yu , Sigurd Løkse , Robert Jenssen , Jose C. Principe

Recent deep learning methods have led to increased interest in solving high-efficiency end-to-end transmission problems. These methods, we call nonlinear transform source-channel coding (NTSCC), extract the semantic latent features of…

Signal Processing · Electrical Eng. & Systems 2023-08-21 Sixian Wang , Jincheng Dai , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

In this paper we give a short theoretical description of the general predictive adaptive arithmetic coding technique. The links between this technique and the works of J. Rissanen in the 80's, in particular the BIC information criterion…

Information Theory · Computer Science 2007-07-13 Guilhem Coq , Olivier Alata , Marc Arnaudon , Christian Olivier

The Information Bottleneck (IB) principle facilitates effective representation learning by preserving label-relevant information while compressing irrelevant information. However, its strong reliance on accurate labels makes it inherently…

Machine Learning · Computer Science 2025-12-12 Yi Huang , Qingyun Sun , Yisen Gao , Haonan Yuan , Xingcheng Fu , Jianxin Li

Subgraph recognition aims at discovering a compressed substructure of a graph that is most informative to the graph property. It can be formulated by optimizing Graph Information Bottleneck (GIB) with a mutual information estimator.…

Machine Learning · Computer Science 2022-04-05 Junchi Yu , Jie Cao , Ran He

The Accumulative Iterative Code (AIC) proposed in this work is a new error correcting code for channels with feedback. AIC sends the information message to the receiver in a number of transmissions, where the initial transmission contains…

Information Theory · Computer Science 2021-06-15 Alberto G. Perotti , Branislav M. Popovic , Anahid R. Safavi

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

Deep neural networks suffer from poor generalization to unseen environments when the underlying data distribution is different from that in the training set. By learning minimum sufficient representations from training data, the information…

Machine Learning · Computer Science 2021-10-13 Francesco Alesiani , Shujian Yu , Xi Yu

Generative semantic communication models are reshaping semantic communication frameworks by moving beyond pixel-wise optimization to align with human perception. However, many existing approaches prioritize image-level perceptual quality,…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Kailang Ye , Mingze Gong , Shuoyao Wang , Daquan Feng

Recent diffusion-based extreme image compression methods have demonstrated remarkable performance at ultra-low bitrates. However, most approaches require training separate diffusion models for each target bitrate, resulting in substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xinning Chai , Zhengxue Cheng , Xin Li , Rong Xie , Li Song

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao

Multi-agent systems (MAS) are a promising solution for autonomous exploration tasks in hazardous or remote environments, such as planetary surveys. In such settings, communication among agents is essential to ensure collaborative task…

Signal Processing · Electrical Eng. & Systems 2025-10-21 Maximilian H. V. Tillmann , Ban-Sok Shin , Dmitriy Shutin , Armin Dekorsy

Semantic communication technology emerges as a pivotal bridge connecting AI with classical communication. The current semantic communication systems are generally modeled as an Auto-Encoder (AE). AE lacks a deep integration of AI principles…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Yulong Feng , Jing Xu , Liujun Hu , Guanghui Yu , Xiangyang Duan

The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive Language-Image Pretraining), which demonstrate exceptional performance in learning complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zhiyu Zhu , Zhibo Jin , Jiayu Zhang , Nan Yang , Jiahao Huang , Jianlong Zhou , Fang Chen