English
Related papers

Related papers: TOIB: Task-Oriented Orthogonalised Information Bot…

200 papers

The evolution toward 6G networks demands a fundamental shift from bit-centric transmission to semantic-aware communication that emphasizes task-relevant information. This work introduces TOAST (Task-Oriented Adaptive Semantic Transmission),…

Machine Learning · Computer Science 2025-06-30 Sheng Yun , Jianhua Pei , Ping Wang

Leveraging high-quality joint representations from multimodal data can greatly enhance model performance in various machine-learning based applications. Recent multimodal learning methods, based on the multimodal information bottleneck…

Machine Learning · Computer Science 2025-05-27 Qilong Wu , Yiyang Shao , Jun Wang , Xiaobo Sun

This paper investigates a multi-terminal source coding problem under a logarithmic loss fidelity which does not necessarily lead to an additive distortion measure. The problem is motivated by an extension of the Information Bottleneck…

Information Theory · Computer Science 2021-11-29 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

The Information Bottleneck (IB) principle facilitates effective representation learning by preserving label-relevant information while compressing irrelevant information. However, its strong reliance on accurate labels makes it inherently…

Machine Learning · Computer Science 2025-12-12 Yi Huang , Qingyun Sun , Yisen Gao , Haonan Yuan , Xingcheng Fu , Jianxin Li

Task-oriented image semantic communication is a new communication paradigm, which aims to transmit semantics for artificial intelligent (AI) tasks while ignoring the reconstruction quality of the images. However, in some applications, such…

Information Theory · Computer Science 2022-12-05 Fangfang Liu , Wanjie Tong , Yang Yang , Zhengfen Sun , Caili Guo

Information bottleneck (IB) is a technique for extracting information in one random variable $X$ that is relevant for predicting another random variable $Y$. IB works by encoding $X$ in a compressed "bottleneck" random variable $M$ from…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey , David H. Wolpert

Efficient communication requires balancing informativity and simplicity when encoding meanings. The Information Bottleneck (IB) framework captures this trade-off formally, predicting that natural language systems cluster near an optimal…

Computation and Language · Computer Science 2026-04-07 Antoine Taroni , Ludovic Moncla , Frederique Laforest

Emergent communication research often focuses on optimizing task-specific utility as a driver for communication. However, human languages appear to evolve under pressure to efficiently compress meanings into communication signals by…

Artificial Intelligence · Computer Science 2022-07-04 Mycal Tucker , Julie Shah , Roger Levy , Noga Zaslavsky

Empowered by deep learning, semantic communication marks a paradigm shift from transmitting raw data to conveying task-relevant meaning, enabling more efficient and intelligent wireless systems. In this study, we explore a deep…

Information Theory · Computer Science 2026-01-28 Chenyang Wang , Roger Olsson , Stefan Forsström , Qing He

The integration of artificial intelligence (AI) and mobile networks is regarded as one of the most important scenarios for 6G. In 6G, a major objective is to realize the efficient transmission of task-relevant data. Then a key problem…

Information Theory · Computer Science 2024-05-01 Jingchen Peng , Boxiang Ren , Lu Yang , Chenghui Peng , Panpan Niu , Hao Wu

The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that…

Machine Learning · Computer Science 2020-12-23 Ziqi Pan , Li Niu , Jianfu Zhang , Liqing Zhang

Information bottleneck is an information-theoretic principle of representation learning that aims to learn a maximally compressed representation that preserves as much information about labels as possible. Under this principle, two…

Information Theory · Computer Science 2023-11-08 Yuyan Ni , Yanyan Lan , Ao Liu , Zhiming Ma

In task-oriented semantic communications, the transmitters are designed to deliver task-related semantic information rather than every signal bit to receivers, which alleviates the spectrum pressure by reducing network traffic loads.…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Hong Chen , Fang Fang , Xianbin Wang

Collaborative edge sensing systems, particularly in collaborative perception systems in autonomous driving, can significantly enhance tracking accuracy and reduce blind spots with multi-view sensing capabilities. However, their limited…

Networking and Internet Architecture · Computer Science 2024-09-02 Zhengru Fang , Senkang Hu , Liyan Yang , Yiqin Deng , Xianhao Chen , Yuguang Fang

Markov processes are widely used mathematical models for describing dynamic systems in various fields. However, accurately simulating large-scale systems at long time scales is computationally expensive due to the short time steps required…

Machine Learning · Computer Science 2024-01-29 Marco Federici , Patrick Forré , Ryota Tomioka , Bastiaan S. Veeling

Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In…

Signal Processing · Electrical Eng. & Systems 2023-09-06 S. Barbarossa , D. Comminiello , E. Grassucci , F. Pezone , S. Sardellitti , P. Di Lorenzo

Deep neural networks suffer from poor generalization to unseen environments when the underlying data distribution is different from that in the training set. By learning minimum sufficient representations from training data, the information…

Machine Learning · Computer Science 2021-10-13 Francesco Alesiani , Shujian Yu , Xi Yu

In this work, we expand the cooperative multi-task semantic communication framework (CMT-SemCom) introduced in [1], which divides the semantic encoder on the transmitter side into a common unit (CU) and multiple specific units (SUs), to a…

Signal Processing · Electrical Eng. & Systems 2026-01-27 Ahmad Halimi Razlighi , Carsten Bockelmann , Armin Dekorsy

Collaborative perception systems leverage multiple edge devices, such surveillance cameras or autonomous cars, to enhance sensing quality and eliminate blind spots. Despite their advantages, challenges such as limited channel capacity and…

Networking and Internet Architecture · Computer Science 2025-01-07 Zhengru Fang , Senkang Hu , Jingjing Wang , Yiqin Deng , Xianhao Chen , Yuguang Fang

Collaborative Perception (CP) has shown great potential to achieve more holistic and reliable environmental perception in intelligent unmanned systems (IUSs). However, implementing CP still faces key challenges due to the characteristics of…

Multiagent Systems · Computer Science 2024-06-06 Sheng Zhou , Yukuan Jia , Ruiqing Mao , Zhaojun Nan , Yuxuan Sun , Zhisheng Niu