English
Related papers

Related papers: Distributed Information Bottleneck Theory for Mult…

200 papers

Mobile devices increasingly require the parallel execution of several computing tasks offloaded at the wireless edge. Existing communication systems only support parallel transmissions at the bit level, which fundamentally limits the number…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-19 Mohammad Abdi , Francesca Meneghello , Francesco Restuccia

Semantic communication has emerged as a promising technology for enhancing communication efficiency. However, most existing research emphasizes single-task reconstruction, neglecting model adaptability and generalization across multi-task…

Information Theory · Computer Science 2025-04-01 Weiwen Yuan , Jinke Ren , Chongjie Wang , Ruichen Zhang , Jun Wei , Dong In Kim , Shuguang Cui

As our world grows increasingly connected and new technologies arise, global demands for data traffic continue to rise exponentially. Limited by the fundamental results of information theory, to meet these demands we are forced to either…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Dylan Wheeler , Balasubramaniam Natarajan

Collaborative perception systems leverage multiple edge devices, such surveillance cameras or autonomous cars, to enhance sensing quality and eliminate blind spots. Despite their advantages, challenges such as limited channel capacity and…

Networking and Internet Architecture · Computer Science 2025-01-07 Zhengru Fang , Senkang Hu , Jingjing Wang , Yiqin Deng , Xianhao Chen , Yuguang Fang

Task-Oriented Semantic Communication (TOSC) has been regarded as a promising communication framework, serving for various Artificial Intelligence (AI) task driven applications. The existing TOSC frameworks focus on extracting the full…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Yuzhou Fu , Wenchi Cheng , Jingqing Wang , Liuguo Yin , Wei Zhang

Network coding allows distributed information sources such as sensors to efficiently compress and transmit data to distributed receivers across a bandwidth-limited network. Classical network coding is largely task-agnostic -- the coding…

Information Theory · Computer Science 2022-11-02 Jiangnan Cheng , Sandeep Chinchali , Ao Tang

Semantic communication is emerging as the next pillar in wireless communication technology due to its transformative capabilities in reducing communication overhead, enhancing robustness, and enabling intelligent information exchange. The…

Information Theory · Computer Science 2025-10-08 Loc X. Nguyen , Avi Deb Raha , Pyae Sone Aung , Dusit Niyato , Zhu Han , Choong Seon Hong

Information bottleneck (IB) is a technique for extracting information in one random variable $X$ that is relevant for predicting another random variable $Y$. IB works by encoding $X$ in a compressed "bottleneck" random variable $M$ from…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey , David H. Wolpert

Semantic communication and edge-cloud collaborative intelligence are increasingly recognized as foundational enablers for next-generation intelligent services operating under stringent bandwidth, latency, and resource constraints. By…

Networking and Internet Architecture · Computer Science 2025-12-23 Murdadha Nasif , Ahmed Refaey Hussein

Math Word Problems (MWP) aims to automatically solve mathematical questions given in texts. Previous studies tend to design complex models to capture additional information in the original text so as to enable the model to gain more…

Computation and Language · Computer Science 2026-01-12 Jing Xiong , Chengming Li , Min Yang , Xiping Hu , Bin Hu

Multi-agent reinforcement learning systems deployed in real-world robotics applications face severe communication constraints that significantly impact coordination effectiveness. We present a framework that combines information bottleneck…

Robotics · Computer Science 2026-02-03 Ahmad Farooq , Kamran Iqbal

Wireless connectivity has traditionally been regarded as an opaque data pipe carrying messages, whose context-dependent meaning and effectiveness have been ignored. Nevertheless, in emerging cyber-physical and autonomous networked systems,…

Information Theory · Computer Science 2021-03-11 Marios Kountouris , Nikolaos Pappas

Cross-modal alignment is a crucial task in multimodal learning aimed at achieving semantic consistency between vision and language. This requires that image-text pairs exhibit similar semantics. Traditional algorithms pursue embedding…

Machine Learning · Computer Science 2026-03-09 Xiang Ma , Lexin Fang , Litian Xu , Caiming Zhang

Split learning is a privacy-preserving distributed learning paradigm in which an ML model (e.g., a neural network) is split into two parts (i.e., an encoder and a decoder). The encoder shares so-called latent representation, rather than raw…

Machine Learning · Computer Science 2023-09-07 Omar Alhussein , Moshi Wei , Arashmid Akhavain

Semantic communication enables intelligent agents to extract meaning (or semantics) of information via interaction, to carry out collaborative tasks. In this paper, we study semantic communication from a topological space perspective, in…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Qiyang Zhao , Mehdi Bennis , Merouane Debbah , Daniel Benevides da Costa

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users transmit images while…

Signal Processing · Electrical Eng. & Systems 2021-12-15 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Although deep neural networks have been immensely successful, there is no comprehensive theoretical understanding of how they work or are structured. As a result, deep networks are often seen as black boxes with unclear interpretations and…

Machine Learning · Computer Science 2022-02-22 Ravid Shwartz-Ziv

Optimal transport has numerous applications, particularly in machine learning tasks involving generative models. In practice, the transportation process often encounters an information bottleneck, typically arising from the conversion of a…

Information Theory · Computer Science 2024-12-30 Xiqiang Qu , Ruibin Li , Jun Chen , Lei Yu , Xinbing Wang

Recent efforts on training visual navigation agents conditioned on language using deep reinforcement learning have been successful in learning policies for different multimodal tasks, such as semantic goal navigation and embodied question…

Machine Learning · Computer Science 2019-02-05 Devendra Singh Chaplot , Lisa Lee , Ruslan Salakhutdinov , Devi Parikh , Dhruv Batra

Task-oriented semantic communication (SemCom) prioritizes task execution over accurate symbol reconstruction and is well-suited to emerging intelligent applications. Cooperative multi-task SemCom (CMT-SemCom) further improves task execution…

Signal Processing · Electrical Eng. & Systems 2026-01-27 Ahmad Halimi Razlighi , Pallavi Dhingra , Edgar Beck , Bho Matthiesen , Armin Dekorsy