English
Related papers

Related papers: TOIB: Task-Oriented Orthogonalised Information Bot…

200 papers

Semantic communication is emerging as an effective means of facilitating intelligent and context-aware communication for next-generation communication systems. In this paper, we propose a novel metric called Age of Incorrect Semantics…

Information Theory · Computer Science 2025-08-21 Xue Han , Biqian Feng , Yongpeng Wu , Xiang-Gen Xia , Wenjun Zhang , Shengli Sun

Semantic communication aims to transmit information most relevant to a task rather than raw data, offering significant gains in communication efficiency for applications such as telepresence, augmented reality, and remote sensing. Recent…

Machine Learning · Computer Science 2025-12-18 Matin Mortaheb , Erciyes Karakaya , Sennur Ulukus

The emergence of new intelligent applications has fostered the development of a task-oriented communication paradigm, where a comprehensive, universal, and practical metric is crucial for unleashing the potential of this paradigm. To this…

Information Theory · Computer Science 2025-08-21 Shuying Gan , Xijun Wang , Chao Xu , Xiang Chen

Out-of-distribution (OOD) graph generalization are critical for many real-world applications. Existing methods neglect to discard spurious or noisy features of inputs, which are irrelevant to the label. Besides, they mainly conduct…

Machine Learning · Computer Science 2023-06-29 Ling Yang , Jiayi Zheng , Heyuan Wang , Zhongyi Liu , Zhilin Huang , Shenda Hong , Wentao Zhang , Bin Cui

The information bottleneck (IB) problem is a widely studied framework in machine learning for extracting compressed features that are informative for downstream tasks. However, current approaches to solving the IB problem rely on a…

Information Theory · Computer Science 2024-10-11 Amirmohammad Farzaneh , Osvaldo Simeone

Semantic communication is focused on optimizing the exchange of information by transmitting only the most relevant data required to convey the intended message to the receiver and achieve the desired communication goal. For example, if we…

Information Theory · Computer Science 2024-02-05 Fatemeh Zahra Safaeipour , Morteza Hashemi

Recent advances in sophisticated synthetic speech generated from text-to-speech (TTS) or voice conversion (VC) systems cause threats to the existing automatic speaker verification (ASV) systems. Since such synthetic speech is generated from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-15 Youngsik Eom , Yeonghyeon Lee , Ji Sub Um , Hoirin Kim

A radical paradigm shift of wireless networks from ``connected things'' to ``connected intelligence'' undergoes, which coincides with the Shanno and Weaver's envisions: Communications will transform from the technical level to the semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Yang Yang , Caili Guo , Fangfang Liu , Chuanhong Liu , Lunan Sun , Qizheng Sun , Jiujiu Chen

Empowered by semantic-rich content information, multimedia recommendation has emerged as a potent personalized technique. Current endeavors center around harnessing multimedia content to refine item representation or uncovering latent…

Information Retrieval · Computer Science 2025-01-22 Yonghui Yang , Le Wu , Zhuangzhuang He , Zhengwei Wu , Richang Hong , Meng Wang

In this work, we generalize the information bottleneck (IB) approach to the multi-view learning context. The exponentially growing complexity of the optimal representation motivates the development of two novel formulations with more…

Information Theory · Computer Science 2022-09-20 Teng-Hui Huang , Aly El Gamal , Hesham El Gamal

Recent advances in AI call for a paradigm shift from bit-centric communication to goal- and semantics-oriented architectures, paving the way for AI-native 6G networks. In this context, we address a key open challenge: enabling heterogeneous…

Multiagent Systems · Computer Science 2025-12-04 Enrico Grimaldi , Mario Edoardo Pandolfo , Gabriele D'Acunto , Sergio Barbarossa , Paolo Di Lorenzo

In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the standard architecture…

Information Theory · Computer Science 2024-05-07 Alessio Devoto , Simone Petruzzi , Jary Pomponi , Paolo Di Lorenzo , Simone Scardapane

The Information Bottleneck (IB) principle offers a compelling theoretical framework to understand how neural networks (NNs) learn. However, its practical utility has been constrained by unresolved theoretical ambiguities and significant…

Machine Learning · Computer Science 2026-02-02 Charles Westphal , Stephen Hailes , Mirco Musolesi

This article investigates the exploitation of semantic communications in multi-user networks. We propose a novel heterogeneous semantic and bit multi-user framework for providing flawless, customized, and intelligent information…

Information Theory · Computer Science 2022-11-17 Xidong Mu , Yuanwei Liu

Token communications is an emerging generative semantic communication concept that reduces transmission rates by using context and transformer-based token processing, with tokens serving as universal semantic units. In this paper, we…

Information Theory · Computer Science 2025-07-11 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Deniz Gündüz

Networked integrated sensing and communication (ISAC) has gained significant attention as a promising technology for enabling next-generation wireless systems. To further enhance networked ISAC, delegating the reception of sensing signals…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Meidong Xia , Zhenyao He , Wei Xu , Yongming Huang , Derrick Wing Kwan Ng , Naofal Al-Dhahir

Today, wireless networks are becoming responsible for serving intelligent applications, such as extended reality and metaverse, holographic telepresence, autonomous transportation, and collaborative robots. Although current fifth-generation…

Networking and Internet Architecture · Computer Science 2024-01-30 Hassan Saadat , Abdullatif Albaseer , Mohamed Abdallah , Amr Mohamed , Aiman Erbad

We study the problem of distributed information bottleneck, in which multiple encoders separately compress their observations in a manner such that, collectively, the compressed signals preserve as much information as possible about another…

Information Theory · Computer Science 2017-10-04 Inaki Estella Aguerri , Abdellatif Zaidi

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

The rapid development of Internet of Things (IoT) technologies has not only enabled new applications, but also presented new challenges for reliable communication with limited resources. In this work, we define a novel problem that can…

Networking and Internet Architecture · Computer Science 2025-09-30 Shaan ul Haque , Siddharth Chandak , Federico Chiariotti , Deniz Gunduz , Petar Popovski