English
Related papers

Related papers: Learning Task-Oriented Communication for Edge Infe…

200 papers

Bayesian Inference and Information Bottleneck are the two most popular objectives for neural networks, but they can be optimised only via a variational lower bound: the Variational Information Bottleneck (VIB). In this manuscript we show…

Machine Learning · Computer Science 2020-03-10 Vincenzo Crescimanna , Bruce Graham

Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over wireless links…

Machine Learning · Computer Science 2026-01-22 Hang Zhao , Hongru Li , Dongfang Xu , Shenghui Song , Khaled B. Letaief

Conflicting objectives present a considerable challenge in interleaving multi-task learning, necessitating the need for meticulous design and balance to ensure effective learning of a representative latent data space across all tasks…

Machine Learning · Computer Science 2025-01-17 Noelle Y. L. Wong , Eng Yeow Cheu , Zhonglin Chiam , Dipti Srinivasan

The Information Bottleneck (IB) principle has emerged as a promising approach for enhancing the generalization, robustness, and interpretability of deep neural networks, demonstrating efficacy across image segmentation, document clustering,…

Information Theory · Computer Science 2025-04-18 Hanzhe Yang , Youlong Wu , Dingzhu Wen , Yong Zhou , Yuanming Shi

With the rapid development of large multimodal models (LMMs), multimodal understanding applications are emerging. As most LMM inference requests originate from edge devices with limited computational capabilities, the predominant inference…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Cheng Yuan , Zhening Liu , Jiashu Lv , Jiawei Shao , Yufei Jiang , Jun Zhang , Xuelong Li

Information Bottleneck (IB) based multi-view learning provides an information theoretic principle for seeking shared information contained in heterogeneous data descriptions. However, its great success is generally attributed to estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Xudong Tian , Zhizhong Zhang , Cong Wang , Wensheng Zhang , Yanyun Qu , Lizhuang Ma , Zongze Wu , Yuan Xie , Dacheng Tao

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

6G will connect heterogeneous intelligent agents to make them operate complex cooperative tasks. When connecting intelligence, two main research questions arise to identify how AI and ML models behave depending on: i) their input data…

Signal Processing · Electrical Eng. & Systems 2023-08-28 Mattia Merluzzi , Miltiadis C. Filippou , Leonardo Gomes Baltar , Markus D. Muek , Emilio Calvanese Strinati

Semantic communication enhances transmission efficiency by conveying semantic information rather than raw input symbol sequences. Task-oriented semantic communication is a variant that tries to retains only task-specific information, thus…

Cryptography and Security · Computer Science 2025-10-06 Xuesong Wang , Mo Li , Xingyan Shi , Zhaoqian Liu , Shenghao Yang

We propose a variational Bayesian (VB) approach to learning distributions of latent variables in deep neural network (DNN) models for cross-domain knowledge transfer, to address acoustic mismatches between training and testing conditions.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Hu Hu , Sabato Marco Siniscalchi , Chao-Han Huck Yang , Chin-Hui Lee

Integrated sensing and communication (ISAC) is a promising solution to accelerate edge inference via the dual use of wireless signals. However, this paradigm needs to minimize the inference error and latency under ISAC co-functionality…

Signal Processing · Electrical Eng. & Systems 2024-04-17 Xibin Jin , Guoliang Li , Shuai Wang , Miaowen Wen , Chengzhong Xu , H. Vincent Poor

Biased attributes, spuriously correlated with target labels in a dataset, can problematically lead to neural networks that learn improper shortcuts for classifications and limit their capabilities for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jinyung Hong , Eun Som Jeon , Changhoon Kim , Keun Hee Park , Utkarsh Nath , Yezhou Yang , Pavan Turaga , Theodore P. Pavlic

Effective interaction modeling and behavior prediction of dynamic agents play a significant role in interactive motion planning for autonomous robots. Although existing methods have improved prediction accuracy, few research efforts have…

Robotics · Computer Science 2024-01-09 Victoria M. Dax , Jiachen Li , Enna Sachdeva , Nakul Agarwal , Mykel J. Kochenderfer

Conventional unsupervised hashing methods usually take advantage of similarity graphs, which are either pre-computed in the high-dimensional space or obtained from random anchor points. On the one hand, existing methods uncouple the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yuming Shen , Jie Qin , Jiaxin Chen , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

Given the input graph and its label/property, several key problems of graph learning, such as finding interpretable subgraphs, graph denoising and graph compression, can be attributed to the fundamental problem of recognizing a subgraph of…

Machine Learning · Computer Science 2020-10-13 Junchi Yu , Tingyang Xu , Yu Rong , Yatao Bian , Junzhou Huang , Ran He

The information bottleneck (IB) method seeks a compressed representation of data that preserves information relevant to a target variable for prediction while discarding irrelevant information from the original data. In its classical…

Information Theory · Computer Science 2026-02-23 Akira Kamatsuka , Takahiro Yoshida

Discrete representation has emerged as a powerful tool in task-oriented semantic communication (ToSC), offering compact, interpretable, and efficient representations well-suited for low-power edge intelligence scenarios. Its inherent…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Anbang Zhang , Shuaishuai Guo , Chenyuan Feng , Hongyang Du , Haojin Li , Chen Sun , Haijun Zhang

This letter proposes UniToCom, a unified token communication paradigm that treats tokens as the fundamental units for both processing and wireless transmission. Specifically, to enable efficient token representations, we propose a…

Signal Processing · Electrical Eng. & Systems 2025-07-03 Hao Wei , Wanli Ni , Wen Wang , Wenjun Xu , Dusit Niyato , Ping Zhang

As an increasing amount of image and video content will be analyzed by machines, there is demand for a new codec paradigm that is capable of compressing visual input primarily for the purpose of computer vision inference, while secondarily…

Image and Video Processing · Electrical Eng. & Systems 2023-01-12 Ezgi Ozyilkan , Mateen Ulhaq , Hyomin Choi , Fabien Racape

Departing from the classic paradigm of data-centric designs, the 6G networks for supporting edge AI features task-oriented techniques that focus on effective and efficient execution of AI task. Targeting end-to-end system performance, such…

Information Theory · Computer Science 2022-11-03 Dingzhu Wen , Xiang Jiao , Peixi Liu , Guangxu Zhu , Yuanming Shi , Kaibin Huang