English
Related papers

Related papers: TOIB: Task-Oriented Orthogonalised Information Bot…

200 papers

Semantic communication has emerged as new paradigm shifts in 6G from the conventional syntax-oriented communications. Recently, the wireless broadcast technology has been introduced to support semantic communication system toward higher…

Signal Processing · Electrical Eng. & Systems 2024-02-01 Mingze Gong , Shuoyao Wang , Fangwei Ye , Suzhi Bi

Semantic communication has gained attention as a key enabler for intelligent and context-aware communication. However, one of the key challenges of semantic communications is the need to tailor the resource allocation to meet the specific…

Information Theory · Computer Science 2024-01-22 Ouiame Marnissi , Hajar EL Hammouti , El Houcine Bergou

Information Bottleneck (IB) is a generalization of rate-distortion theory that naturally incorporates compression and relevance trade-offs for learning. Though the original IB has been extensively studied, there has not been much…

Machine Learning · Computer Science 2019-10-08 Thanh T. Nguyen , Jaesik Choi

Subgraph recognition aims at discovering a compressed substructure of a graph that is most informative to the graph property. It can be formulated by optimizing Graph Information Bottleneck (GIB) with a mutual information estimator.…

Machine Learning · Computer Science 2022-04-05 Junchi Yu , Jie Cao , Ran He

Multimodal sentiment analysis has received significant attention across diverse research domains. Despite advancements in algorithm design, existing approaches suffer from two critical limitations: insufficient learning of…

Artificial Intelligence · Computer Science 2025-11-04 Huiting Huang , Tieliang Gong , Kai He , Jialun Wu , Erik Cambria , Mengling Feng

Traditional communication systems focus on the transmission process, and the context-dependent meaning has been ignored. The fact that 5G system has approached Shannon limit and the increasing amount of data will cause communication…

Signal Processing · Electrical Eng. & Systems 2022-02-22 Chen Dong , Haotai Liang , Xiaodong Xu , Shujun Han , Bizhu Wang , Ping Zhang

Semantic communication has emerged as a promising technology for enhancing communication efficiency. However, most existing research emphasizes single-task reconstruction, neglecting model adaptability and generalization across multi-task…

Information Theory · Computer Science 2025-04-01 Weiwen Yuan , Jinke Ren , Chongjie Wang , Ruichen Zhang , Jun Wei , Dong In Kim , Shuguang Cui

While large-scale pretrained language models have obtained impressive results when fine-tuned on a wide variety of tasks, they still often suffer from overfitting in low-resource scenarios. Since such models are general-purpose feature…

Computation and Language · Computer Science 2021-06-11 Rabeeh Karimi Mahabadi , Yonatan Belinkov , James Henderson

Motivated by the recent success of Machine Learning (ML) tools in wireless communications, the idea of semantic communication by Weaver from 1949 has gained attention. It breaks with Shannon's classic design paradigm by aiming to transmit…

Information Theory · Computer Science 2023-07-14 Edgar Beck , Carsten Bockelmann , Armin Dekorsy

Developing interpretable models for neurodevelopmental disorders (NDDs) diagnosis presents significant challenges in effectively encoding, decoding, and integrating multimodal neuroimaging data. While many existing machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yueyang Li , Lei Chen , Wenhao Dong , Shengyu Gong , Zijian Kang , Boyang Wei , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Semantic communication is emerging as the next pillar in wireless communication technology due to its transformative capabilities in reducing communication overhead, enhancing robustness, and enabling intelligent information exchange. The…

Information Theory · Computer Science 2025-10-08 Loc X. Nguyen , Avi Deb Raha , Pyae Sone Aung , Dusit Niyato , Zhu Han , Choong Seon Hong

In this paper, we study a remote source coding scenario in which binary phase shift keying (BPSK) modulation sources are corrupted by additive white Gaussian noise (AWGN). An intermediate node, such as a relay, receives these observations…

Information Theory · Computer Science 2024-05-14 Yi Song , Kai Wan , Zhenyu Liao , Giuseppe Caire

Weakly supervised semantic segmentation produces pixel-level localization from class labels; however, a classifier trained on such labels is likely to focus on a small discriminative region of the target object. We interpret this phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Jungbeom Lee , Jooyoung Choi , Jisoo Mok , Sungroh Yoon

Semantic communications are considered a promising beyond-Shannon/bit paradigm to reduce network traffic and increase reliability, thus making wireless networks more energy efficient, robust, and sustainable. However, the performance is…

Effective task-oriented semantic communications relies on perfect knowledge alignment between transmitters and receivers for accurate recovery of task-related semantic information, which can be susceptible to knowledge misalignment and…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Hong Chen , Fang Fang , Xianbin Wang

Rapid advancements in multimodal large language models have enabled the creation of hyper-realistic images from textual descriptions. However, these advancements also raise significant concerns about unauthorized use, which hinders their…

Multimedia · Computer Science 2024-12-17 Yongyang Pan , Xiaohong Liu , Siqi Luo , Yi Xin , Xiao Guo , Xiaoming Liu , Xiongkuo Min , Guangtao Zhai

This work presents a novel semantic transmission framework in wireless networks, leveraging the joint processing technique. Our framework enables multiple cooperating base stations to efficiently transmit semantic information to multiple…

Information Theory · Computer Science 2024-01-03 Xumin Pu , Tiantian Lei , Wanli Wen , Qianbin Chen

As digital technologies advance, communication networks face challenges in handling the vast data generated by intelligent devices. Autonomous vehicles, smart sensors, and IoT systems necessitate new paradigms. This thesis addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Francesco Pezone

With the development of artificial intelligence (AI) techniques and the increasing popularity of camera-equipped devices, many edge video analytics applications are emerging, calling for the deployment of computation-intensive AI models at…

Signal Processing · Electrical Eng. & Systems 2024-04-02 Jiawei Shao , Xinjie Zhang , Jun Zhang

Although link prediction on graphs has achieved great success with the development of graph neural networks (GNNs), the potential robustness under the edge noise is still less investigated. To close this gap, we first conduct an empirical…

Machine Learning · Computer Science 2023-11-03 Zhanke Zhou , Jiangchao Yao , Jiaxu Liu , Xiawei Guo , Quanming Yao , Li He , Liang Wang , Bo Zheng , Bo Han