English
Related papers

Related papers: Multi-Modal Self-Supervised Semantic Communication

200 papers

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Empowered by deep learning, semantic communication marks a paradigm shift from transmitting raw data to conveying task-relevant meaning, enabling more efficient and intelligent wireless systems. In this study, we explore a deep…

Information Theory · Computer Science 2026-01-28 Chenyang Wang , Roger Olsson , Stefan Forsström , Qing He

We propose semantic communication over wireless channels for various modalities, e.g., text and images, in a task-oriented communications setup where the task is classification. We present two approaches based on memory and learning. Both…

Information Theory · Computer Science 2024-02-01 Emrecan Kutay , Aylin Yener

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

The growing demands of artificial intelligence and immersive media require communication beyond bit-level accuracy to meaning awareness. Conventional optical systems that focused on syntactic precision suffer significant inefficiencies.…

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Semantic communication has shown great potential in boosting the effectiveness and reliability of communications. However, its systems to date are mostly enabled by deep learning, which requires demanding computing resources. This article…

Information Theory · Computer Science 2023-12-04 Zhijin Qin , Jingkai Ying , Dingxi Yang , Hengjiang Wang , Xiaoming Tao

Semantic communication technologies enable wireless edge devices to communicate effectively by transmitting semantic meaning of data. Edge components, such as vehicles in next-generation intelligent transport systems, use well-trained…

Networking and Internet Architecture · Computer Science 2022-08-11 Zi Qin Liew , Hongyang Du , Wei Yang Bryan Lim , Zehui Xiong , Dusit Niyato , Chunyan Miao , Dong In Kim

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

As digital technologies advance, communication networks face challenges in handling the vast data generated by intelligent devices. Autonomous vehicles, smart sensors, and IoT systems necessitate new paradigms. This thesis addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Francesco Pezone

Task-oriented semantic communications have achieved significant performance gains. However, the employed deep neural networks in semantic communications have to be updated when the task is changed or multiple models need to be stored for…

Signal Processing · Electrical Eng. & Systems 2024-06-11 Guangyi Zhang , Qiyu Hu , Zhijin Qin , Yunlong Cai , Guanding Yu , Xiaoming Tao

This work presents a novel semantic transmission framework in wireless networks, leveraging the joint processing technique. Our framework enables multiple cooperating base stations to efficiently transmit semantic information to multiple…

Information Theory · Computer Science 2024-01-03 Xumin Pu , Tiantian Lei , Wanli Wen , Qianbin Chen

The development of emerging applications, such as autonomous transportation systems, are expected to result in an explosive growth in mobile data traffic. As the available spectrum resource becomes more and more scarce, there is a growing…

Networking and Internet Architecture · Computer Science 2022-02-15 Wanting Yang , Zi Qin Liew , Wei Yang Bryan Lim , Zehui Xiong , Dusit Niyato , Xuefen Chi , Xianbin Cao , Khaled B. Letaief

With the proliferation of edge computing, efficient AI inference on edge devices has become essential for intelligent applications such as autonomous vehicles and VR/AR. In this context, we address the problem of efficient remote object…

Information Theory · Computer Science 2023-12-01 Xiangyu Gao , Yaping Sun , Dongyu Wei , Xiaodong Xu , Hao Chen , Hao Yin , Shuguang Cui

Task-oriented semantic communication enhances transmission efficiency by conveying semantic information rather than exact messages. Deep learning (DL)-based semantic communication can effectively cultivate the essential semantic knowledge…

Machine Learning · Computer Science 2025-05-27 Run Gu , Wei Xu , Zhaohui Yang , Dusit Niyato , Aylin Yener

With the rapid growth of intelligent services, communication targets are shifting from humans to artificial intelligent (AI) agents, which require new paradigms to enable real-time perception, decision-making, and collaboration. Semantic…

Artificial Intelligence · Computer Science 2025-10-02 Kaiwen Yu , Mengying Sun , Zhijin Qin , Xiaodong Xu , Ping Yang , Yue Xiao , Gang Wu

Recent advancements in generative artificial intelligence have introduced groundbreaking approaches to innovating next-generation semantic communication, which prioritizes conveying the meaning of a message rather than merely transmitting…

Artificial Intelligence · Computer Science 2025-05-19 Achintha Wijesinghe , Weiwei Wang , Suchinthaka Wanninayaka , Songyang Zhang , Zhi Ding

Recently, semantic communications are envisioned as a key enabler of future 6G networks. Back to Shannon's information theory, the goal of communication has long been to guarantee the correct reception of transmitted messages irrespective…

Information Theory · Computer Science 2021-10-18 Mohamed Sana , Emilio Calvanese Strinati

Establishing visual correspondence across images is a challenging and essential task. Recently, an influx of self-supervised methods have been proposed to better learn representations for visual correspondence. However, we find that these…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yingdong Hu , Renhao Wang , Kaifeng Zhang , Yang Gao

Semantic communication (SemCom) has emerged as a promising technique for the next-generation communication systems, in which the generation at the receiver side is allowed with semantic features' recovery. However, the majority of existing…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Chengyang Liang , Dong Li