English
Related papers

Related papers: Semantics-Native Communication with Contextual Rea…

200 papers

Motivated by the recent success of Machine Learning (ML) tools in wireless communications, the idea of semantic communication by Weaver from 1949 has gained attention. It breaks with Shannon's classic design paradigm by aiming to transmit…

Information Theory · Computer Science 2023-07-14 Edgar Beck , Carsten Bockelmann , Armin Dekorsy

Large model has emerged as a key enabler for the popularity of future networked intelligent applications. However, the surge of data traffic brought by intelligent applications puts pressure on the resource utilization and energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-28 Haijun Zhang , Jiaxin Ni , Zijun Wu , Xiangnan Liu , V. C. M. Leung

In this paper, a semantic communication framework is proposed for textual data transmission. In the studied model, a base station (BS) extracts the semantic information from textual data, and transmits it to each user. The semantic…

Information Theory · Computer Science 2022-08-18 Yining Wang , Mingzhe Chen , Tao Luo , Walid Saad , Dusit Niyato , H. Vincent Poor , Shuguang Cui

Semantic communication, recognized as a promising technology for future intelligent applications, has received widespread research attention. Despite the potential of semantic communication to enhance transmission reliability, especially in…

Information Theory · Computer Science 2023-12-05 Lingyi Wang , Wei Wu , Fuhui Zhou , Zhaohui Yang , Zhijin Qin

Context compression is an advanced technique that accelerates large language model (LLM) inference by converting long inputs into compact representations. Existing methods primarily rely on autoencoding tasks to train special compression…

Computation and Language · Computer Science 2026-03-12 Xin Liu , Runsong Zhao , Pengcheng Huang , Xinyu Liu , Junyi Xiao , Chunyang Xiao , Tong Xiao , Shengxiang Gao , Zhengtao Yu , Jingbo Zhu

We present a novel approach to learn representations for sentence-level semantic similarity using conversational data. Our method trains an unsupervised model to predict conversational input-response pairs. The resulting sentence embeddings…

Computation and Language · Computer Science 2018-04-23 Yinfei Yang , Steve Yuan , Daniel Cer , Sheng-yi Kong , Noah Constant , Petr Pilar , Heming Ge , Yun-Hsuan Sung , Brian Strope , Ray Kurzweil

Semantic parsing aims at mapping natural language utterances into structured meaning representations. In this work, we propose a structure-aware neural architecture which decomposes the semantic parsing process into two stages. Given an…

Computation and Language · Computer Science 2018-05-15 Li Dong , Mirella Lapata

This paper presents a novel semantic-based phrase translation model. A pair of source and target phrases are projected into continuous-valued vector representations in a low-dimensional latent semantic space, where their translation score…

Computation and Language · Computer Science 2013-12-03 Jianfeng Gao , Xiaodong He , Wen-tau Yih , Li Deng

Compared with the current Shannon's Classical Information Theory (CIT) paradigm, semantic communication (SemCom) has recently attracted more attention, since it aims to transmit the meaning of information rather than bit-by-bit…

Image and Video Processing · Electrical Eng. & Systems 2023-04-20 Bingxuan Xu , Rui Meng , Yue Chen , Xiaodong Xu , Chen Dong , Hao Sun

Semantic communication has gained significant attention from researchers as a promising technique to replace conventional communication in the next generation of communication systems, primarily due to its ability to reduce communication…

Information Theory · Computer Science 2025-02-07 Loc X. Nguyen , Ye Lin Tun , Yan Kyaw Tun , Minh N. H. Nguyen , Chaoning Zhang , Zhu Han , Choong Seon Hong

We propose semantic communication over wireless channels for various modalities, e.g., text and images, in a task-oriented communications setup where the task is classification. We present two approaches based on memory and learning. Both…

Information Theory · Computer Science 2024-02-01 Emrecan Kutay , Aylin Yener

Speech codecs that convert continuous speech signals into discrete tokens have become essential for speech language models. However, existing codecs struggle to balance high-quality reconstruction with semantically rich representations,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-16 Wenxi Chen , Xinsheng Wang , Ruiqi Yan , Yushen Chen , Zhikang Niu , Ziyang Ma , Xiquan Li , Yuzhe Liang , Hanlin Wen , Shunshun Yin , Ming Tao , Xie Chen

Understanding human language is one of the key themes of artificial intelligence. For language representation, the capacity of effectively modeling the linguistic knowledge from the detail-riddled and lengthy texts and getting rid of the…

Computation and Language · Computer Science 2021-01-08 Zhuosheng Zhang , Yuwei Wu , Junru Zhou , Sufeng Duan , Hai Zhao , Rui Wang

Although the semantic communications have exhibited satisfactory performance in a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise is a particular kind of…

Signal Processing · Electrical Eng. & Systems 2022-05-24 Qiyu Hu , Guangyi Zhang , Zhijin Qin , Yunlong Cai , Guanding Yu , Geoffrey Ye Li

Semantic communication is poised to play a pivotal role in shaping the landscape of future AI-driven communication systems. Its challenge of extracting semantic information from the original complex content and regenerating semantically…

Machine Learning · Computer Science 2023-09-07 Eleonora Grassucci , Yuki Mitsufuji , Ping Zhang , Danilo Comminiello

The burgeoning generative artificial intelligence technology offers novel insights into the development of semantic communication (SemCom) frameworks. These frameworks hold the potential to address the challenges associated with the…

Multimedia · Computer Science 2023-10-25 Wanting Yang , Zehui Xiong , Hongyang Du , Yanli Yuan , Tony Q. S. Quek

Semantic parsing is the problem of deriving machine interpretable meaning representations from natural language utterances. Neural models with encoder-decoder architectures have recently achieved substantial improvements over traditional…

Computation and Language · Computer Science 2019-09-30 Huseyin A. Inan , Gaurav Singh Tomar , Huapu Pan

Task-Oriented Semantic Communication (TOSC) has been considered as a new communication paradigm to serve various samrt devices that depend on Artificial Intelligence (AI) tasks in future wireless networks. The existing TOSC frameworks rely…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Yuzhou Fu , Wenchi Cheng , Wei Zhang , Wei Zhang

As communication systems transition from symbol transmission to conveying meaningful information, sixth-generation (6G) networks emphasize semantic communication. This approach prioritizes high-level semantic information, improving…

Signal Processing · Electrical Eng. & Systems 2025-01-27 Zhe Xiang , Fei Yu , Quan Deng , Yuandi Li , Zhiguo Wan

Spatial constraint systems (scs) are semantic structures for reasoning about spatial and epistemic information in concurrent systems. They have been used to reason about beliefs, lies, and group epistemic behaviour inspired by social…

Multiagent Systems · Computer Science 2019-08-26 Frank Valencia