English
Related papers

Related papers: Semantics-Aware Hierarchical Token Communication: …

200 papers

The use of a learnable codebook provides an efficient way for semantic communications to map vector-based high-dimensional semantic features onto discrete symbol representations required in digital communication systems. In this paper, the…

Information Theory · Computer Science 2025-10-16 Lingyi Wang , Rashed Shelim , Walid Saad , Naren Ramakrishnan

Topological deep learning (TDL) is a rapidly growing field that seeks to leverage topological structure in data and facilitate learning from data supported on topological objects, ranging from molecules to 3D shapes. Most TDL architectures…

Machine Learning · Computer Science 2025-02-13 Yam Eitan , Yoav Gelberg , Guy Bar-Shalom , Fabrizio Frasca , Michael Bronstein , Haggai Maron

Semantic communication (SemCom) aims to convey the intended meaning of messages rather than merely transmitting bits, thereby offering greater efficiency and robustness, particularly in resource-constrained or noisy environments. In this…

Information Theory · Computer Science 2025-07-08 Chengyang Liang , Dong Li

This work designs a novel semantic communication (SemCom) framework for the next-generation wireless network to tackle the challenges of unnecessary transmission of vast amounts that cause high bandwidth consumption, more latency, and…

Networking and Internet Architecture · Computer Science 2023-10-16 Avi Deb Raha , Md. Shirajum Munir , Apurba Adhikary , Yu Qiao , Choong Seon Hong

This position paper presents ThothSP, a Semantic Programming framework with the aim of lowering the coding effort in building smart applications on the Device-Edge-Cloud continuum by leveraging semantic knowledge. It introduces a novel…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-20 Anh Le-Tuan , David Bowden , Danh Le-Phuoc

With recent rapid growth of large language models (LLMs), discrete speech tokenization has played an important role for injecting speech into LLMs. However, this discretization gives rise to a loss of information, consequently impairing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-23 Zhichao Huang , Chutong Meng , Tom Ko

Along with the springing up of the semantics-empowered communication (SemCom) research, it is now witnessing an unprecedentedly growing interest towards a wide range of aspects (e.g., theories, applications, metrics and implementations) in…

Human-Computer Interaction · Computer Science 2023-11-14 Zhilin Lu , Rongpeng Li , Kun Lu , Xianfu Chen , Ekram Hossain , Zhifeng Zhao , Honggang Zhang

The organization of latent token representations plays a crucial role in determining the stability, generalization, and contextual consistency of language models, yet conventional approaches to embedding refinement often rely on parameter…

Computation and Language · Computer Science 2025-03-26 Meiquan Dong , Haoran Liu , Yan Huang , Zixuan Feng , Jianhong Tang , Ruoxi Wang

Language models typically tokenize text into subwords, using a deterministic, hand-engineered heuristic of combining characters into longer surface-level strings such as 'ing' or whole words. Recent literature has repeatedly shown the…

Computation and Language · Computer Science 2023-10-19 Avijit Thawani , Saurabh Ghanekar , Xiaoyuan Zhu , Jay Pujara

The purpose of speech tokenization is to transform a speech signal into a sequence of discrete representations, serving as the foundation for speech language models (SLMs). While speech tokenization has many options, their effect on the…

Computation and Language · Computer Science 2025-06-03 Shunsuke Kando , Yusuke Miyao , Shinnosuke Takamichi

In this paper, we propose a semantic-aware waveform design framework for AI-native 6G networks that jointly optimizes physical layer resource usage and semantic communication efficiency and robustness, while explicitly accounting for the…

Networking and Internet Architecture · Computer Science 2026-02-17 Nour Hello , Mohamed Amine Hamoura , Francois Rivet , Emilio Calvanese Strinati

As digital technologies advance, communication networks face challenges in handling the vast data generated by intelligent devices. Autonomous vehicles, smart sensors, and IoT systems necessitate new paradigms. This thesis addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Francesco Pezone

Digital mapping of semantic features is essential for achieving interoperability between semantic communication and practical digital infrastructure. However, current research efforts predominantly concentrate on analog semantic…

Information Theory · Computer Science 2026-02-18 Jianqiao Chen , Nan Ma , Xiaodong Xu , Tingting Zhu , Huishi Song , Chen Dong , Wenkai Liu , Rui Meng , Ping Zhang

Semantic communication (SemCom), as an emerging paradigm focusing on meaning delivery, has recently been considered a promising solution for the inevitable crisis of scarce communication resources. This trend stimulates us to explore the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Le Xia , Yao Sun , Dusit Niyato , Daquan Feng , Lei Feng , Muhammad Ali Imran

Semantic communication has recently attracted significant interest from both industry and academia due to its potential to transform the existing data-focused communication architecture towards a more generally intelligent and goal-oriented…

Artificial Intelligence · Computer Science 2023-01-16 Yong Xiao , Zijian Sun , Guangming Shi , Dusit Niyato

Pioneering token-based works such as Chameleon and Emu3 have established a foundation for multimodal unification but face challenges of high training computational overhead and limited comprehension performance due to a lack of high-level…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Haokun Lin , Teng Wang , Yixiao Ge , Yuying Ge , Zhichao Lu , Ying Wei , Qingfu Zhang , Zhenan Sun , Ying Shan

Current unified multimodal models typically rely on discrete visual tokenizers to bridge the modality gap. However, discretization inevitably discards fine-grained semantic information, leading to suboptimal performance in visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Yaqi Zhao , Wang Lin , Zijian Zhang , Miles Yang , Jingyuan Chen , Wentao Zhang , Zhao Zhong , Liefeng Bo

Current open-domain neural semantics parsers show impressive performance. However, closer inspection of the symbolic meaning representations they produce reveals significant weaknesses: sometimes they tend to merely copy character sequences…

Computation and Language · Computer Science 2024-09-19 Xiao Zhang , Gosse Bouma , Johan Bos

Semantic communication (SC) is recognized as a promising approach for enabling reliable communication with minimal data transfer while maintaining seamless connectivity for a group of wireless users. Unlocking the advantages of SC for…

Information Theory · Computer Science 2024-06-24 Nitisha Singh , Christo Kurisummoottil Thomas , Walid Saad , Emilio Calvanese Strinati

Audio tokenizers are fundamental to unifying audio understanding and generation. Understanding requires high-level semantics, while generation demands semantic and acoustic details. Existing unified tokenizers jointly encode both in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-28 Zhisheng Zhang , Xiang Li , Yixuan Zhou , Jing Peng , Guoyang Zeng , Zhiyong Wu