English
Related papers

Related papers: Evolving Token Communication with Parametric Memor…

200 papers

Generative foundation AI models have recently shown great success in synthesizing natural signals with high perceptual quality using only textual prompts and conditioning signals to guide the generation process. This enables semantic…

Information Theory · Computer Science 2024-08-20 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Chuan Heng Foh , Pei Xiao , Mehdi Bennis

Semantic communication is expected to be one of the cores of next-generation AI-based communications. One of the possibilities offered by semantic communication is the capability to regenerate, at the destination side, images or videos…

Artificial Intelligence · Computer Science 2026-05-18 Eleonora Grassucci , Sergio Barbarossa , Danilo Comminiello

Task-Oriented Semantic Communication (TOSC) has been considered as a new communication paradigm to serve various samrt devices that depend on Artificial Intelligence (AI) tasks in future wireless networks. The existing TOSC frameworks rely…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Yuzhou Fu , Wenchi Cheng , Wei Zhang , Wei Zhang

Semantic communications conveys task-relevant meaning rather than focusing solely on message reconstruction, improving bandwidth efficiency and robustness for next-generation wireless systems. However, learned semantic representations can…

Networking and Internet Architecture · Computer Science 2026-01-01 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Sensing and communication are fundamental enablers of next-generation networks. While communication technologies have advanced significantly, sensing remains limited to conventional parameter estimation and is far from fully explored.…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Xiaoqi Zhang , J. Andrew Zhang , Chang Liu , Weijie Yuan , Geoffrey Ye Li , Moeness G. Amin

In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC). TokCom is a new paradigm, motivated by the recent success…

Multimedia · Computer Science 2025-07-18 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Rahim Tafazolli , Mehdi Bennis , Dusit Niyato

The increasing use of token-based representations in language-driven applications has motivated wireless token communication, where tokens are treated as fundamental units for transmission. However, conventional communication systems…

Signal Processing · Electrical Eng. & Systems 2026-05-05 Junyong Shin , Joohyuk Park , Yongjeong Oh , Jihong Park , Jinho Choi , Yo-Seb Jeon

Semantic communication is a promising technology to improve communication efficiency by transmitting only the semantic information of the source data. However, traditional semantic communication methods primarily focus on data…

Sound · Computer Science 2024-10-07 Jiahao Zheng , Jinke Ren , Peng Xu , Zhihao Yuan , Jie Xu , Fangxin Wang , Gui Gui , Shuguang Cui

Satellite communications face severe bottlenecks in supporting high-fidelity synchronized audiovisual services, as conventional schemes struggle with cross-modal coherence under fluctuating channel conditions, limited bandwidth, and long…

Image and Video Processing · Electrical Eng. & Systems 2026-03-12 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Xiao Li , Shi Jin

Semantic communication represents a promising roadmap toward achieving end-to-end communication with reduced communication overhead and an enhanced user experience. The integration of semantic concepts with wireless communications presents…

Information Theory · Computer Science 2023-07-04 Hossein Rezaei , Thushan Sivalingam , Nandana Rajatheva

Semantic communications, aiming at ensuring the successful delivery of the meaning of information, are expected to be one of the potential techniques for the next generation communications. However, the knowledge forming and synchronizing…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Yuan Zheng , Fengyu Wang , Wenjun Xu , Miao Pan , Ping Zhang

We propose a novel neural waveform compression method to catalyze emerging speech semantic communications. By introducing nonlinear transform and variational modeling, we effectively capture the dependencies within speech frames and…

Sound · Computer Science 2022-12-14 Shengshi Yao , Zixuan Xiao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

Transformers achieve unrivalled performance in modelling language, but remain inefficient in terms of memory and time complexity. A possible remedy is to reduce the sequence length in the intermediate layers by pooling fixed-length segments…

Computation and Language · Computer Science 2023-10-25 Piotr Nawrot , Jan Chorowski , Adrian Łańcucki , Edoardo M. Ponti

Dialogue generation models face the challenge of producing generic and repetitive responses. Unlike previous augmentation methods that mostly focus on token manipulation and ignore the essential variety within a single sample using hard…

Computation and Language · Computer Science 2021-03-03 Yu Cao , Liang Ding , Zhiliang Tian , Meng Fang

The use of a learnable codebook provides an efficient way for semantic communications to map vector-based high-dimensional semantic features onto discrete symbol representations required in digital communication systems. In this paper, the…

Information Theory · Computer Science 2025-10-16 Lingyi Wang , Rashed Shelim , Walid Saad , Naren Ramakrishnan

With the rapid growth of the Internet of Things (IoT), integrating artificial intelligence (AI) on extremely weak embedded devices has garnered significant attention, enabling improved real-time performance and enhanced data privacy.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Jiaming Huang , Yi Gao , Fuchang Pan , Renjie Li , Wei Dong

Generative driving world models rely on compact latent state representations that must be efficiently transmitted and synchronized across distributed compute and connected vehicles. We study network-efficient streaming of a discrete world…

Robotics · Computer Science 2026-05-12 Shatadal Mishra , Ahmadreza Moradipari , Nejib Ammar

We introduce a memory- and compute-efficient method for low-communication distributed training. Existing methods reduce communication by performing multiple local updates between infrequent global synchronizations. We demonstrate that their…

Machine Learning · Computer Science 2025-09-29 Anastasiia Filippova , Angelos Katharopoulos , David Grangier , Ronan Collobert

We introduce a text-to-speech(TTS) framework based on a neural transducer. We use discretized semantic tokens acquired from wav2vec2.0 embeddings, which makes it easy to adopt a neural transducer for the TTS framework enjoying its monotonic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-09 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Dongjune Lee , Nam Soo Kim