English
Related papers

Related papers: Seq2Seq-SC: End-to-End Semantic Communication Syst…

200 papers

With the exponential surge in traffic data and the pressing need for ultra-low latency in emerging intelligence applications, it is envisioned that 6G networks will demand disruptive communication technologies to foster ubiquitous…

Information Theory · Computer Science 2024-08-12 Youlong Wu , Yuanmin Shi , Shuai Ma , Chunxiao Jiang , Wei Zhang , Khaled B. Letaief

Semantic communication, as a revolutionary communication architecture, is considered a promising novel communication paradigm. Unlike traditional symbol-based error-free communication systems, semantic-based visual communication systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

Semantic communication is considered the future of mobile communication, which aims to transmit data beyond Shannon's theorem of communications by transmitting the semantic meaning of the data rather than the bit-by-bit reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Maheshi Lokumarambage , Vishnu Gowrisetty , Hossein Rezaei , Thushan Sivalingam , Nandana Rajatheva , Anil Fernando

Semantic communication (SC) is recognized as a promising approach for enabling reliable communication with minimal data transfer while maintaining seamless connectivity for a group of wireless users. Unlocking the advantages of SC for…

Information Theory · Computer Science 2024-06-24 Nitisha Singh , Christo Kurisummoottil Thomas , Walid Saad , Emilio Calvanese Strinati

In this paper, we propose a robust semantic communication system for speech transmission, named Ross-S2T, by delivering the essential semantic information. Specifically, we consider the speech-to-text translation (S2TT) as the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Driven by the vision of "intelligent connection of everything" toward 6G, the collective intelligence of networked machines can be fully exploited to improve system efficiency by shifting the paradigm of wireless communication design from…

Signal Processing · Electrical Eng. & Systems 2023-07-03 Ping Zhang , Heng Yang , Zhiyong Feng , Yanpeng Cui , Jincheng Dai , Xiaoqi Qin , Jinglin Li , Qixun Zhang

Semantic communication has drawn substantial attention as a promising paradigm to achieve effective and intelligent communications. However, efficient image semantic communication encounters challenges with a lower testing compression ratio…

Information Theory · Computer Science 2024-05-10 Shuling Li , Yaping Sun , Jinbei Zhang , Kechao Cai , Shuguang Cui , Xiaodong Xu

We propose semantic communication over wireless channels for various modalities, e.g., text and images, in a task-oriented communications setup where the task is classification. We present two approaches based on memory and learning. Both…

Information Theory · Computer Science 2024-02-01 Emrecan Kutay , Aylin Yener

Existing communication systems are mainly built based on Shannon's information theory which deliberately ignores the semantic aspects of communication. The recent iteration of wireless technology, the so-called 5G and beyond, promises to…

Networking and Internet Architecture · Computer Science 2021-06-24 Guangming Shi , Yong Xiao , Yingyu Li , Xuemei Xie

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong

Copy mechanisms are employed in sequence to sequence models (seq2seq) to generate reproductions of words from the input to the output. These frameworks, operating at the lexical type level, fail to provide an explicit alignment that records…

Computation and Language · Computer Science 2020-10-30 Abhinav Singh , Patrick Xia , Guanghui Qin , Mahsa Yarmohammadi , Benjamin Van Durme

Semantic Edge Computing (SEC) and Semantic Communications (SemComs) have been proposed as viable approaches to achieve real-time edge-enabled intelligence in sixth-generation (6G) wireless networks. On one hand, SemCom leverages the…

Machine Learning · Computer Science 2025-07-24 Milin Zhang , Mohammad Abdi , Venkat R. Dasari , Francesco Restuccia

Generating semantic layout from scene graph is a crucial intermediate task connecting text to image. We present a conceptually simple, flexible and general framework using sequence to sequence (seq-to-seq) learning for this task. The…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Boren Li , Boyu Zhuang , Mingyang Li , Jian Gu

Language model pre-training has shown promising results in various downstream tasks. In this context, we introduce a cross-modal pre-trained language model, called Speech-Text BERT (ST-BERT), to tackle end-to-end spoken language…

Computation and Language · Computer Science 2021-04-13 Minjeong Kim , Gyuwan Kim , Sang-Woo Lee , Jung-Woo Ha

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Zhenzi Weng , Zhijin Qin , Huiqiang Xie , Xiaoming Tao , Khaled B. Letaief

Ubiquitous image transmission in emerging applications brings huge overheads to limited wireless resources. Since that text has the characteristic of conveying a large amount of information with very little data, the transmission of the…

Multimedia · Computer Science 2024-09-26 Xinfeng Wei , Haonan Tong , Nuocheng Yang , Changchuan Yin

We introduce a new semantic communication mechanism - SemanticRL, whose key idea is to preserve the semantic information instead of strictly securing the bit-level precision. Unlike previous methods that mainly concentrate on the network or…

Machine Learning · Computer Science 2022-04-04 Kun Lu , Rongpeng Li , Xianfu Chen , Zhifeng Zhao , Honggang Zhang

In this work, we perform an empirical comparison among the CTC, RNN-Transducer, and attention-based Seq2Seq models for end-to-end speech recognition. We show that, without any language model, Seq2Seq and RNN-Transducer models both…

Computation and Language · Computer Science 2017-07-25 Eric Battenberg , Jitong Chen , Rewon Child , Adam Coates , Yashesh Gaur , Yi Li , Hairong Liu , Sanjeev Satheesh , David Seetapun , Anuroop Sriram , Zhenyao Zhu

Semantic communication (SemCom) aims to convey the meaning behind a transmitted message by transmitting only semantically-relevant information. This semantic-centric design helps to minimize power usage, bandwidth consumption, and…

Signal Processing · Electrical Eng. & Systems 2023-04-26 Tilahun M. Getu , Georges Kaddoum , Mehdi Bennis

Recent works using artificial neural networks based on distributed word representation greatly boost performance on various natural language processing tasks, especially the answer selection problem. Nevertheless, most of the previous works…

Computation and Language · Computer Science 2018-03-19 Lingxun Meng , Yan Li