English
Related papers

Related papers: Semantics Alignment via Split Learning for Resilie…

200 papers

Large Language Models (LLMs) increasingly incorporate multilingual capabilities, fueling the demand to transfer them into target language-specific models. However, most approaches, which blend the source model's embedding by replacing the…

Computation and Language · Computer Science 2025-05-23 Seungyoon Lee , Seongtae Hong , Hyeonseok Moon , Heuiseok Lim

With the development of deep learning (DL), natural language processing (NLP) makes it possible for us to analyze and understand a large amount of language texts. Accordingly, we can achieve a semantic communication in terms of joint…

Computation and Language · Computer Science 2021-11-30 Qingyang Zhou , Rongpeng Li , Zhifeng Zhao , Chenghui Peng , Honggang Zhang

We consider a semantic communication system for speech signals, named DeepSC-S. Motivated by the breakthroughs in deep learning (DL), we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Semantic parsing aims to map natural language utterances onto machine interpretable meaning representations, aka programs whose execution against a real-world environment produces a denotation. Weakly-supervised semantic parsers are trained…

Computation and Language · Computer Science 2019-09-11 Bailin Wang , Ivan Titov , Mirella Lapata

Deep learning (DL) enabled semantic communications leverage DL to train encoders and decoders (codecs) to extract and recover semantic information. However, most semantic training datasets contain personal private information. Such concerns…

Cryptography and Security · Computer Science 2025-02-28 Weiqi Wang , Zhiyi Tian , Chenhan Zhang , Shui Yu

Sign Language (SL), as the mother tongue of the deaf community, is a special visual language that most hearing people cannot understand. In recent years, neural Sign Language Translation (SLT), as a possible way for bridging communication…

Computation and Language · Computer Science 2022-11-02 Jiangbin Zheng , Siyuan Li , Cheng Tan , Chong Wu , Yidong Chen , Stan Z. Li

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

In this paper, we propose a class of high-efficiency deep joint source-channel coding methods that can closely adapt to the source distribution under the nonlinear transform, it can be collected under the name nonlinear transform…

Information Theory · Computer Science 2022-11-03 Jincheng Dai , Sixian Wang , Kailin Tan , Zhongwei Si , Xiaoqi Qin , Kai Niu , Ping Zhang

Sequence labeling (SL) is a fundamental research problem encompassing a variety of tasks, e.g., part-of-speech (POS) tagging, named entity recognition (NER), text chunking, etc. Though prevalent and effective in many downstream applications…

Computation and Language · Computer Science 2020-11-16 Zhiyong He , Zanbo Wang , Wei Wei , Shanshan Feng , Xianling Mao , Sheng Jiang

Semi-supervised semantic segmentation relieves the reliance on large-scale labeled data by leveraging unlabeled data. Recent semi-supervised semantic segmentation approaches mainly resort to pseudo-labeling methods to exploit unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Hui Xiao , Yuting Hong , Li Dong , Diqun Yan , Jiayan Zhuang , Junjie Xiong , Dongtai Liang , Chengbin Peng

Although there is significant progress in supervised semantic segmentation, it remains challenging to deploy the segmentation models to unseen domains due to domain biases. Domain adaptation can help in this regard by transferring knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Binhui Xie , Mingjia Li , Shuang Li

We introduce semantic form mid-tuning, an approach for transferring semantic knowledge from semantic meaning representations into transformer-based language encoders. In mid-tuning, we learn to align the text of general sentences -- not…

Computation and Language · Computer Science 2021-10-15 Mohammad Umair , Francis Ferraro

Semantic communication (SemCom) demonstrates strong superiority over conventional bit-level accurate transmission, by only attempting to recover the essential semantic information of data. In this paper, in order to tackle the…

Information Theory · Computer Science 2023-10-02 Siyu Tong , Xiaoxue Yu , Rongpeng Li , Kun Lu , Zhifeng Zhao , Honggang Zhang

Split Federated Learning (SFL) is a distributed machine learning framework which strategically divides the learning process between a server and clients and collaboratively trains a shared model by aggregating local models updated based on…

Machine Learning · Computer Science 2025-12-29 Jiarong Yang , Yuan Liu

Federated learning (FL) is a key enabler for efficient communication and computing, leveraging devices' distributed computing capabilities. However, applying FL in practice is challenging due to the local devices' heterogeneous energy,…

Machine Learning · Computer Science 2022-12-23 Won Joon Yun , Yunseok Kwak , Hankyul Baek , Soyi Jung , Mingyue Ji , Mehdi Bennis , Jihong Park , Joongheon Kim

Sign Language Translation (SLT) is a promising technology to bridge the communication gap between the deaf and the hearing people. Recently, researchers have adopted Neural Machine Translation (NMT) methods, which usually require…

Computation and Language · Computer Science 2023-03-22 Biao Fu , Peigen Ye , Liang Zhang , Pei Yu , Cong Hu , Yidong Chen , Xiaodong Shi

Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier that evaluates the…

Cryptography and Security · Computer Science 2022-12-21 Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus , Aylin Yener

Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and susceptibility to noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weilong Chen , Wenxuan Xu , Haoran Chen , Xinran Zhang , Zhijin Qin , Yanru Zhang , Zhu Han

Addressing the challenges of deploying large language models in wireless communication networks, this paper combines low-rank adaptation technology (LoRA) with the splitfed learning framework to propose the federated split learning for…

Networking and Internet Architecture · Computer Science 2024-07-15 Kai Zhao , Zhaohui Yang , Chongwen Huang , Xiaoming Chen , Zhaoyang Zhang

Semantic communication has gained significant attention from researchers as a promising technique to replace conventional communication in the next generation of communication systems, primarily due to its ability to reduce communication…

Information Theory · Computer Science 2025-02-07 Loc X. Nguyen , Ye Lin Tun , Yan Kyaw Tun , Minh N. H. Nguyen , Chaoning Zhang , Zhu Han , Choong Seon Hong