English
Related papers

Related papers: Mentor-Telemachus Bond: Transferring Knowledge in …

200 papers

Recently, the ever-increasing demand for bandwidth in multi-modal communication systems requires a paradigm shift. Powered by deep learning, semantic communications are applied to multi-modal scenarios to boost communication efficiency and…

Signal Processing · Electrical Eng. & Systems 2023-05-19 Yangshuo He , Guanding Yu , Yunlong Cai

Semantic communication in the 6G era has been deemed a promising communication paradigm to break through the bottleneck of traditional communications. However, its applications for the multi-user scenario, especially the broadcasting case,…

Machine Learning · Computer Science 2022-09-21 Han Hu , Xingwu Zhu , Fuhui Zhou , Wei Wu , Rose Qingyang Hu , Hongbo Zhu

Goal-oriented semantic communication will be a pillar of next-generation wireless networks. Despite significant recent efforts in this area, most prior works are focused on specific data types (e.g., image or audio), and they ignore the…

Networking and Internet Architecture · Computer Science 2023-01-18 Mohammad Karimzadeh Farshbafan , Walid Saad , Merouane Debbah

Contrastive learning (CL) has become a dominant paradigm for self-supervised hypergraph learning, enabling effective training without costly labels. However, node entities in real-world hypergraphs are often associated with rich textual…

Machine Learning · Computer Science 2026-05-26 Mengting Pan , Fan Li , Chen Chen , Xiaoyang Wang , Wenjie Zhang

Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier that evaluates the…

Cryptography and Security · Computer Science 2022-12-21 Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus , Aylin Yener

Semantic broadcast communications (Semantic BC) for image transmission have achieved significant performance gains for single-task scenarios. Nevertheless, extending these methods to multi-task scenarios remains challenging, as different…

Signal Processing · Electrical Eng. & Systems 2025-04-29 Zhilin Lu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Knowledge distillation typically involves transferring knowledge from a Large Language Model (LLM) to a Smaller Language Model (SLM). However, in tasks such as text matching, fine-tuned smaller models often yield more effective…

Computation and Language · Computer Science 2025-07-09 Mingzhe Li , Jing Xiang , Qishen Zhang , Kaiyang Wan , Xiuying Chen

Semantic Communication (SC) combined with Vehicular edge computing (VEC) provides an efficient edge task processing paradigm for Internet of Vehicles (IoV). Focusing on highway scenarios, this paper proposes a Tripartite Cooperative…

Machine Learning · Computer Science 2025-12-11 Jingbo Zhang , Maoxin Ji , Qiong Wu , Pingyi Fan , Kezhi Wang , Wen Chen

A key challenge for Emotion Recognition in Conversations (ERC) is to distinguish semantically similar emotions. Some works utilise Supervised Contrastive Learning (SCL) which uses categorical emotion labels as supervision signals and…

Computation and Language · Computer Science 2023-02-10 Kailai Yang , Tianlin Zhang , Hassan Alhuzali , Sophia Ananiadou

We introduce SemCSE, an unsupervised method for learning semantic embeddings of scientific texts. Building on recent advances in contrastive learning for text embeddings, our approach leverages LLM-generated summaries of scientific…

Computation and Language · Computer Science 2025-07-18 Marc Brinner , Sina Zarriess

As semantic communication (SemCom) attracts growing attention as a novel communication paradigm, ensuring the security of transmitted semantic information over open wireless channels has become a critical issue. However, traditional…

Information Theory · Computer Science 2025-11-25 Weixuan Chen , Qianqian Yang , Shuo Shao , Zhiguo Shi , Jiming Chen , Xuemin , Shen

Domain adaptation in natural language generation (NLG) remains challenging because of the high complexity of input semantics across domains and limited data of a target domain. This is particularly the case for dialogue systems, where we…

Computation and Language · Computer Science 2019-10-16 Bo-Hsiang Tseng , Paweł Budzianowski , Yen-Chen Wu , Milica Gašić

As one novel approach to realize end-to-end wireless image semantic transmission, deep learning-based joint source-channel coding (deep JSCC) method is emerging in both deep learning and communication communities. However, current deep JSCC…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jun Wang , Sixian Wang , Jincheng Dai , Zhongwei Si , Dekun Zhou , Kai Niu

Contrastive learning has been extensively studied in sentence embedding learning, which assumes that the embeddings of different views of the same sentence are closer. The constraint brought by this assumption is weak, and a good sentence…

Computation and Language · Computer Science 2022-10-17 Xing Wu , Chaochen Gao , Zijia Lin , Jizhong Han , Zhongyuan Wang , Songlin Hu

Analogical reasoning is a hallmark of human intelligence, enabling us to solve new problems by transferring knowledge from one situation to another. Yet, developing artificial intelligence systems capable of robust human-like analogical…

Machine Learning · Computer Science 2026-04-09 Philipp Hellwig , Willem Zuidema , Claire E. Stevenson , Martha Lewis

Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In…

Signal Processing · Electrical Eng. & Systems 2023-09-06 S. Barbarossa , D. Comminiello , E. Grassucci , F. Pezone , S. Sardellitti , P. Di Lorenzo

In cross-lingual language understanding, machine translation is often utilized to enhance the transferability of models across languages, either by translating the training data from the source language to the target, or from the target to…

Computation and Language · Computer Science 2023-11-14 Tingfeng Cao , Chengyu Wang , Chuanqi Tan , Jun Huang , Jinhui Zhu

In this paper, we propose a novel joint source-channel coding (JSCC) approach for channel-adaptive digital semantic communications. In semantic communication systems with digital modulation and demodulation, robust design of JSCC encoder…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Joohyuk Park , Yongjeong Oh , Seonjung Kim , Yo-Seb Jeon

Semantic communication has emerged as a promising paradigm for next-generation networks, yet several fundamental challenges remain unresolved. Building on the probabilistic model of semantic communication and leveraging the concept of…

Information Theory · Computer Science 2026-02-27 Javad Gholipour , Rafael F. Schaefer , Gerhard P. Fettweis

Capturing the composition patterns of relations is a vital task in knowledge graph completion. It also serves as a fundamental step towards multi-hop reasoning over learned knowledge. Previously, several rotation-based translational methods…

Artificial Intelligence · Computer Science 2022-01-12 Haonan Lu , Hailin Hu , Xiaodong Lin