English
Related papers

Related papers: Disentangling Learnable and Memorizable Data via C…

200 papers

Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often…

Machine Learning · Computer Science 2025-05-29 Zi-Hao Zhou , Jun-Jie Wang , Tong Wei , Min-Ling Zhang

With the emergence of diverse and massive data in the upcoming sixth-generation (6G) networks, the task-agnostic semantic communication system is regarded to provide robust intelligent services. In this paper, we propose a task-agnostic…

Information Theory · Computer Science 2025-09-16 Shiyao Jiang , Jian Jiao , Xingjian Zhang , Ye Wang , Dusit Niyato , Qinyu Zhang

Semantic communication, enabled by deep joint source-channel coding (DeepJSCC), is widely expected to inherit the vulnerability of deep learning to adversarial perturbations. This paper challenges this prevailing belief and reveals a…

Information Theory · Computer Science 2026-03-26 Runxin Zhang , Yulin Shao , Hongyu An , Zhijin Qin , Kaibin Huang

This paper explores opportunities and challenges of task (goal)-oriented and semantic communications for next-generation (NextG) communication networks through the integration of multi-task learning. This approach employs deep neural…

Networking and Internet Architecture · Computer Science 2024-01-04 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Semantic communication has emerged as a promising approach for improving efficient transmission in the next generation of wireless networks. Inspired by the success of semantic communication in different areas, we aim to provide a new…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Jiming Chen

Semantic communications mark a paradigm shift from bit-accurate transmission toward meaning-centric communication, essential as wireless systems approach theoretical capacity limits. The emergence of generative AI has catalyzed generative…

Signal Processing · Electrical Eng. & Systems 2026-05-08 Hai-Long Qin , Jincheng Dai , Guo Lu , Shuo Shao , Sixian Wang , Tongda Xu , Wenjun Zhang , Ping Zhang , Khaled B. Letaief

Pursuing realistic results according to human visual perception is the central concern in the image transformation tasks. Perceptual learning approaches like perceptual loss are empirically powerful for such tasks but they usually rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Kangfu Mei , Yao Lu , Qiaosi Yi , Haoyu Wu , Juncheng Li , Rui Huang

Clustering continues to be a significant and challenging task. Recent studies have demonstrated impressive results by applying clustering to feature representations acquired through self-supervised learning, particularly on small datasets.…

Machine Learning · Computer Science 2023-07-19 Fei Ding , Dan Zhang , Yin Yang , Venkat Krovi , Feng Luo

Most dialogue systems in real world rely on predefined intents and answers for QA service, so discovering potential intents from large corpus previously is really important for building such dialogue services. Considering that most…

Machine Learning · Computer Science 2022-01-20 Feng Wei , Zhenbo Chen , Zhenghong Hao , Fengxin Yang , Hua Wei , Bing Han , Sheng Guo

Learning sentence embeddings from dialogues has drawn increasing attention due to its low annotation cost and high domain adaptability. Conventional approaches employ the siamese-network for this task, which obtains the sentence embeddings…

Computation and Language · Computer Science 2021-09-28 Che Liu , Rui Wang , Jinghua Liu , Jian Sun , Fei Huang , Luo Si

Semantic communication has emerged as a promising technology for enhancing communication efficiency. However, most existing research emphasizes single-task reconstruction, neglecting model adaptability and generalization across multi-task…

Information Theory · Computer Science 2025-04-01 Weiwen Yuan , Jinke Ren , Chongjie Wang , Ruichen Zhang , Jun Wei , Dong In Kim , Shuguang Cui

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

Machine Learning · Computer Science 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

A critical challenge faced by supervised word sense disambiguation (WSD) is the lack of large annotated datasets with sufficient coverage of words in their diversity of senses. This inspired recent research on few-shot WSD using…

Computation and Language · Computer Science 2021-06-08 Yingjun Du , Nithin Holla , Xiantong Zhen , Cees G. M. Snoek , Ekaterina Shutova

A great challenge in speaker representation learning using deep models is to design learning objectives that can enhance the discrimination of unseen speakers under unseen domains. This work proposes a supervised contrastive learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-18 Zhe Li , Man-Wai Mak

This paper shows that a popular approach to the supervised embedding of documents for classification, namely, contrastive Word Mover's Embedding, can be significantly enhanced by adding interpretability. This interpretability is achieved by…

Computation and Language · Computer Science 2021-11-02 Ruijie Jiang , Julia Gouvea , Eric Miller , David Hammer , Shuchin Aeron

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

Semantic communication and edge-cloud collaborative intelligence are increasingly recognized as foundational enablers for next-generation intelligent services operating under stringent bandwidth, latency, and resource constraints. By…

Networking and Internet Architecture · Computer Science 2025-12-23 Murdadha Nasif , Ahmed Refaey Hussein

Contrastive speaker embedding assumes that the contrast between the positive and negative pairs of speech segments is attributed to speaker identity only. However, this assumption is incorrect because speech signals contain not only speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-26 Youzhi Tu , Man-Wai Mak , Jen-Tzung Chien

In this letter, we design a federated contrastive learning (FedCL) framework aimed at supporting personalized semantic communication. Our FedCL enables collaborative training of local semantic encoders across multiple clients and a global…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Yining Wang , Wanli Ni , Wenqiang Yi , Xiaodong Xu , Ping Zhang , Arumugam Nallanathan
‹ Prev 1 3 4 5 6 7 10 Next ›