English
Related papers

Related papers: Contrastive Learning based Semantic Communication …

200 papers

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

We explore the value of weak labels in learning transferable representations for medical images. Compared to hand-labeled datasets, weak or inexact labels can be acquired in large quantities at significantly lower cost and can provide…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Boon Peng Yap , Beng Koon Ng

Empowered by deep learning, semantic communication marks a paradigm shift from transmitting raw data to conveying task-relevant meaning, enabling more efficient and intelligent wireless systems. In this study, we explore a deep…

Information Theory · Computer Science 2026-01-28 Chenyang Wang , Roger Olsson , Stefan Forsström , Qing He

Reliable image transmission over wireless channels is particularly challenging at extremely low transmission rates, where conventional compression and channel coding schemes fail to preserve adequate visual quality. To address this issue,…

Information Theory · Computer Science 2025-10-27 Shengkang Chen , Tong Wu , Zhiyong Chen , Feng Yang , Meixia Tao , Wenjun Zhang

The image-text retrieval task aims to retrieve relevant information from a given image or text. The main challenge is to unify multimodal representation and distinguish fine-grained differences across modalities, thereby finding similar…

Multimedia · Computer Science 2024-05-20 Ziyu Gong , Chengcheng Mai , Yihua Huang

As a new communication paradigm, semantic communication has received widespread attention in communication fields. However, since the decoding of semantic signals relies on contextual knowledge, misalignment between the starting position of…

Signal Processing · Electrical Eng. & Systems 2023-12-19 Xiaoyi Liu , Haotai Liang , Chen Dong , Xiaodong Xu

Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted to multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zhongchen Ma , Lisha Li , Qirong Mao , Songcan Chen

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

To improve the detection accuracy and generalization of steganalysis, this paper proposes the Steganalysis Contrastive Framework (SCF) based on contrastive learning. The SCF improves the feature representation of steganalysis by maximizing…

Artificial Intelligence · Computer Science 2021-03-02 Yanzhen Ren , Yiwen Liu , Lina Wang

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

Recent advances in self-supervised contrastive learning yield good image-level representation, which favors classification tasks but usually neglects pixel-level detailed information, leading to unsatisfactory transfer performance to dense…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Feng Wang , Huiyu Wang , Chen Wei , Alan Yuille , Wei Shen

Contrastive learning (CL) can learn generalizable feature representations and achieve the state-of-the-art performance of downstream tasks by finetuning a linear classifier on top of it. However, as adversarial robustness becomes vital in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Lijie Fan , Sijia Liu , Pin-Yu Chen , Gaoyuan Zhang , Chuang Gan

Self-supervised representation learning based on Contrastive Learning (CL) has been the subject of much attention in recent years. This is due to the excellent results obtained on a variety of subsequent tasks (in particular…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Ahmed Ben Saad , Kristina Prokopetc , Josselin Kherroubi , Axel Davy , Adrien Courtois , Gabriele Facciolo

In Magnetic Resonance Imaging (MRI), image acquisitions are often undersampled in the measurement domain to accelerate the scanning process, at the expense of image quality. However, image quality is a crucial factor that influences the…

Image and Video Processing · Electrical Eng. & Systems 2024-05-31 Mevan Ekanayake , Zhifeng Chen , Mehrtash Harandi , Gary Egan , Zhaolin Chen

While state-of-the-art contrastive Self-Supervised Learning (SSL) models produce results competitive with their supervised counterparts, they lack the ability to infer latent variables. In contrast, prescribed latent variable (LV) models…

Machine Learning · Computer Science 2021-12-01 Jason Ramapuram , Dan Busbridge , Xavier Suau , Russ Webb

Context-aware neural machine translation (NMT) incorporates contextual information of surrounding texts, that can improve the translation quality of document-level machine translation. Many existing works on context-aware NMT have focused…

Computation and Language · Computer Science 2021-09-14 Yongkeun Hwang , Hyungu Yun , Kyomin Jung

We propose a new algorithm for color transfer between images that have perceptually similar semantic structures. We aim to achieve a more accurate color transfer that leverages semantically-meaningful dense correspondence between images. To…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Mingming He , Jing Liao , Dongdong Chen , Lu Yuan , Pedro V. Sander

Contrastive Learning (CL) has been successfully applied to classification and other downstream tasks related to concrete concepts, such as objects contained in the ImageNet dataset. No attempts seem to have been made so far in applying this…

Machine Learning · Computer Science 2025-05-30 Daniel N. Nissani

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Byungseok Roh , Wuhyun Shin , Ildoo Kim , Sungwoong Kim