English
Related papers

Related papers: Features-over-the-Air: Contrastive Learning Enable…

200 papers

Despite the success of contrastive learning (CL) in vision and language, its theoretical foundations and mechanisms for building representations remain poorly understood. In this work, we build connections between noise contrastive…

Machine Learning · Computer Science 2025-02-28 Zihao Chen , Chi-Heng Lin , Ran Liu , Jingyun Xiao , Eva L Dyer

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

This study explores the benefits of integrating the novel clustered federated learning (CFL) approach with non-orthogonal multiple access (NOMA) under non-independent and identically distributed (non-IID) datasets, where multiple devices…

Networking and Internet Architecture · Computer Science 2024-03-06 Yushen Lin , Kaidi Wang , Zhiguo Ding

Non-orthogonal multiple access (NOMA) is a promising radio access technique for next-generation wireless networks. In this article, we investigate the NOMA-based cooperative relay network. We begin with an introduction of the existing…

Information Theory · Computer Science 2018-01-16 Dehuan Wan , Miaowen Wen , Fei Ji , Hua Yu , Fangjiong Chen

Composed Image Retrieval (CIR) seeks to find a target image using a multi-modal query, which combines an image with modification text to pinpoint the target. While recent CIR methods have shown promise, they mainly focus on exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Peng Gao , Yujian Lee , Zailong Chen , Hui zhang , Xubo Liu , Yiyang Hu , Guquang Jing

In the realm of image processing and computer vision (CV), machine learning (ML) architectures are widely applied. Convolutional neural networks (CNNs) solve a wide range of image processing issues and can solve image compression problem.…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Sonain Jamil , Md. Jalil Piran , MuhibUrRahman

Exploiting the idle computation resources of mobile devices in mobile edge computing (MEC) system can achieve both channel diversity and computing diversity as mobile devices can offload their computation tasks to nearby mobile devices in…

Information Theory · Computer Science 2020-01-01 Yuwen Huang , Yuan Liu , Fangjiong Chen

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

This paper is concerned with contrastive learning (CL) for low-level image restoration and enhancement tasks. We propose a new label-efficient learning paradigm based on residuals, residual contrastive learning (RCL), and derive an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nanqing Dong , Matteo Maggioni , Yongxin Yang , Eduardo Pérez-Pellitero , Ales Leonardis , Steven McDonagh

Text-image cross-modal retrieval is a challenging task in the field of language and vision. Most previous approaches independently embed images and sentences into a joint embedding space and compare their similarities. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Zihao Wang , Xihui Liu , Hongsheng Li , Lu Sheng , Junjie Yan , Xiaogang Wang , Jing Shao

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

Contrastive learning (CL) has been successful as a powerful representation learning method. In this work we propose CLIM: Contrastive Learning with mutual Information Maximization, to explore the potential of CL on cross-domain sentiment…

Computation and Language · Computer Science 2020-11-13 Tian Li , Xiang Chen , Shanghang Zhang , Zhen Dong , Kurt Keutzer

Over-the-air federated learning (OTA-FL) unifies communication and model aggregation by leveraging the inherent superposition property of the wireless medium. This strategy can enable scalable and bandwidth-efficient learning via…

Information Theory · Computer Science 2024-12-05 Jiayu Mao , Aylin Yener

This paper addresses the challenges of complex dependencies and diverse anomaly patterns in cloud service environments by proposing a dependency modeling and anomaly detection method that integrates contrastive learning. The method…

Machine Learning · Computer Science 2025-10-16 Yue Xing , Yingnan Deng , Heyao Liu , Ming Wang , Yun Zi , Xiaoxuan Sun

Cognitive radio (CR) and non-orthogonal multiple access (NOMA) have been deemed two promising technologies due to their potential to achieve high spectral efficiency and massive connectivity. This paper studies a multiple-input…

Signal Processing · Electrical Eng. & Systems 2018-02-28 Fuhui Zhou , Zheng Chu , Haijian Sun , Rose Qingyang Hu , Lajos Hanzo

Customizable keyword spotting (KWS) in continuous speech has attracted increasing attention due to its real-world application potential. While contrastive learning (CL) has been widely used to extract keyword representations, previous CL…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-15 Yu Xi , Baochen Yang , Hao Li , Jiaqi Guo , Kai Yu

A generalized downlink multi-antenna non-orthogonal multiple access (NOMA) transmission framework is proposed with the novel concept of cluster-free successive interference cancellation (SIC). In contrast to conventional NOMA approaches,…

Information Theory · Computer Science 2022-08-02 Xiaoxia Xu , Yuanwei Liu , Xidong Mu , Qimei Chen , Zhiguo Ding

The image-text retrieval task aims to retrieve relevant information from a given image or text. The main challenge is to unify multimodal representation and distinguish fine-grained differences across modalities, thereby finding similar…

Multimedia · Computer Science 2024-05-20 Ziyu Gong , Chengcheng Mai , Yihua Huang

Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the similarity-based…

Machine Learning · Computer Science 2023-03-09 Zehua Zhang , Shilin Sun , Guixiang Ma , Caiming Zhong