English
Related papers

Related papers: A Universal Knowledge Embedded Contrastive Learnin…

200 papers

Contrastive learning (CL) aims to preserve relational structure between samples by learning representations that reflect a similarity graph. Yet, the geometry of the resulting embeddings remains poorly understood. Here we show that weighted…

Machine Learning · Computer Science 2026-05-15 Raphael Vock , Edouard Duchesnay , Benoit Dufumier

Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Information between different augmented views of the same instance.…

Information Retrieval · Computer Science 2024-01-01 Huiyuan Chen , Vivian Lai , Hongye Jin , Zhimeng Jiang , Mahashweta Das , Xia Hu

Deep clustering has shown its promising capability in joint representation learning and clustering via deep neural networks. Despite the significant progress, the existing deep clustering works mostly utilize some distribution-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Yuankun Xu , Dong Huang , Chang-Dong Wang , Jian-Huang Lai

In this paper, we introduce a new image representation based on a multilayer kernel machine. Unlike traditional kernel methods where data representation is decoupled from the prediction task, we learn how to shape the kernel with…

Machine Learning · Statistics 2016-10-26 Julien Mairal

Contrastive learning has achieved remarkable success on various high-level tasks, but there are fewer contrastive learning-based methods proposed for low-level tasks. It is challenging to adopt vanilla contrastive learning technologies…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Gang Wu , Junjun Jiang , Xianming Liu

Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings…

Machine Learning · Computer Science 2023-02-14 Peng Peng , Hanrong Zhang , Mengxuan Li , Gongzhuang Peng , Hongwei Wang , Weiming Shen

Hyperspectral image (HSI) classification is one of the most active research topics and has achieved promising results boosted by the recent development of deep learning. However, most state-of-the-art approaches tend to perform poorly when…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Ying Qu , Razieh Kaviani Baghbaderani , Wei Li , Lianru Gao , Hairong Qi

Skin image datasets often suffer from imbalanced data distribution, exacerbating the difficulty of computer-aided skin disease diagnosis. Some recent works exploit supervised contrastive learning (SCL) for this long-tailed challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Yilan Zhang , Jianqi Chen , Ke Wang , Fengying Xie

Heterogeneous graph neural networks (HGNNs) have demonstrated their superiority in exploiting auxiliary information for recommendation tasks. However, graphs constructed using meta-paths in HGNNs are usually too dense and contain a large…

Information Retrieval · Computer Science 2025-06-02 Lei Sang , Yu Wang , Yiwen Zhang

Pathology is essential for cancer diagnosis, with multiple instance learning (MIL) widely used for whole slide image (WSI) analysis. WSIs exhibit a natural hierarchy -- patches, regions, and slides -- with distinct semantic associations.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Peixiang Huang , Yanyan Huang , Weiqin Zhao , Junjun He , Lequan Yu

Accurate hyperspectral image (HSI) interpretation is critical for providing valuable insights into various earth observation-related applications such as urban planning, precision agriculture, and environmental monitoring. However, existing…

Hyperspectral images are of crucial importance in order to better understand features of different materials. To reach this goal, they leverage on a high number of spectral bands. However, this interesting characteristic is often paid by a…

Image and Video Processing · Electrical Eng. & Systems 2020-06-01 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng , Tai-Xiang Jiang , Gemine Vivone , Jocelyn Chanussot

Accurate segmentation and classification of nuclei in histology images is critical but challenging due to nuclei heterogeneity, staining variations, and tissue complexity. Existing methods often struggle with limited dataset variability,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Wenhua Zhang , Sen Yang , Meiwei Luo , Chuan He , Yuchen Li , Jun Zhang , Xiyue Wang , Fang Wang

Incorporating heterogeneous representations from different architectures has facilitated various vision tasks, e.g., some hybrid networks combine transformers and convolutions. However, complementarity between such heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Zhong-Yu Li , Bo-Wen Yin , Yongxiang Liu , Li Liu , Ming-Ming Cheng

Although self-/un-supervised methods have led to rapid progress in visual representation learning, these methods generally treat objects and scenes using the same lens. In this paper, we focus on learning representations for objects and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Songwei Ge , Shlok Mishra , Simon Kornblith , Chun-Liang Li , David Jacobs

Learning discriminative representations is a central goal of supervised deep learning. While cross-entropy (CE) remains the dominant objective for classification, it does not explicitly enforce desirable geometric properties in the…

Machine Learning · Computer Science 2026-04-13 Matheus Vinícius Todescato , Joel Luís Carbonera

Hyperspectral image (HSI) clustering has been a fundamental but challenging task with zero training labels. Currently, some deep graph clustering methods have been successfully explored for HSI due to their outstanding performance in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Yao Ding , Weijie Kang , Aitao Yang , Zhili Zhang , Junyang Zhao , Jie Feng , Danfeng Hong , Qinhe Zheng

As a fundamental visual attribute, image complexity significantly influences both human perception and the performance of computer vision models. However, accurately assessing and quantifying image complexity remains a challenging task. (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shipeng Liu , Liang Zhao , Dengfeng Chen

Semi-supervised learning has substantially advanced medical image segmentation since it alleviates the heavy burden of acquiring the costly expert-examined annotations. Especially, the consistency-based approaches have attracted more…

Image and Video Processing · Electrical Eng. & Systems 2022-03-16 Zhe Xu , Yixin Wang , Donghuan Lu , Lequan Yu , Jiangpeng Yan , Jie Luo , Kai Ma , Yefeng Zheng , Raymond Kai-yu Tong

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

Machine Learning · Computer Science 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen