English
Related papers

Related papers: Contrastive Quantization with Code Memory for Unsu…

200 papers

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

Machine Learning · Statistics 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

Reliable detection of anomalies is crucial when deploying machine learning models in practice, but remains challenging due to the lack of labeled data. To tackle this challenge, contrastive learning approaches are becoming increasingly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Puck de Haan , Sindy Löwe

Medical image registration is a fundamental task in medical image analysis, enabling the alignment of images from different modalities or time points. However, intensity inconsistencies and nonlinear tissue deformations pose significant…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Eytan Kats , Christoph Grossbroehmer , Ziad Al-Haj Hemidi , Fenja Falta , Wiebke Heyer , Mattias P. Heinrich

Learning semantic-rich representations from raw unlabeled time series data is critical for downstream tasks such as classification and forecasting. Contrastive learning has recently shown its promising representation learning capability in…

Machine Learning · Computer Science 2023-03-31 Qianwen Meng , Hangwei Qian , Yong Liu , Lizhen Cui , Yonghui Xu , Zhiqi Shen

Understanding mathematical questions effectively is a crucial task, which can benefit many applications, such as difficulty estimation. Researchers have drawn much attention to designing pre-training models for question representations due…

Computation and Language · Computer Science 2023-01-19 Yuting Ning , Zhenya Huang , Xin Lin , Enhong Chen , Shiwei Tong , Zheng Gong , Shijin Wang

State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data.…

Computation and Language · Computer Science 2024-05-13 Bowen Xing , Ivor W. Tsang

Unsupervised person re-identification (re-ID) has attracted increasing research interests because of its scalability and possibility for real-world applications. State-of-the-art unsupervised re-ID methods usually follow a clustering-based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Tianyang Liu , Yutian Lin , Bo Du

The segmentation of endoscopic images plays a vital role in computer-aided diagnosis and treatment. The advancements in deep learning have led to the employment of numerous models for endoscopic tumor segmentation, achieving promising…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Lingcong Cai , Yun Li , Xiaomao Fan , Kaixuan Song , Ruxin Wang , Wenbin Lei

In this paper, we propose EqCo (Equivalent Rules for Contrastive Learning) to make self-supervised learning irrelevant to the number of negative samples in the contrastive learning framework. Inspired by the InfoMax principle, we point that…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Benjin Zhu , Junqiang Huang , Zeming Li , Xiangyu Zhang , Jian Sun

Accurate and efficient prediction of the molecular properties of drugs is one of the fundamental problems in drug research and development. Recent advancements in representation learning have been shown to greatly improve the performance of…

Biomolecules · Quantitative Biology 2022-06-17 Hui Liu , Yibiao Huang , Xuejun Liu , Lei Deng

Heterogeneous graph neural networks (HGNNs) as an emerging technique have shown superior capacity of dealing with heterogeneous information network (HIN). However, most HGNNs follow a semi-supervised learning manner, which notably limits…

Machine Learning · Computer Science 2021-05-20 Xiao Wang , Nian Liu , Hui Han , Chuan Shi

We propose contrastive coding to learn shared, dense image representations, referred to as CoMIRs (Contrastive Multimodal Image Representations). CoMIRs enable the registration of multimodal images where existing registration methods often…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Nicolas Pielawski , Elisabeth Wetzer , Johan Öfverstedt , Jiahao Lu , Carolina Wählby , Joakim Lindblad , Nataša Sladoje

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask. To increase the ability of encoder-decoder neural networks to perform this task across large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Ho Hin Lee , Yucheng Tang , Qi Yang , Xin Yu , Shunxing Bao , Leon Y. Cai , Lucas W. Remedios , Bennett A. Landman , Yuankai Huo

``Learning to hash'' is a practical solution for efficient retrieval, offering fast search speed and low storage cost. It is widely applied in various applications, such as image-text cross-modal search. In this paper, we explore the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Young Kyun Jang , Donghyun Kim , Ser-nam Lim

Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Bo Dai , Dahua Lin

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid

Unsupervised binary representation allows fast data retrieval without any annotations, enabling practical application like fast person re-identification and multimedia retrieval. It is argued that conflicts in binary space are one of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Fangrui Liu , Zheng Liu

Image harmonization task aims at harmonizing different composite foreground regions according to specific background image. Previous methods would rather focus on improving the reconstruction ability of the generator by some internal…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Jingtang Liang , Chi-Man Pun

Large-scale image datasets are fundamental to deep learning, but their high storage demands pose challenges for deployment in resource-constrained environments. While existing approaches reduce dataset size by discarding samples, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Chenyue Yu , Lingao Xiao , Jinhong Deng , Ivor W. Tsang , Yang He