English
Related papers

Related papers: Multi-scale and Cross-scale Contrastive Learning f…

200 papers

Extracting image semantics effectively and assigning corresponding labels to multiple objects or attributes for natural images is challenging due to the complex scene contents and confusing label dependencies. Recent works have focused on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Leilei Ma , Dengdi Sun , Lei Wang , Haifeng Zhao , Bin Luo

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

Deep learning (DL) applied to breast tissue segmentation in magnetic resonance imaging (MRI) has received increased attention in the last decade, however, the domain shift which arises from different vendors, acquisition protocols, and…

To date, most existing self-supervised learning methods are designed and optimized for image classification. These pre-trained models can be sub-optimal for dense prediction tasks due to the discrepancy between image-level prediction and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Xinlong Wang , Rufeng Zhang , Chunhua Shen , Tao Kong , Lei Li

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Weiquan Li , Xianzhong Long , Yun Li

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

In recent years, the field of intelligent transportation systems (ITS) has achieved remarkable success, which is mainly due to the large amount of available annotation data. However, obtaining these annotated data has to afford expensive…

Machine Learning · Computer Science 2022-11-30 Quan Feng , Jiayu Yao , Zhison Pan , Guojun Zhou

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zhili Li , Xuejin Chen , Jie Zhao , Zhiwei Xiong

Contrastive learning is a discriminative approach that aims at grouping similar samples closer and diverse samples far from each other. It it an efficient technique to train an encoder generating distinguishable and informative…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Qing Chen , Jian Zhang

X-ray computed tomography (CT) is widely used in medical imaging, with sparse-view reconstruction offering an effective way to reduce radiation dose. However, ill-posed conditions often result in severe streak artifacts. Recent advances in…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Jiashu Dong , Jiabing Xiang , Lisheng Geng , Suqing Tian , Wei Zhao

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Supervised deep learning-based methods yield accurate results for medical image segmentation. However, they require large labeled datasets for this, and obtaining them is a laborious task that requires clinical expertise.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Unpaired image-to-image translation involves learning mappings between source domain and target domain in the absence of aligned or corresponding samples. Score based diffusion models have demonstrated state-of-the-art performance in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Venkata Narendra Kotyada , Revanth Eranki , Nagesh Bhattu Sristy

Weakly supervised semantic segmentation (WSSS) aims at learning a semantic segmentation model with only image-level tags. Despite intensive research on deep learning approaches over a decade, there is still a significant performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Qi Lai , Chi-Man Vong

A key feature of magnetic resonance (MR) imaging is its ability to manipulate how the intrinsic tissue parameters of the anatomy ultimately contribute to the contrast properties of the final, acquired image. This flexibility, however, can…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Dzung L. Pham , Snehashis Roy

Self-supervised learning (SSL) approaches have achieved great success when the amount of labeled data is limited. Within SSL, models learn robust feature representations by solving pretext tasks. One such pretext task is contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jamshid Hassanpour , Vinkle Srivastav , Didier Mutter , Nicolas Padoy

Modern supervised semantic segmentation methods are usually finetuned based on the supervised or self-supervised models pre-trained on ImageNet. Recent work shows that transferring the knowledge from CLIP to semantic segmentation via prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Chaohui Yu , Qiang Zhou , Zhibin Wang , Fan Wang