English
Related papers

Related papers: Contextrast: Contextual Contrastive Learning for S…

200 papers

Recently, contrastive self-supervised learning has become a key component for learning visual representations across many computer vision tasks and benchmarks. However, contrastive learning in the context of domain adaptation remains…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Mamatha Thota , Georgios Leontidis

Sketch semantic segmentation is a well-explored and pivotal problem in computer vision involving the assignment of pre-defined part labels to individual strokes. This paper presents ContextSeg - a simple yet highly effective approach to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Jiawei Wang , Changjian Li

We introduce a novel approach to unsupervised and semi-supervised domain adaptation for semantic segmentation. Unlike many earlier methods that rely on adversarial learning for feature alignment, we leverage contrastive learning to bridge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Weizhe Liu , David Ferstl , Samuel Schulter , Lukas Zebedin , Pascal Fua , Christian Leistner

In this paper, we propose a fully supervised pre-training scheme based on contrastive learning particularly tailored to dense classification tasks. The proposed Context-Self Contrastive Loss (CSCL) learns an embedding space that makes…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Michail Tarasiou , Riza Alp Guler , Stefanos Zafeiriou

Recent works have widely explored the contextual dependencies to achieve more accurate segmentation results. However, most approaches rarely distinguish different types of contextual dependencies, which may pollute the scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Changqian Yu , Jingbo Wang , Changxin Gao , Gang Yu , Chunhua Shen , Nong Sang

To overcome the data-hungry challenge, we have proposed a semi-supervised contrastive learning framework for the task of class-imbalanced semantic segmentation. First and foremost, to make the model operate in a semi-supervised manner, we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kangcheng Liu

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

During the last half decade, convolutional neural networks (CNNs) have triumphed over semantic segmentation, which is one of the core tasks in many applications such as autonomous driving and augmented reality. However, to train CNNs…

Computer Vision and Pattern Recognition · Computer Science 2019-01-11 Yang Zhang , Philip David , Hassan Foroosh , Boqing Gong

Modern deep learning architectures produce highly accurate results on many challenging semantic segmentation datasets. State-of-the-art methods are, however, not directly transferable to real-time applications or embedded devices, since…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Rudra P K Poudel , Ujwal Bonde , Stephan Liwicki , Christopher Zach

There is extensive interest in metric learning methods for image retrieval. Many metric learning loss functions focus on learning a correct ranking of training samples, but strongly overfit semantically inconsistent labels and require a…

Machine Learning · Computer Science 2023-06-05 Christopher Liao , Theodoros Tsiligkaridis , Brian Kulis

Cross-lingual summarization (CLS) is a sophisticated branch in Natural Language Processing that demands models to accurately translate and summarize articles from different source languages. Despite the improvement of the subsequent…

Computation and Language · Computer Science 2024-11-27 Sanzana Karim Lora , M. Sohel Rahman , Rifat Shahriyar

Recently, contrastive learning attracts increasing interests in neural text generation as a new solution to alleviate the exposure bias problem. It introduces a sequence-level training signal which is crucial to generation tasks that always…

Computation and Language · Computer Science 2023-02-06 Chenxin An , Jiangtao Feng , Kai Lv , Lingpeng Kong , Xipeng Qiu , Xuanjing Huang

Contextual information has been shown to be powerful for semantic segmentation. This work proposes a novel Context-based Tandem Network (CTNet) by interactively exploring the spatial contextual information and the channel contextual…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Zechao Li , Yanpeng Sun , Jinhui Tang

In this work, we leverage estimated depth to boost self-supervised contrastive learning for segmentation of urban scenes, where unlabeled videos are readily available for training self-supervised depth estimation. We argue that the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Liang Zeng , Attila Lengyel , Nergis Tömen , Jan van Gemert

Semantic segmentation in autonomous driving predominantly focuses on learning from large-scale data with a closed set of known classes without considering unknown objects. Motivated by safety reasons, we address the video class agnostic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Mennatullah Siam , Alex Kendall , Martin Jagersand

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

During the last half decade, convolutional neural networks (CNNs) have triumphed over semantic segmentation, which is one of the core tasks in many applications such as autonomous driving. However, to train CNNs requires a considerable…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Yang Zhang , Philip David , Boqing Gong

Singh et al. (2020) point out the dangers of contextual bias in visual recognition datasets. They propose two methods, CAM-based and feature-split, that better recognize an object or attribute in the absence of its typical context while…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Sunnie S. Y. Kim , Sharon Zhang , Nicole Meister , Olga Russakovsky

Graph clustering is essential in graph analysis for revealing structural patterns and node communities. Despite recent advances in self-supervised contrastive learning that have improved clustering via structural and attribute signals,…

Machine Learning · Computer Science 2026-05-28 Lei Zhang , Fubo Sun , Haipeng Yang , Zhong Guan , Likang Wu

In-Batch contrastive learning is a state-of-the-art self-supervised method that brings semantically-similar instances close while pushing dissimilar instances apart within a mini-batch. Its key to success is the negative sharing strategy,…

Machine Learning · Computer Science 2023-06-07 Zhen Yang , Tinglin Huang , Ming Ding , Yuxiao Dong , Rex Ying , Yukuo Cen , Yangliao Geng , Jie Tang