English
Related papers

Related papers: Contrastive Learning with Large Memory Bank and Ne…

200 papers

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Contrastive Language-Image Pretraining (CLIP) models excel at understanding image-text relationships but struggle with adapting to new data without forgetting prior knowledge. To address this, models are typically fine-tuned using both new…

Machine Learning · Computer Science 2026-05-06 Ryan King , Gang Li , Bobak Mortazavi , Tianbao Yang

At present, the great achievements of convolutional neural network(CNN) in feature and metric learning have attracted many researchers. However, the vast majority of deep network architectures have been used to represent based on real…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Siwen Jiang , Wenxuan Wei , Shihao Guo , Hongguang Fu , Lei Huang

Recent studies have shown that deep convolutional neural networks (DCNN) are vulnerable to adversarial examples and sensitive to perceptual quality as well as the acquisition condition of images. These findings raise a big concern for the…

Machine Learning · Computer Science 2020-04-15 Yeli Feng , Yiyu Cai

This paper proposes an adaptive auxiliary task learning based approach for object counting problems. Unlike existing auxiliary task learning based methods, we develop an attention-enhanced adaptively shared backbone network to enable both…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Yanda Meng , Joshua Bridge , Meng Wei , Yitian Zhao , Yihong Qiao , Xiaoyun Yang , Xiaowei Huang , Yalin Zheng

What makes images similar? To measure the similarity between images, they are typically embedded in a feature-vector space, in which their distance preserve the relative dissimilarity. However, when learning such similarity embeddings the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Andreas Veit , Serge Belongie , Theofanis Karaletsos

This paper considers the problem of helping humans exercise scalable oversight over deep neural networks (DNNs). Adversarial examples can be useful by helping to reveal weaknesses in DNNs, but they can be difficult to interpret or draw…

Machine Learning · Computer Science 2023-05-08 Stephen Casper , Kaivalya Hariharan , Dylan Hadfield-Menell

Recently, unsupervised image-to-image translation methods based on contrastive learning have achieved state-of-the-art results in many tasks. However, in the previous works, the negatives are sampled from the input image itself, which…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Chen Zhao , Wei-Ling Cai , Zheng Yuan , Cheng-Wei Hu

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

Convolutional Neural Networks (CNN) have become de fact state-of-the-art for the main computer vision tasks. However, due to the complex underlying structure their decisions are hard to understand which limits their use in some context of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Nina Schaaf , Omar de Mitri , Hang Beom Kim , Alexander Windberger , Marco F. Huber

Object detection systems based on the deep convolutional neural network (CNN) have recently made ground- breaking advances on several object detection benchmarks. While the features learned by these high-capacity neural networks are…

Computer Vision and Pattern Recognition · Computer Science 2016-01-15 Yuting Zhang , Kihyuk Sohn , Ruben Villegas , Gang Pan , Honglak Lee

Prior work has shown Convolutional Neural Networks (CNNs) trained on surrogate Computer Aided Design (CAD) models are able to detect and classify real-world artefacts from photographs. The applications of which support twinning of digital…

Machine Learning · Computer Science 2021-06-07 Ric Real , James Gopsill , David Jones , Chris Snider , Ben Hicks

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

Convolutional neural networks (CNNs) are one of the most popular models of Artificial Neural Networks (ANN)s in Computer Vision (CV). A variety of CNN-based structures were developed by researchers to solve problems like image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Bowen Qiu , Daniela Raicu , Jacob Furst , Roselyne Tchoua

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Graph contrastive learning has achieved great success in pre-training graph neural networks without ground-truth labels. Leading graph contrastive learning follows the classical scheme of contrastive learning, forcing model to identify the…

Machine Learning · Computer Science 2024-12-12 Junran Wu , Xueyuan Chen , Shangzhe Li

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

Convolutional Neural Networks (CNN) has been widely applied in the realm of computer vision. However, given the fact that CNN models are translation invariant, they are not aware of the coordinate information of each pixel. Thus the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Liliang Ren , Zhuonan Hao

Distance-based anomaly detection methods rely on compact in-distribution (ID) embeddings that are well separated from anomalies. However, conventional contrastive learning strategies often struggle to achieve this balance, either promoting…

Machine Learning · Computer Science 2026-02-02 Willian T. Lunardi , Abdulrahman Banabila , Dania Herzalla , Martin Andreoni