English
Related papers

Related papers: CATformer: Contrastive Adversarial Transformer for…

200 papers

Adversarial perturbations are noise-like patterns that can subtly change the data, while failing an otherwise accurate classifier. In this paper, we propose to use such perturbations within a novel contrastive learning setup to build…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Jue Wang , Anoop Cherian

Difference features obtained by comparing the images of two periods play an indispensable role in the change detection (CD) task. However, a pair of bi-temporal images can exhibit diverse changes, which may cause various difference…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Dan Wang , Licheng Jiao , Jie Chen , Shuyuan Yang , Fang Liu

Contrastive learning has demonstrated great effectiveness in representation learning especially for image classification tasks. However, there is still a shortage in the studies targeting regression tasks, and more specifically applications…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mohamad Dhaini , Maxime Berar , Paul Honeine , Antonin Van Exem

In recent years, there has been a significant focus on research related to text-guided image inpainting. However, the task remains challenging due to several constraints, such as ensuring alignment between the image and the text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Jihoon Lee , Yunhong Min , Hwidong Kim , Sangtae Ahn

There are not many large medical image datasets available. For these datasets, too small deep learning models can't learn useful features, so they don't work well due to underfitting, and too big models tend to overfit the limited data. As…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Pervaiz Iqbal Khan , Andreas Dengel , Sheraz Ahmed

Transformer-based methods have shown impressive performance in image restoration tasks, such as image super-resolution and denoising. However, we find that these networks can only utilize a limited spatial range of input information through…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiangyu Chen , Xintao Wang , Wenlong Zhang , Xiangtao Kong , Yu Qiao , Jiantao Zhou , Chao Dong

Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising structure. While prior methods accelerate sampling by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Dong Liu , Yanxuan Yu , Ben Lengerich , Ying Nian Wu

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

The presence of adversarial examples poses a significant threat to deep learning models and their applications. Existing defense methods provide certain resilience against adversarial examples, but often suffer from decreased accuracy and…

Cryptography and Security · Computer Science 2023-11-27 Jiahao Chen , Diqun Yan , Li Dong

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Soumik Mukhopadhyay , Matthew Gwilliam , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Srinidhi Hegde , Tianyi Zhou , Abhinav Shrivastava

Deep neural networks (DNNs) are vulnerable to adversarial perturbation, where an imperceptible perturbation is added to the image that can fool the DNNs. Diffusion-based adversarial purification focuses on using the diffusion model to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Kaiyu Song , Hanjiang Lai

Synthetic data generation has become an emerging tool to help improve the adversarial robustness in classification tasks since robust learning requires a significantly larger amount of training samples compared with standard classification…

Machine Learning · Computer Science 2023-07-06 Yidong Ouyang , Liyan Xie , Guang Cheng

We introduce CAN, a simple, efficient and scalable method for self-supervised learning of visual representations. Our framework is a minimal and conceptually clean synthesis of (C) contrastive learning, (A) masked autoencoders, and (N) the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shlok Mishra , Joshua Robinson , Huiwen Chang , David Jacobs , Aaron Sarna , Aaron Maschinot , Dilip Krishnan

The increasing availability of advanced image editing tools has led to a significant rise in manipulated digital content, posing serious challenges for digital forensics and information security. This study presents a transfer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Fatma Betul Buyuk , Gozde Karatas Baydogmus , Ali Buldu , Ayaulym Tulendiyeva , Zhuldyz Baizhumanova

The success of deep learning is usually accompanied by the growth in neural network depth. However, the traditional training method only supervises the neural network at its last layer and propagates the supervision layer-by-layer, which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Linfeng Zhang , Xin Chen , Junbo Zhang , Runpei Dong , Kaisheng Ma

Recent progress in single-image super-resolution (SISR) has achieved remarkable performance, yet the computational costs of these methods remain a challenge for deployment on resource-constrained devices. In particular, transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Gang Wu , Junjun Jiang , Junpeng Jiang , Xianming Liu

In this work, we tackle the challenging problem of arbitrary image style transfer using a novel style feature representation learning method. A suitable style representation, as a key component in image stylization tasks, is essential to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Yuxin Zhang , Fan Tang , Weiming Dong , Haibin Huang , Chongyang Ma , Tong-Yee Lee , Changsheng Xu

This work aims to tackle the all-in-one image restoration task, which seeks to handle multiple types of degradation with a single model. The primary challenge is to extract degradation representations from the input degraded images and use…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jie Chu , Tong Su , Pei Liu , Yunpeng Wu , Le Zhang , Zenglin Shi , Meng Wang

Deep learning with noisy labels is an interesting challenge in weakly supervised learning. Despite their significant learning capacity, CNNs have a tendency to overfit in the presence of samples with noisy labels. Alleviating this issue,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yan Han , Soumava Kumar Roy , Mehrtash Harandi , Lars Petersson

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi