English
Related papers

Related papers: Adapting Self-Supervised Vision Transformers by Pr…

200 papers

Robotic Perception in diverse domains such as low-light scenarios, where new modalities like thermal imaging and specialized night-vision sensors are increasingly employed, remains a challenge. Largely, this is due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Anirudha Ramesh , Anurag Ghosh , Christoph Mertz , Jeff Schneider

Semi-Supervised Learning (SSL) and Unsupervised Domain Adaptation (UDA) enhance the model performance by exploiting information from labeled and unlabeled data. The clustering assumption has proven advantageous for learning with limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Durgesh Singh , Ahcène Boubekki , Robert Jenssen , Michael Kampffmeyer

Masked Autoencoders (MAE) achieve self-supervised learning of image representations by randomly removing a portion of visual tokens and reconstructing the original image as a pretext task, thereby significantly enhancing pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiaxuan Li , Qing Xu , Xiangjian He , Ziyu Liu , Chang Xing , Zhen Chen , Daokun Zhang , Rong Qu , Chang Wen Chen

Object detectors frequently encounter significant performance degradation when confronted with domain gaps between collected data (source domain) and data from real-world applications (target domain). To address this task, numerous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jianhong Han , Liang Chen , Yupei Wang

Transformers have become prevalent in computer vision due to their performance and flexibility in modelling complex operations. Of particular significance is the 'cross-attention' operation, which allows a vector representation (e.g. of an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Ali Athar , Jonathon Luiten , Alexander Hermans , Deva Ramanan , Bastian Leibe

Domain adaptation (DA) enables knowledge transfer from a labeled source domain to an unlabeled target domain by reducing the cross-domain distribution discrepancy. Most prior DA approaches leverage complicated and powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuang Li , Jinming Zhang , Wenxuan Ma , Chi Harold Liu , Wei Li

We propose a privacy-preserving semantic-segmentation method for applying perceptual encryption to images used for model training in addition to test images. This method also provides almost the same accuracy as models without any…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Homare Sueyoshi , Kiyoshi Nishikawa , Hitoshi Kiya

Object detection is essential in space applications targeting Space Domain Awareness and also applications involving relative navigation scenarios. Current deep learning models for Object Detection in space applications are often trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Samet Hicsonmez , Abd El Rahman Shabayek , Arunkumar Rathinam , Djamila Aouada

Deep learning has shown remarkable performance in medical image segmentation. However, despite its promise, deep learning has many challenges in practice due to its inability to effectively transition to unseen domains, caused by the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Dewei Hu , Hao Li , Han Liu , Jiacheng Wang , Xing Yao , Daiwei Lu , Ipek Oguz

Unsupervised Domain Adaptation (DA) consists of adapting a model trained on a labeled source domain to perform well on an unlabeled target domain with some data distribution shift. While many methods have been proposed in the literature,…

Domain adaptation (DA) addresses the real-world image classification problem of discrepancy between training (source) and testing (target) data distributions. We propose an unsupervised DA method that considers the presence of only…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Debasmit Das , C. S. George Lee

Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

Recent deep learning frameworks in histopathology, particularly multiple instance learning (MIL) combined with pathology foundational models (PFMs), have shown strong performance. However, PFMs exhibit limitations on certain cancer or…

We address the task of weakly-supervised few-shot image classification and segmentation, by leveraging a Vision Transformer (ViT) pretrained with self-supervision. Our proposed method takes token representations from the self-supervised ViT…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Dahyun Kang , Piotr Koniusz , Minsu Cho , Naila Murray

Training (source) domain bias affects state-of-the-art object detectors, such as Faster R-CNN, when applied to new (target) domains. To alleviate this problem, researchers proposed various domain adaptation methods to improve object…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Petru Soviany , Radu Tudor Ionescu , Paolo Rota , Nicu Sebe

We present an approach to efficiently and effectively adapt a masked image modeling (MIM) pre-trained vanilla Vision Transformer (ViT) for object detection, which is based on our two novel observations: (i) A MIM pre-trained vanilla ViT…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yuxin Fang , Shusheng Yang , Shijie Wang , Yixiao Ge , Ying Shan , Xinggang Wang

Unsupervised domain adaptation (UDA) is vital for alleviating the workload of labeling 3D point cloud data and mitigating the absence of labels when facing a newly defined domain. Various methods of utilizing images to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jingyi Xu , Weidong Yang , Lingdong Kong , Youquan Liu , Rui Zhang , Qingyuan Zhou , Ben Fei

Source-Free Domain Adaptation (SFDA) seeks to adapt a source model, which is pre-trained on a supervised source domain, for a target domain, with only access to unlabeled target training data. Relying on pseudo labeling and/or auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Song Tang , Yunxiang Bai , Wenxin Su , Mao Ye , Jianwei Zhang , Xiatian Zhu

Vision transformer has achieved impressive performance for many vision tasks. However, it may suffer from high redundancy in capturing local features for shallow layers. Local self-attention or early-stage convolutions are thus utilized,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Huaibo Huang , Xiaoqiang Zhou , Jie Cao , Ran He , Tieniu Tan

Vision-language models such as CLIP are pretrained on large volumes of internet sourced image and text pairs, and have been shown to sometimes exhibit impressive zero- and low-shot image classification performance. However, due to their…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Omiros Pantazis , Gabriel Brostow , Kate Jones , Oisin Mac Aodha