English
Related papers

Related papers: Unsupervised Domain Adaptation within Deep Foundat…

200 papers

Recent advances in deep learning have led to the development of accurate and efficient models for various computer vision applications such as classification, segmentation, and detection. However, learning highly accurate models relies on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Poojan Oza , Vishwanath A. Sindagi , Vibashan VS , Vishal M. Patel

This report analyzes the evolution of key design patterns in computer vision by examining six influential papers. The analysis begins with foundational architectures for image recognition. We review ResNet, which introduced residual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Radu-Andrei Bourceanu , Neil De La Fuente , Jan Grimm , Andrei Jardan , Andriy Manucharyan , Cornelius Weiss , Daniel Cremers , Roman Pflugfelder

Many models of visual attention have been proposed so far. Traditional bottom-up models, like saliency models, fail to replicate human gaze patterns, and deep gaze prediction models lack biological plausibility due to their reliance on…

Neurons and Cognition · Quantitative Biology 2025-05-28 Takuto Yamamoto , Hirosato Akahoshi , Shigeru Kitazawa

Vision transformers (ViT) have demonstrated impressive performance across various machine vision problems. These models are based on multi-head self-attention mechanisms that can flexibly attend to a sequence of image patches to encode…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Muzammal Naseer , Kanchana Ranasinghe , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang

In this paper, we focus on a less explored, but more realistic and complex problem of domain adaptation in LiDAR semantic segmentation. There is a significant drop in performance of an existing segmentation model when training (source…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Mrigank Rochan , Shubhra Aich , Eduardo R. Corral-Soto , Amir Nabatchian , Bingbing Liu

In recent years, Vision Transformers have attracted increasing interest from computer vision researchers. However, the advantage of these transformers over CNNs is only fully manifested when trained over a large dataset, mainly due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Itamar Zimerman , Lior Wolf

In this study, we explore the efficacy of advanced pre-trained architectures, such as Vision Transformers (ViT), ConvNeXt, and Swin Transformers in enhancing Federated Domain Generalization. These architectures capture global contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Avi Deb Raha , Apurba Adhikary , Mrityunjoy Gain , Yu Qiao , Choong Seon Hong

This study evaluates the trade-offs between convolutional and transformer-based architectures on both medical and general-purpose image classification benchmarks. We use ResNet-18 as our baseline and introduce a fine-tuning strategy applied…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Aidar Amangeldi , Angsar Taigonyrov , Muhammad Huzaifa Jawad , Chinedu Emmanuel Mbonu

The observation that computer vision methods overfit to dataset specifics has inspired diverse attempts to make object recognition models robust to domain shifts. However, similar work on domain-robust visual question answering methods is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Mingda Zhang , Tristan Maidment , Ahmad Diab , Adriana Kovashka , Rebecca Hwa

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu

Existing Question Answering (QA) systems limited by the capability of answering questions from unseen domain or any out-of-domain distributions making them less reliable for deployment to real scenarios. Most importantly all the existing QA…

Computation and Language · Computer Science 2023-05-10 Anant Khandelwal

We consider the problem of domain generalization, namely, how to learn representations given data from a set of domains that generalize to data from a previously unseen domain. We propose the Domain Invariant Variational Autoencoder (DIVA),…

Machine Learning · Statistics 2019-10-08 Maximilian Ilse , Jakub M. Tomczak , Christos Louizos , Max Welling

Deep Learning has greatly advanced the performance of semantic segmentation, however, its success relies on the availability of large amounts of annotated data for training. Hence, many efforts have been devoted to domain adaptive semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zhengeng Yang , Hongshan Yu , Wei Sun , Li-Cheng , Ajmal Mian

Unsupervised domain adaptation (UDA) has been successfully applied to transfer knowledge from a labeled source domain to target domains without their labels. Recently introduced transferable prototypical networks (TPN) further addresses…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Fangxu Xing , Jia You , Jun Lu , C. -C. Jay Kuo , Georges El Fakhri , Jonghye Woo

Unsupervised Multiple Domain Translation is the task of transforming data from one domain to other domains without having paired data to train the systems. Typically, methods based on Generative Adversarial Networks (GANs) are used to…

Machine Learning · Computer Science 2024-01-19 Antonio Almudévar , Théo Mariotte , Alfonso Ortega , Marie Tahon

As a vital problem in pattern analysis and machine intelligence, Unsupervised Domain Adaptation (UDA) attempts to transfer an effective feature learner from a labeled source domain to an unlabeled target domain. Inspired by the success of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Ren Chuan-Xian , Zhai Yi-Ming , Luo You-Wei , Yan Hong

We study the problem of unsupervised domain adaptive re-identification (re-ID) which is an active topic in computer vision but lacks a theoretical foundation. We first extend existing unsupervised domain adaptive classification theories to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Liangchen Song , Cheng Wang , Lefei Zhang , Bo Du , Qian Zhang , Chang Huang , Xinggang Wang

Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attractive to train models…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Luke Melas-Kyriazi , Arjun K. Manrai

The proposed framework named IDEAL (Interpretable-by-design DEep learning ALgorithms) recasts the standard supervised classification problem into a function of similarity to a set of prototypes derived from the training data, while taking…

Machine Learning · Computer Science 2023-11-21 Plamen Angelov , Dmitry Kangin , Ziyang Zhang

Foundation models represent the most prominent and recent paradigm shift in artificial intelligence. Foundation models are large models, trained on broad data that deliver high accuracy in many downstream tasks, often without fine-tuning.…

Cryptography and Security · Computer Science 2025-09-15 Hondamunige Prasanna Silva , Federico Becattini , Lorenzo Seidenari