English
Related papers

Related papers: GeneralizeFormer: Layer-Adaptive Model Generation …

200 papers

Semantic segmentation in a supervised learning manner has achieved significant progress in recent years. However, its performance usually drops dramatically due to the data-distribution discrepancy between seen and unseen domains when we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Temporal domain generalization is a promising yet extremely challenging area where the goal is to learn models under temporally changing data distributions and generalize to unseen data distributions following the trends of the change. The…

Machine Learning · Computer Science 2023-02-13 Guangji Bai , Chen Ling , Liang Zhao

State-of-the-art parameter-efficient fine-tuning methods rely on introducing adapter modules between the layers of a pretrained language model. However, such modules are trained separately for each task and thus do not enable sharing…

Computation and Language · Computer Science 2021-06-09 Rabeeh Karimi Mahabadi , Sebastian Ruder , Mostafa Dehghani , James Henderson

Though convolutional neural networks (CNNs) have demonstrated remarkable ability in learning discriminative features, they often generalize poorly to unseen domains. Domain generalization aims to address this problem by learning from a set…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Kaiyang Zhou , Yongxin Yang , Yu Qiao , Tao Xiang

Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this…

Machine Learning · Computer Science 2020-10-07 Laëtitia Shao , Yang Song , Stefano Ermon

Humans have the ability to accumulate knowledge of new tasks in varying conditions, but deep neural networks often suffer from catastrophic forgetting of previously learned knowledge after learning a new task. Many recent methods focus on…

Existing domain adaptation methods aim at learning features that can be generalized among domains. These methods commonly require to update source classifier to adapt to the target domain and do not properly handle the trade off between the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Shaokai Ye , Kailu Wu , Mu Zhou , Yunfei Yang , Sia huat Tan , Kaidi Xu , Jiebo Song , Chenglong Bao , Kaisheng Ma

A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

When models, e.g., for semantic segmentation, are applied to images that are vastly different from training data, the performance will drop significantly. Domain adaptation methods try to overcome this issue, but need samples from the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Joshua Niemeijer , Manuel Schwonberg , Jan-Aike Termöhlen , Nico M. Schmidt , Tim Fingscheidt

In AI-based histopathology, domain shifts are common and well-studied. However, this research focuses on stain and scanner variations, which do not show the full picture -- shifts may be combinations of other shifts, or "invisible" shifts…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Andrew Walker

This paper strives for domain generalization, where models are trained exclusively on source domains before being deployed on unseen target domains. We follow the strict separation of source training and target testing, but exploit the…

Machine Learning · Computer Science 2024-07-02 Sameer Ambekar , Zehao Xiao , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

Domain adaptation framework of GANs has achieved great progress in recent years as a main successful approach of training contemporary GANs in the case of very limited training data. In this work, we significantly improve this framework by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Aibek Alanov , Vadim Titov , Dmitry Vetrov

Due to the scarcity of publicly available diarization data, the model performance can be improved by training a single model with data from different domains. In this work, we propose to incorporate domain information to train a single…

Sound · Computer Science 2023-12-13 Ivan Fung , Lahiru Samarakoon , Samuel J. Broughton

We aim for source-free domain adaptation, where the task is to deploy a model pre-trained on source domains to target domains. The challenges stem from the distribution shift from the source to the target domain, coupled with the…

Machine Learning · Computer Science 2022-10-20 Mengmeng Jing , Xiantong Zhen , Jingjing Li , Cees G. M. Snoek

In open-world scenarios, where both novel classes and domains may exist, an ideal segmentation model should detect anomaly classes for safety and generalize to new domains. However, existing methods often struggle to distinguish between…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Zhitong Gao , Bingnan Li , Mathieu Salzmann , Xuming He

The successful training of deep neural networks requires addressing challenges such as overfitting, numerical instabilities leading to divergence, and increasing variance in the residual stream. A common solution is to apply regularization…

Machine Learning · Computer Science 2025-11-20 Jörg K. H. Franke , Urs Spiegelhalter , Marianna Nezhurina , Jenia Jitsev , Frank Hutter , Michael Hefenbrock

Domain adaptation algorithms are designed to minimize the misclassification risk of a discriminative model for a target domain with little training data by adapting a model from a source domain with a large amount of training data. Standard…

Machine Learning · Statistics 2021-07-27 Werner Zellinger , Bernhard A Moser , Susanne Saminger-Platz

This paper proposes a novel test-time adaptation strategy that adjusts the model pre-trained on the source domain using only unlabeled online data from the target domain to alleviate the performance degradation due to the distribution shift…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Sungha Choi , Seunghan Yang , Seokeon Choi , Sungrack Yun

As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. In previous DG…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Yue Wang , Lei Qi , Yinghuan Shi , Yang Gao
‹ Prev 1 3 4 5 6 7 10 Next ›