中文
相关论文

相关论文: Is Large-Scale Pretraining the Secret to Good Doma…

200 篇论文

Data augmentation is a popular pre-processing trick to improve generalization accuracy. It is believed that by processing augmented inputs in tandem with the original ones, the model learns a more robust set of features which are shared…

机器学习 · 计算机科学 2020-07-10 Vihari Piratla , Shiv Shankar

The annotation scarcity of medical image segmentation poses challenges in collecting sufficient training data for deep learning models. Specifically, models trained on limited data may not generalize well to other unseen data domains,…

图像与视频处理 · 电气工程与系统科学 2023-07-19 Heng Li , Haojin Li , Wei Zhao , Huazhu Fu , Xiuyun Su , Yan Hu , Jiang Liu

In this study, we explore the efficacy of advanced pre-trained architectures, such as Vision Transformers (ViT), ConvNeXt, and Swin Transformers in enhancing Federated Domain Generalization. These architectures capture global contextual…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Avi Deb Raha , Apurba Adhikary , Mrityunjoy Gain , Yu Qiao , Choong Seon Hong

Instead of directly distilling a language model, this study addresses the problem of aligning a base model with a target model in distribution by designing the domain mixture of training data for pretraining or continued pretraining as a…

计算与语言 · 计算机科学 2026-03-18 Ryo Kishino , Riku Shiomi , Hiroaki Yamagiwa , Momose Oyama , Hidetoshi Shimodaira

Diabetic Retinopathy (DR) constitutes 5% of global blindness cases. While numerous deep learning approaches have sought to enhance traditional DR grading methods, they often falter when confronted with new out-of-distribution data thereby…

图像与视频处理 · 电气工程与系统科学 2024-11-06 Sharon Chokuwa , Muhammad Haris Khan

Domain adaptation (DA) and domain generalization (DG) have emerged as a solution to the domain shift problem where the distribution of the source and target data is different. The task of DG is more challenging than DA as the target data is…

计算机视觉与模式识别 · 计算机科学 2019-12-02 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen

Domain adaptation performance of a learning algorithm on a target domain is a function of its source domain error and a divergence measure between the data distribution of these two domains. We present a study of various distance-based…

计算与语言 · 计算机科学 2020-03-05 Han Guo , Ramakanth Pasunuru , Mohit Bansal

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

计算机视觉与模式识别 · 计算机科学 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

Text information including extensive prior knowledge about land cover classes has been ignored in hyperspectral image classification (HSI) tasks. It is necessary to explore the effectiveness of linguistic mode in assisting HSI…

计算机视觉与模式识别 · 计算机科学 2023-02-08 Yuxiang Zhang , Mengmeng Zhang , Wei Li , Shuai Wang , Ran Tao

Fine-tuning large pretrained vision-language models (VLMs) has emerged as a prevalent paradigm for downstream adaptation, yet it faces a critical trade-off between domain specificity and domain generalization (DG) ability. Current methods…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Xinyao Li , Yinjie Min , Hongbo Chen , Zhekai Du , Fengling Li , Jingjing Li

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

机器学习 · 计算机科学 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Deep learning has become the method of choice to tackle real-world problems in different domains, partly because of its ability to learn from data and achieve impressive performance on a wide range of applications. However, its success…

计算机视觉与模式识别 · 计算机科学 2022-08-17 Xiaofeng Liu , Chaehwa Yoo , Fangxu Xing , Hyejin Oh , Georges El Fakhri , Je-Won Kang , Jonghye Woo

To address distribution shifts between training and test data, domain generalization (DG) leverages multiple source domains to learn a model that generalizes well to unseen domains. However, existing DG methods often overfit to the source…

机器学习 · 计算机科学 2026-04-28 Danni Peng , Sinno Jialin Pan

Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any target data. Existing domain generalization methods ignore…

机器学习 · 计算机科学 2022-06-08 William Wei Wang , Gezheng Xu , Ruizhi Pu , Jiaqi Li , Fan Zhou , Changjian Shui , Charles Ling , Christian Gagné , Boyu Wang

In domain generalization (DG), the target domain is unknown when the model is being trained, and the trained model should successfully work on an arbitrary (and possibly unseen) target domain during inference. This is a difficult problem,…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Jungwuk Park , Dong-Jun Han , Soyeong Kim , Jaekyun Moon

Image alignment across domains has recently become one of the realistic and popular topics in the research community. In this problem, a deep learning-based image alignment method is usually trained on an available largescale database.…

计算机视觉与模式识别 · 计算机科学 2019-06-03 Thanh-Dat Truong , Khoa Luu , Chi Nhan Duong , Ngan Le , Minh-Triet Tran

Domain adaptation of neural networks commonly relies on three training phases: pretraining, selected data training and then fine tuning. Data selection improves target domain generalization by training further on pretraining data identified…

计算与语言 · 计算机科学 2021-09-17 Dan Iter , David Grangier

With the rapid development of deep learning methods, there have been many breakthroughs in the field of text classification. Models developed for this task have been shown to achieve high accuracy. However, most of these models are trained…

机器学习 · 计算机科学 2024-09-24 Yuxuan Hu , Chenwei Zhang , Min Yang , Xiaodan Liang , Chengming Li , Xiping Hu

Domain generalization approaches aim to learn a domain invariant prediction model for unknown target domains from multiple training source domains with different distributions. Significant efforts have recently been committed to broad…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Mohammad Mahfujur Rahman , Clinton Fookes , Sridha Sridharan