中文
相关论文

相关论文: Explore and Exploit the Diverse Knowledge in Model…

200 篇论文

Domain generalization is a popular machine learning technique that enables models to perform well on the unseen target domain, by learning from multiple source domains. Domain generalization is useful in cases where data is limited,…

计算机视觉与模式识别 · 计算机科学 2024-01-10 Yuyang Sun , Panagiotis Kosmas

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

Building sample-efficient agents that generalize out-of-distribution (OOD) in real-world settings remains a fundamental unsolved problem on the path towards achieving higher-level cognition. One particularly promising approach is to begin…

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

In the field of computer vision, fine-tuning pre-trained models has become a prevalent strategy for out-of-distribution (OOD) generalization tasks. Different from most prior work that has focused on advancing learning algorithms, we…

机器学习 · 计算机科学 2025-04-29 Hiroki Naganuma , Ryuichiro Hataya , Kotaro Yoshida , Ioannis Mitliagkas

Diffusion models, a family of generative models based on deep learning, have become increasingly prominent in cutting-edge machine learning research. With a distinguished performance in generating samples that resemble the observed data,…

机器学习 · 计算机科学 2023-05-02 Lequan Lin , Zhengkun Li , Ruikun Li , Xuliang Li , Junbin Gao

In the last years, neural networks (NN) have evolved from laboratory environments to the state-of-the-art for many real-world problems. It was shown that NN models (i.e., their weights and biases) evolve on unique trajectories in weight…

机器学习 · 计算机科学 2022-09-30 Konstantin Schürholt , Diyar Taskiran , Boris Knyazev , Xavier Giró-i-Nieto , Damian Borth

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

With the great success of pre-trained models, the pretrain-then-finetune paradigm has been widely adopted on downstream tasks for source code understanding. However, compared to costly training a large-scale model from scratch, how to…

软件工程 · 计算机科学 2022-03-16 Deze Wang , Zhouyang Jia , Shanshan Li , Yue Yu , Yun Xiong , Wei Dong , Xiangke Liao

Loading models pre-trained on the large-scale corpus in the general domain and fine-tuning them on specific downstream tasks is gradually becoming a paradigm in Natural Language Processing. Previous investigations prove that introducing a…

计算与语言 · 计算机科学 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Can one inject new concepts into an already trained generative model, while respecting its existing structure and knowledge? We propose a new task - domain expansion - to address this. Given a pretrained generator and novel (but related)…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Yotam Nitzan , Michaël Gharbi , Richard Zhang , Taesung Park , Jun-Yan Zhu , Daniel Cohen-Or , Eli Shechtman

Domain shift across crowd data severely hinders crowd counting models to generalize to unseen scenarios. Although domain adaptive crowd counting approaches close this gap to a certain extent, they are still dependent on the target domain…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Zhipeng Du , Jiankang Deng , Miaojing Shi

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e.,…

机器学习 · 计算机科学 2022-05-25 Jindong Wang , Cuiling Lan , Chang Liu , Yidong Ouyang , Tao Qin , Wang Lu , Yiqiang Chen , Wenjun Zeng , Philip S. Yu

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

计算机视觉与模式识别 · 计算机科学 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all…

机器学习 · 计算机科学 2022-02-16 A. Tuan Nguyen , Toan Tran , Yarin Gal , Atılım Güneş Baydin

Achieving robustness in recognition systems across diverse domains is crucial for their practical utility. While ample data availability is usually assumed, low-resource languages, such as ancient manuscripts and non-western languages, tend…

机器学习 · 计算机科学 2025-06-19 Adrià Molina Rodríguez , Oriol Ramos Terrades , Josep Lladós

Vision foundation models are increasingly moving beyond 2D to volumetric domains such as 3D medical imaging, where unified pretraining across different imaging modalities (i.e. CT, MRI, and PET) could provide foundational models for diverse…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Ho Hin Lee , Dongna Du , Chu Wang , Yuankai Huo , Shi Gu , James C. Gee , Yifan Wu

In this work, we investigate the domain generalization capabilities of diffusion models in the context of synthesizing images that are distinct from the training data. Instead of fine-tuning, we tackle this challenge from a sampling-based…

机器学习 · 计算机科学 2025-12-01 Ye Zhu , Yu Wu , Duo Xu , Zhiwei Deng , Yan Yan , Olga Russakovsky

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

计算与语言 · 计算机科学 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Domain generalization is a technique aimed at enabling models to maintain high accuracy when applied to new environments or datasets (unseen domains) that differ from the datasets used in training. Generally, the accuracy of models trained…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Reiji Saito , Kazuhiro Hotta