中文
相关论文

相关论文: Learning Gradient-based Mixup with Extrapolation t…

200 篇论文

Domain generalization (DG) methods aim to maintain good performance in an unseen target domain by using training data from multiple source domains. While success on certain occasions are observed, enhancing the baseline across most…

机器学习 · 计算机科学 2024-10-28 Liang Chen , Yong Zhang , Yibing Song , Zhiqiang Shen , Lingqiao Liu

Research on loss surface geometry, such as Sharpness-Aware Minimization (SAM), shows that flatter minima improve generalization. Recent studies further reveal that flatter minima can also reduce the domain generalization (DG) gap. However,…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Jiacheng Jiang , Yuan Meng , Chen Tang , Han Yu , Qun Li , Zhi Wang , Wenwu Zhu

Domain Adaptation is an actively researched problem in Computer Vision. In this work, we propose an approach that leverages unsupervised data to bring the source and target distributions closer in a learned joint feature space. We…

计算机视觉与模式识别 · 计算机科学 2018-04-16 Swami Sankaranarayanan , Yogesh Balaji , Carlos D. Castillo , Rama Chellappa

In this paper, we propose a novel domain generalization (DG) framework based on a new upper bound to the risk on the unseen domain. Particularly, our framework proposes to jointly minimize both the covariate-shift as well as the…

机器学习 · 计算机科学 2022-08-02 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Machine learning systems typically assume that the distributions of training and test sets match closely. However, a critical requirement of such systems in the real world is their ability to generalize to unseen domains. Here, we propose…

机器学习 · 计算机科学 2021-07-15 Yuge Shi , Jeffrey Seely , Philip H. S. Torr , N. Siddharth , Awni Hannun , Nicolas Usunier , Gabriel Synnaeve

Domain Generalization (DG) is essentially a sub-branch of out-of-distribution generalization, which trains models from multiple source domains and generalizes to unseen target domains. Recently, some domain generalization algorithms have…

计算机视觉与模式识别 · 计算机科学 2023-03-23 Zining Chen , Weiqiu Wang , Zhicheng Zhao , Aidong Men

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Aristotelis Ballas , Christos Diou

Existing domain generalization (DG) methods for cross-person generalization tasks often face challenges in capturing intra- and inter-domain style diversity, resulting in domain gaps with the target domain. In this study, we explore a novel…

机器学习 · 计算机科学 2024-07-02 Junru Zhang , Lang Feng , Zhidan Liu , Yuhan Wu , Yang He , Yabo Dong , Duanqing Xu

Mixup is a data augmentation technique that enhances model generalization by interpolating between data points using a mixing ratio $\lambda$ in the image domain. Recently, the concept of mixup has been adapted to the graph domain through…

机器学习 · 计算机科学 2024-12-12 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yibing Zhan , Yiheng Lu , Dapeng Tao

Domain generalization (DG) seeks to develop models that generalize well to unseen target domains, addressing the prevalent issue of distribution shifts in real-world applications. One line of research in DG focuses on aligning domain-level…

机器学习 · 计算机科学 2025-06-10 Yuen Chen , Haozhe Si , Guojun Zhang , Han Zhao

Out-of-distribution (OOD) generalization is a favorable yet challenging property for deep neural networks. The core challenges lie in the limited availability of source domains that help models learn an invariant representation from the…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Yijiang Li , Sucheng Ren , Weipeng Deng , Yuzhi Xu , Ying Gao , Edith Ngai , Haohan Wang

In this paper, we question the rationale behind propagating large numbers of parameters through a distributed system during federated learning. We start by examining the rank characteristics of the subspace spanned by gradients across…

机器学习 · 计算机科学 2022-02-02 Sheikh Shams Azam , Seyyedali Hosseinalipour , Qiang Qiu , Christopher Brinton

We propose $\textbf{UniDG}$, a novel and $\textbf{Uni}$fied framework for $\textbf{D}$omain $\textbf{G}$eneralization that is capable of significantly enhancing the out-of-distribution generalization performance of foundation models…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Yiyuan Zhang , Kaixiong Gong , Xiaohan Ding , Kaipeng Zhang , Fangrui Lv , Kurt Keutzer , Xiangyu Yue

Computer vision has flourished in recent years thanks to Deep Learning advancements, fast and scalable hardware solutions and large availability of structured image data. Convolutional Neural Networks trained on supervised tasks with…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Antono D'Innocente

Mixup and its variants form a popular class of data augmentation techniques.Using a random sample pair, it generates a new sample by linear interpolation of the inputs and labels. However, generating only one single interpolation may limit…

机器学习 · 计算机科学 2024-06-04 Lifeng Shen , Jincheng Yu , Hansi Yang , James T. Kwok

Single Domain Generalization (SDG) aims to train models that maintain consistent performance across diverse scenarios using data from a single source. While latent diffusion models (LDMs) show promise for augmenting limited source data, our…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Hao Li , Yubin Xiao , Ke Liang , Mengzhu Wang , Long Lan , Kenli Li , Xinwang Liu

This paper introduces Domain Generalization Sharpness-Aware Minimization Model-Agnostic Meta-Learning (DGS-MAML), a novel meta-learning algorithm designed to generalize across tasks with limited training data. DGS-MAML combines gradient…

机器学习 · 计算机科学 2025-08-14 Usman Anjum , Chris Stockman , Cat Luong , Justin Zhan

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by…

机器学习 · 计算机科学 2017-10-11 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

机器学习 · 计算机科学 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that learns domain-invariant…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Kyungmoon Lee , Sungyeon Kim , Suha Kwak