中文
相关论文

相关论文: Flatness-Aware Minimization for Domain Generalizat…

200 篇论文

To address distribution shifts between training and test data, domain generalization (DG) leverages multiple source domains to learn a model that generalizes well to unseen domains. However, existing DG methods often overfit to the source…

机器学习 · 计算机科学 2026-04-28 Danni Peng , Sinno Jialin Pan

Machine learning models fail to perform when facing out-of-distribution (OOD) domains, a challenging task known as domain generalization (DG). In this work, we develop a novel DG training strategy, we call PGrad, to learn a robust gradient…

机器学习 · 计算机科学 2023-05-03 Zhe Wang , Jake Grigsby , Yanjun Qi

Generalizing to out-of-distribution data while being aware of model fairness is a significant and challenging problem in meta-learning. The goal of this problem is to find a set of fairness-aware invariant parameters of classifier that is…

机器学习 · 计算机科学 2024-11-05 Kai Jiang , Chen Zhao , Haoliang Wang , Feng Chen

Domain generalization (DG) aims to tackle the distribution shift between training domains and unknown target domains. Generating new domains is one of the most effective approaches, yet its performance gain depends on the distribution…

机器学习 · 计算机科学 2023-05-17 Rui Dai , Yonggang Zhang , Zhen Fang , Bo Han , Xinmei Tian

We tackle the domain generalisation (DG) problem by posing it as a domain adaptation (DA) task where we adversarially synthesise the worst-case target domain and adapt a model to that worst-case domain, thereby improving the model's…

机器学习 · 计算机科学 2023-02-24 Minyoung Kim , Da Li , Timothy Hospedales

Neural Architecture Search (NAS) paves the way for the automatic definition of Neural Network (NN) architectures, attracting increasing research attention and offering solutions in various scenarios. This study introduces a novel NAS…

机器学习 · 计算机科学 2025-01-29 Matteo Gambella , Fabrizio Pittorino , Manuel Roveri

Domain generalization(DG) endeavors to develop robust models that possess strong generalizability while preserving excellent discriminability. Nonetheless, pivotal DG techniques tend to improve the feature generalizability by learning…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

Machine learning typically relies on the assumption that training and testing distributions are identical and that data is centrally stored for training and testing. However, in real-world scenarios, distributions may differ significantly…

机器学习 · 计算机科学 2025-08-22 Ying Li , Xingwei Wang , Rongfei Zeng , Praveen Kumar Donta , Ilir Murturi , Min Huang , Schahram Dustdar

Following the introduction of Adam, several novel adaptive optimizers for deep learning have been proposed. These optimizers typically excel in some tasks but may not outperform Adam uniformly across all tasks. In this work, we introduce…

机器学习 · 计算机科学 2024-06-18 Kaan Ozkara , Can Karakus , Parameswaran Raman , Mingyi Hong , Shoham Sabach , Branislav Kveton , Volkan Cevher

Recent advancements in domain generalization (DG) for face anti-spoofing (FAS) have garnered considerable attention. Traditional methods have focused on designing learning objectives and additional modules to isolate domain-specific…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Binh M. Le , Simon S. Woo

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

计算机视觉与模式识别 · 计算机科学 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

In the field of object detection, domain generalisation (DG) aims to ensure robust performance across diverse and unseen target domains by learning the robust domain-invariant features corresponding to the objects of interest across…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Shuvam Jena , Sushmetha Sumathi Rajendran , Karthik Seemakurthy , Sasithradevi A , Vijayalakshmi M , Prakash Poornachari

Flatness of the loss landscape has been widely studied as an important perspective for understanding the behavior and generalization of deep learning algorithms. Motivated by this view, we propose Flatness-Aware Stochastic Gradient Langevin…

机器学习 · 计算机科学 2026-05-28 Stefano Bruno , Youngsik Hwang , Jaehyeon An , Sotirios Sabanis , Dong-Young Lim

A key challenge in Domain Generalization (DG) is preventing overfitting to source domains, which can be mitigated by finding flatter minima in the loss landscape. In this work, we propose Quantization-aware Training for Domain…

机器学习 · 计算机科学 2025-06-30 Saqib Javed , Hieu Le , Mathieu Salzmann

The intuition that local flatness of the loss landscape is correlated with better generalization for deep neural networks (DNNs) has been explored for decades, spawning many different flatness measures. Recently, this link with…

机器学习 · 计算机科学 2021-06-22 Shuofeng Zhang , Isaac Reid , Guillermo Valle Pérez , Ard Louis

Generalizing to out-of-distribution (OOD) data or unseen domain, termed OOD generalization, still lacks appropriate theoretical guarantees. Canonical OOD bounds focus on different distance measurements between source and target domains but…

机器学习 · 计算机科学 2024-03-12 Yingtian Zou , Kenji Kawaguchi , Yingnan Liu , Jiashuo Liu , Mong-Li Lee , Wynne Hsu

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

机器学习 · 计算机科学 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

Flatness of the loss curve around a model at hand has been shown to empirically correlate with its generalization ability. Optimizing for flatness has been proposed as early as 1994 by Hochreiter and Schmidthuber, and was followed by more…

机器学习 · 计算机科学 2023-07-06 Linara Adilova , Amr Abourayya , Jianning Li , Amin Dada , Henning Petzka , Jan Egger , Jens Kleesiek , Michael Kamp

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

机器学习 · 计算机科学 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

机器学习 · 计算机科学 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla