中文
相关论文

相关论文: Domain Generalization via Pareto Optimal Gradient …

200 篇论文

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

机器学习 · 统计学 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

To ensure the out-of-distribution (OOD) generalization performance, traditional domain generalization (DG) methods resort to training on data from multiple sources with different underlying distributions. And the success of those DG methods…

机器学习 · 计算机科学 2023-05-26 Zheyan Shen , Han Yu , Peng Cui , Jiashuo Liu , Xingxuan Zhang , Linjun Zhou , Furui Liu

In this paper, we propose a novel normalization method called penalty gradient normalization (PGN) to tackle the training instability of Generative Adversarial Networks (GANs) caused by the sharp gradient space. Unlike existing work such as…

计算机视觉与模式识别 · 计算机科学 2023-06-26 Tian Xia

Visual recognition systems are meant to work in the real world. For this to happen, they must work robustly in any visual domain, and not only on the data used during training. Within this context, a very realistic scenario deals with…

计算机视觉与模式识别 · 计算机科学 2018-10-01 Antonio D'Innocente , Barbara Caputo

Domain generalization (DG) tends to alleviate the poor generalization capability of deep neural networks by learning model with multiple source domains. A classical solution to DG is domain augmentation, the common belief of which is that…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Fangrui Lv , Jian Liang , Shuang Li , Jinming Zhang , Di Liu

Many optimization problems require balancing multiple conflicting objectives. As gradient descent is limited to single-objective optimization, we introduce its direct generalization: Jacobian descent (JD). This algorithm iteratively updates…

机器学习 · 计算机科学 2025-02-04 Pierre Quinton , Valérian Rey

Domain generalization (DG) seeks to develop models that generalize well to unseen target domains, addressing the prevalent issue of distribution shifts in real-world applications. One line of research in DG focuses on aligning domain-level…

机器学习 · 计算机科学 2025-06-10 Yuen Chen , Haozhe Si , Guojun Zhang , Han Zhao

While deep learning has significantly improved ReID model accuracy under the independent and identical distribution (IID) assumption, it has also become clear that such models degrade notably when applied to an unseen novel domain due to…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Qilei Li , Shaogang Gong

Embedding parameterized optimization problems as layers into machine learning architectures serves as a powerful inductive bias. Training such architectures with stochastic gradient descent requires care, as degenerate derivatives of the…

机器学习 · 计算机科学 2024-12-16 Anselm Paulus , Georg Martius , Vít Musil

Domain generalization (DG) is the problem of generalizing from several distributions (or domains), for which labeled training data are available, to a new test domain for which no labeled data is available. For the prevailing benchmark…

机器学习 · 计算机科学 2026-02-05 Yilun Zhu , Naihao Deng , Naichen Shi , Aditya Gangrade , Clayton Scott

One of the challenges in vision-based driving trajectory generation is dealing with out-of-distribution scenarios. In this paper, we propose a domain generalization method for vision-based driving trajectory generation for autonomous…

计算机视觉与模式识别 · 计算机科学 2021-09-29 Yunkai Wang , Dongkun Zhang , Yuxiang Cui , Zexi Chen , Wei Jing , Junbo Chen , Rong Xiong , Yue Wang

As deep learning models and datasets rapidly scale up, network training is extremely time-consuming and resource-costly. Instead of training on the entire dataset, learning with a small synthetic dataset becomes an efficient solution.…

机器学习 · 计算机科学 2022-08-02 Zixuan Jiang , Jiaqi Gu , Mingjie Liu , David Z. Pan

Configuration Optimization Problems (COPs), which involve minimizing a loss function over a set of discrete points $\boldsymbol{\gamma} \subset P$, are common in areas like Model Order Reduction, Active Learning, and Optimal Experimental…

数值分析 · 数学 2024-10-24 Evie Nielen , Oliver Tse , Karen Veroy

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Toshihiko Matsuura , Tatsuya Harada

The domain shift between training and testing data presents a significant challenge for training generalizable deep learning models. As a consequence, the performance of models trained with the independent and identically distributed…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Aleksandr Matsun , Dana O. Mohamed , Sharon Chokuwa , Muhammad Ridzuan , Mohammad Yaqub

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

机器学习 · 计算机科学 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

Deep learning methods can struggle to handle domain shifts not seen in training data, which can cause them to not generalize well to unseen domains. This has led to research attention on domain generalization (DG), which aims to the model's…

机器学习 · 计算机科学 2022-05-10 Wei Zhu , Le Lu , Jing Xiao , Mei Han , Jiebo Luo , Adam P. Harrison

Generalization is the core objective when training optimizers from data. However, limited training instances often constrain the generalization capability of the trained optimizers. Co-evolutionary approaches address this challenge by…

神经与进化计算 · 计算机科学 2025-11-19 Zhiyuan Wang , Shengcai Liu , Peng Yang , Ke Tang

Domain generalization (DG) aims to avoid the performance degradation of the model when the distribution shift between the limited training data and unseen test data occurs. Recently, foundation models with enormous parameters have been…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Jiajun Hu , Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

机器学习 · 计算机科学 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li