中文
相关论文

相关论文: PGrad: Learning Principal Gradients For Domain Gen…

200 篇论文

The great success neural networks have achieved is inseparable from the application of gradient-descent (GD) algorithms. Based on GD, many variant algorithms have emerged to improve the GD optimization process. The gradient for…

机器学习 · 计算机科学 2023-05-29 Zefan Li , Bingbing Ni , Teng Li , WenJun Zhang , Wen Gao

The reliable deployment of deep reinforcement learning in real-world settings requires the ability to generalize across a variety of conditions, including both in-distribution scenarios seen during training as well as novel…

机器学习 · 计算机科学 2025-11-26 James Queeney , Xiaoyi Cai , Alexander Schperberg , Radu Corcodel , Mouhacine Benosman , Jonathan P. How

Out-of-distribution (OOD) generalization has long been a challenging problem that remains largely unsolved. Gaussian processes (GP), as popular probabilistic model classes, especially in the small data regime, presume strong OOD…

机器学习 · 计算机科学 2023-12-19 Xilong Zhao , Siyuan Bian , Yaoyun Zhang , Yuliang Zhang , Qinying Gu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

In many real-world applications of Machine Learning it is of paramount importance not only to provide accurate predictions, but also to ensure certain levels of robustness. Adversarial Training is a training procedure aiming at providing…

机器学习 · 计算机科学 2019-10-09 Matteo Terzi , Gian Antonio Susto , Pratik Chaudhari

Computer vision has flourished in recent years thanks to Deep Learning advancements, fast and scalable hardware solutions and large availability of structured image data. Convolutional Neural Networks trained on supervised tasks with…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Antono D'Innocente

Domain generalization aims to learn invariance across multiple training domains, thereby enhancing generalization against out-of-distribution data. While gradient or representation matching algorithms have achieved remarkable success, these…

机器学习 · 计算机科学 2024-06-17 Yuxin Dong , Tieliang Gong , Hong Chen , Shuangyong Song , Weizhan Zhang , Chen Li

Domain generalization (DG) aims to learn models that perform well on unseen target domains by training on multiple source domains. Sharpness-Aware Minimization (SAM), known for finding flat minima that improve generalization, has therefore…

机器学习 · 统计学 2025-07-01 Youngjun Song , Youngsik Hwang , Jonghun Lee , Heechang Lee , Dong-Young Lim

Training large machine learning models requires a distributed computing approach, with communication of the model updates being the bottleneck. For this reason, several methods based on the compression (e.g., sparsification and/or…

机器学习 · 计算机科学 2023-12-29 Konstantin Mishchenko , Eduard Gorbunov , Martin Takáč , Peter Richtárik

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

计算与语言 · 计算机科学 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Neural networks are achieving state of the art and sometimes super-human performance on learning tasks across a variety of domains. Whenever these problems require learning in a continual or sequential manner, however, neural networks…

机器学习 · 计算机科学 2019-10-17 Mehrdad Farajtabar , Navid Azizan , Alex Mott , Ang Li

Distribution shift presents a significant challenge in machine learning, where models often underperform during the test stage when faced with a different distribution than the one they were trained on. This paper focuses on domain shifts,…

机器学习 · 计算机科学 2024-03-19 Huaxiu Yao , Xinyu Yang , Xinyi Pan , Shengchao Liu , Pang Wei Koh , Chelsea Finn

Out-of-distribution generalization of machine learning models remains challenging since the models are inherently bound to the training data distribution. This especially manifests, when the learned models rely on spurious correlations.…

机器学习 · 计算机科学 2025-02-27 Martin Surner , Abdelmajid Khelil , Ludwig Bothmann

Domain Adaptation (DA) has recently received significant attention due to its potential to adapt a learning model across source and target domains with mismatched distributions. Since DA methods rely exclusively on the given source and…

机器学习 · 统计学 2022-11-01 Akram S. Awad , George K. Atia

Domain Generalization (DG) aims to generalize to arbitrary unseen domains. A promising approach to improve model generalization in DG is the identification of flat minima. One typical method for this task is SWAD, which involves averaging…

计算机视觉与模式识别 · 计算机科学 2023-09-13 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Many crucial tasks of image processing and computer vision are formulated as inverse problems. Thus, it is of great importance to design fast and robust algorithms to solve these problems. In this paper, we focus on generalized projected…

图像与视频处理 · 电气工程与系统科学 2025-12-09 Ali Joundi , Yann Traonmilin , Alasdair Newson

Standard supervised learning setting assumes that training data and test data come from the same distribution (domain). Domain generalization (DG) methods try to learn a model that when trained on data from multiple domains, would…

计算机视觉与模式识别 · 计算机科学 2020-08-18 Udit Maniyar , Joseph K J , Aniket Anand Deshmukh , Urun Dogan , Vineeth N Balasubramanian

While deep learning has significantly improved ReID model accuracy under the independent and identical distribution (IID) assumption, it has also become clear that such models degrade notably when applied to an unseen novel domain due to…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Qilei Li , Shaogang Gong

Despite the striking performance achieved by modern detectors when training and test data are sampled from the same or similar distribution, the generalization ability of detectors under unknown distribution shifts remains hardly studied.…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Xingxuan Zhang , Zekai Xu , Renzhe Xu , Jiashuo Liu , Peng Cui , Weitao Wan , Chong Sun , Chen Li

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternative for DG. However,…

机器学习 · 计算机科学 2020-12-29 Hoang Son Le , Rini Akmeliawati , Gustavo Carneiro

Domain Generalization (DG) is a critical area that focuses on developing models capable of performing well on data from unseen distributions, which is essential for real-world applications. Existing approaches primarily concentrate on…

机器学习 · 计算机科学 2026-01-28 Xudong Han , Senkang Hu , Yihang Tao , Yu Guo , Philip Birch , Sam Tak Wu Kwong , Yuguang Fang