English
Related papers

Related papers: Seeking Consistent Flat Minima for Better Domain G…

200 papers

Person re-identification (re-ID) aims at identifying the same persons' images across different cameras. However, domain diversities between different datasets pose an evident challenge for adapting the re-ID model trained on one dataset to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-31 Yixiao Ge , Dapeng Chen , Hongsheng Li

Remote sensing enables a wide range of critical applications such as land cover and land use mapping, crop yield prediction, and environmental monitoring. Advances in satellite technology have expanded remote sensing datasets, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Anan Yaghmour , Melba M. Crawford , Saurabh Prasad

In this paper, we tackle the problem of training with multiple source domains with the aim to generalize to new domains at test time without an adaptation step. This is known as domain generalization (DG). Previous works on DG assume…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Mohammad Mahfujur Rahman , Clinton Fookes , Sridha Sridharan

Domain generalization (DG) aims to learn a robust model from source domains that generalize well on unseen target domains. Recent studies focus on generating novel domain samples or features to diversify distributions complementary to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Chenming Li , Daoan Zhang , Wenjian Huang , Jianguo Zhang

Deep Neural Networks (DNNs) suffer from domain shift when the test dataset follows a distribution different from the training dataset. Domain generalization aims to tackle this issue by learning a model that can generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yu Ding , Lei Wang , Bin Liang , Shuming Liang , Yang Wang , Fang Chen

Open-set single-source domain generalization aims to use a single-source domain to learn a robust model that can be generalized to unknown target domains with both domain shifts and label shifts. The scarcity of the source domain and the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Pengkun Jiao , Na Zhao , Jingjing Chen , Yu-Gang Jiang

In this work, we explore the usage of the Frequency Transformation for reducing the domain shift between the source and target domain (e.g., synthetic image and real image respectively) towards solving the Domain Adaptation task. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vikash Kumar , Himanshu Patil , Rohit Lal , Anirban Chakraborty

Multi-domain generalization (mDG) is universally aimed to minimize the discrepancy between training and testing distributions to enhance marginal-to-label distribution mapping. However, existing mDG literature lacks a general learning…

Machine Learning · Computer Science 2024-12-19 Zhaorui Tan , Xi Yang , Kaizhu Huang

Despite an extensive body of literature on deep learning optimization, our current understanding of what makes an optimization algorithm effective is fragmented. In particular, we do not understand well whether enhanced optimization…

Machine Learning · Computer Science 2024-03-04 Toki Tahmid Inan , Mingrui Liu , Amarda Shehu

Preference tuning aligns pretrained language models to human judgments of quality, helpfulness, or safety by optimizing over explicit preference signals rather than likelihood alone. Prior work has shown that preference-tuning degrades…

Computation and Language · Computer Science 2026-01-12 Constantinos Karouzos , Xingwei Tan , Nikolaos Aletras

Overfitting to the source domain is a common issue in gradient-based training of deep neural networks. To compensate for the over-parameterized models, numerous regularization techniques have been introduced such as those based on dropout.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Mateusz Michalkiewicz , Masoud Faraki , Xiang Yu , Manmohan Chandraker , Mahsa Baktashmotlagh

This work studies the generalization issue of face anti-spoofing (FAS) models on domain gaps, such as image resolution, blurriness and sensor variations. Most prior works regard domain-specific signals as a negative impact, and apply metric…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yiyou Sun , Yaojie Liu , Xiaoming Liu , Yixuan Li , Wen-Sheng Chu

Semantic communication can significantly improve bandwidth utilization in wireless systems by exploiting the meaning behind raw data. However, the advancements achieved through semantic communication are closely dependent on the development…

Information Theory · Computer Science 2026-02-25 Loc X. Nguyen , Ji Su Yoon , Huy Q. Le , Yu Qiao , Avi Deb Raha , Eui-Nam Huh , Walid Saad , Dusit Niyato , Zhu Han , Choong Seon Hong

Graph Neural Networks (GNNs) have achieved remarkable success across various graph-based tasks but remain highly sensitive to distribution shifts. In this work, we focus on a prevalent yet under-explored phenomenon in graph generalization,…

Machine Learning · Computer Science 2026-02-10 Yang Qiu , Yixiong Zou , Jun Wang

We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers that are specific to individual domains. Our approach employs multiple…

Machine Learning · Computer Science 2020-07-22 Seonguk Seo , Yumin Suh , Dongwan Kim , Geeho Kim , Jongwoo Han , Bohyung Han

Learning in Deep Neural Networks (DNN) takes place by minimizing a non-convex high-dimensional loss function, typically by a stochastic gradient descent (SGD) strategy. The learning process is observed to be able to find good minimizers…

Machine Learning · Computer Science 2020-03-12 Carlo Baldassi , Fabrizio Pittorino , Riccardo Zecchina

A large body of theory and empirical work hypothesizes a connection between the flatness of a neural network's loss landscape during training and its performance. However, there have been conceptually opposite pieces of evidence regarding…

Machine Learning · Computer Science 2026-02-06 Yizhou Xu , Pierfrancesco Beneventano , Isaac Chuang , Liu Ziyin

Despite progress, deep neural networks still suffer performance declines under distribution shifts between training and test domains, leading to a substantial decrease in Quality of Experience (QoE) for applications. Existing test-time…

Machine Learning · Computer Science 2025-06-10 Qinting Jiang , Chuyang Ye , Dongyan Wei , Bingli Wang , Yuan Xue , Jingyan Jiang , Zhi Wang

In today's heavily overparameterized models, the value of the training loss provides few guarantees on model generalization ability. Indeed, optimizing only the training loss value, as is commonly done, can easily lead to suboptimal model…

Machine Learning · Computer Science 2021-04-30 Pierre Foret , Ariel Kleiner , Hossein Mobahi , Behnam Neyshabur

Domain transfer is a prevalent challenge in modern neural Information Retrieval (IR). To overcome this problem, previous research has utilized domain-specific manual annotations and synthetic data produced by consistency filtering to…

Information Retrieval · Computer Science 2023-08-08 Haoxiang Shi , Sumio Fujita , Tetsuya Sakai