English
Related papers

Related papers: Domain-Inspired Sharpness-Aware Minimization Under…

200 papers

Machine learning algorithms minimizing the average training loss usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

Machine Learning · Computer Science 2022-07-29 Xi Leng , Xiaoying Tang , Yatao Bian

Domain adaptation (DA) is a technique that transfers predictive models trained on a labeled source domain to an unlabeled target domain, with the core difficulty of resolving distributional shift between domains. Currently, most popular DA…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Bo Li , Yezhen Wang , Tong Che , Shanghang Zhang , Sicheng Zhao , Pengfei Xu , Wei Zhou , Yoshua Bengio , Kurt Keutzer

Unsupervised domain adaptation is critical in various computer vision tasks, such as object detection, instance segmentation, etc. They attempt to reduce domain bias-induced performance degradation while also promoting model application…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Lijun Gou , Jinrong Yang , Hangcheng Yu , Pan Wang , Xiaoping Li , Chao Deng

Recent advancements in learning algorithms have demonstrated that the sharpness of the loss surface is an effective measure for improving the generalization gap. Building upon this concept, Sharpness-Aware Minimization (SAM) was proposed to…

Machine Learning · Computer Science 2024-06-21 Tanapat Ratchatorn , Masayuki Tanaka

Dataset Condensation (DC) has emerged as a promising solution to mitigate the computational and storage burdens associated with training deep learning models. However, existing DC methods largely overlook the multi-domain nature of modern…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Jaehyun Choi , Gyojin Han , Dong-Jae Lee , Sunghyun Baek , Junmo Kim

Unsupervised domain adaptation methods seek to generalize effectively on unlabeled test data, especially when encountering the common challenge in time series data that distribution shifts occur between training and testing datasets. In…

Machine Learning · Computer Science 2025-08-27 Weide Liu , Xiaoyang Zhong , Lu Wang , Jingwen Hou , Yuemei Luo , Jiebin Yan , Yuming Fang

Multi-task learning (MTL) enables a joint model to capture commonalities across multiple tasks, reducing computation costs and improving data efficiency. However, a major challenge in MTL optimization is task conflicts, where the task…

Machine Learning · Computer Science 2025-07-17 Hao Ban , Gokul Ram Subramani , Kaiyi Ji

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

Preference tuning aligns pretrained language models to human judgments of quality, helpfulness, or safety by optimizing over explicit preference signals rather than likelihood alone. Prior work has shown that preference-tuning degrades…

Computation and Language · Computer Science 2026-01-12 Constantinos Karouzos , Xingwei Tan , Nikolaos Aletras

Although synthetic data can alleviate acquisition challenges in image dehazing tasks, it also introduces the problem of domain bias when dealing with small-scale data. This paper proposes a novel dual-branch collaborative unpaired dehazing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shuaibin Fan , Minglong Xue , Aoxiang Ning , Senming Zhong

Sharpness-aware Minimization (SAM) improves generalization in large-scale model training by linking loss landscape geometry to generalization. However, challenges such as mislabeled noisy data and privacy concerns have emerged as…

Machine Learning · Computer Science 2025-07-08 Chenyang Ren , Yifan Jia , Huanyi Xie , Zhaobin Xu , Tianxing Wei , Liangyu Wang , Lijie Hu , Di Wang

In this work, we explore the usage of the Frequency Transformation for reducing the domain shift between the source and target domain (e.g., synthetic image and real image respectively) towards solving the Domain Adaptation task. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vikash Kumar , Himanshu Patil , Rohit Lal , Anirban Chakraborty

Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Rang Meng , Xianfeng Li , Weijie Chen , Shicai Yang , Jie Song , Xinchao Wang , Lei Zhang , Mingli Song , Di Xie , Shiliang Pu

The ability to classify images is dependent on having access to large labeled datasets and testing on data from the same domain that the model can train on. Classification becomes more challenging when dealing with new data from a different…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Firas Al-Hindawi , Md Mahfuzur Rahman Siddiquee , Teresa Wu , Han Hu , Ying Sun

Deep learning models usually suffer from domain shift issues, where models trained on one source domain do not generalize well to other unseen domains. In this work, we investigate the single-source domain generalization problem: training a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Cheng Ouyang , Chen Chen , Surui Li , Zeju Li , Chen Qin , Wenjia Bai , Daniel Rueckert

Domain adaptation for semantic segmentation aims to improve the model performance in the presence of a distribution shift between source and target domain. Leveraging the supervision from auxiliary tasks~(such as depth estimation) has the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Qin Wang , Dengxin Dai , Lukas Hoyer , Luc Van Gool , Olga Fink

Domain adaptation (DA) enables knowledge transfer from a labeled source domain to an unlabeled target domain by reducing the cross-domain distribution discrepancy. Most prior DA approaches leverage complicated and powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuang Li , Jinming Zhang , Wenxuan Ma , Chi Harold Liu , Wei Li

Most state-of-the-art deep domain adaptation techniques align source and target samples in a global fashion. That is, after alignment, each source sample is expected to become similar to any target sample. However, global alignment may not…

Machine Learning · Computer Science 2023-08-22 Liyue Chen , Linian Wang , Jinyu Xu , Shuai Chen , Weiqiang Wang , Wenbiao Zhao , Qiyu Li , Leye Wang

Universal domain adaptation (UniDA) aims to transfer knowledge from the source domain to the target domain without any prior knowledge about the label set. The challenge lies in how to determine whether the target samples belong to common…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Didi Zhu , Yincuan Li , Junkun Yuan , Zexi Li , Kun Kuang , Chao Wu

Despite plenty of efforts focusing on improving the domain adaptation ability (DA) under unsupervised or few-shot semi-supervised settings, recently the solution of active learning started to attract more attention due to its suitability in…

Machine Learning · Computer Science 2022-04-05 Ming Xie , Yuxi Li , Yabiao Wang , Zekun Luo , Zhenye Gan , Zhongyi Sun , Mingmin Chi , Chengjie Wang , Pei Wang