English
Related papers

Related papers: Dual-Path Stable Soft Prompt Generation for Domain…

200 papers

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

Prompt tuning methods have achieved remarkable success in parameter-efficient fine-tuning on large pre-trained models. However, their application to dual-modal fusion-based visual-language pre-trained models (VLPMs), such as GLIP, has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yang Zhou , Yongjian Wu , Jiya Saiyin , Bingzheng Wei , Maode Lai , Eric Chang , Yan Xu

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. Typical diffusion models and modern large-scale conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

The visual prompts have provided an efficient manner in addressing visual cross-domain problems. In previous works, Visual Domain Prompt (VDP) first introduces domain prompts to tackle the classification Test-Time Adaptation (TTA) problem…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Senqiao Yang , Jiarui Wu , Jiaming Liu , Xiaoqi Li , Qizhe Zhang , Mingjie Pan , Yulu Gan , Zehui Chen , Shanghang Zhang

Recently, much exertion has been paid to design graph self-supervised methods to obtain generalized pre-trained models, and adapt pre-trained models onto downstream tasks through fine-tuning. However, there exists an inherent gap between…

Machine Learning · Computer Science 2023-08-16 Yun Zhu , Jianhao Guo , Siliang Tang

Domain generalization (DG) aims to train a model to perform well in unseen domains under different distributions. This paper considers a more realistic yet more challenging scenario,namely Single Domain Generalization (Single-DG), where…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Jiajin Zhang , Hanqing Chao , Amit Dhurandhar , Pin-Yu Chen , Ali Tajer , Yangyang Xu , Pingkun Yan

While recent text-to-video (T2V) diffusion models have achieved impressive quality and prompt alignment, they often produce low-diversity outputs when sampling multiple videos from a single text prompt. We tackle this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tahira Kazimi , Connor Dunlop , Pinar Yanardag

Recent advances in prompt optimization have notably enhanced the performance of pre-trained language models (PLMs) on downstream tasks. However, the potential of optimized prompts on domain generalization has been under-explored. To explore…

Computation and Language · Computer Science 2024-10-22 Chengzhengxu Li , Xiaoming Liu , Zhaohan Zhang , Yichen Wang , Chen Liu , Yu Lan , Chao Shen

Domain adaptive object detection (DAOD) aims to generalize detectors trained on an annotated source domain to an unlabelled target domain. However, existing methods focus on reducing the domain bias of the detection backbone by inferring a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Haochen Li , Rui Zhang , Hantao Yao , Xinkai Song , Yifan Hao , Yongwei Zhao , Ling Li , Yunji Chen

Improving model's generalizability against domain shifts is crucial, especially for safety-critical applications such as autonomous driving. Real-world domain styles can vary substantially due to environment changes and sensor noises, but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Qi Fan , Mattia Segu , Yu-Wing Tai , Fisher Yu , Chi-Keung Tang , Bernt Schiele , Dengxin Dai

Deterministic policy gradient (DPG) is widely utilized for continuous control; however, it inherently relies on the differentiability of the critic with respect to the action during policy updates. This assumption is violated in practical…

Machine Learning · Computer Science 2026-05-08 Hyunjun Na , Donghwan Lee

Domain-general semantic parsing is a long-standing goal in natural language processing, where the semantic parser is capable of robustly parsing sentences from domains outside of which it was trained. Current approaches largely rely on…

Computation and Language · Computer Science 2022-02-10 Abulhair Saparov

Recent advances in diffusion models attempt to handle conditional generative tasks by utilizing a differentiable loss function for guidance without the need for additional training. While these methods achieved certain success, they often…

Machine Learning · Computer Science 2024-07-08 Lingxiao Yang , Shutong Ding , Yifan Cai , Jingyi Yu , Jingya Wang , Ye Shi

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Domain adaption (DA) and domain generalization (DG) are two closely related methods which are both concerned with the task of assigning labels to an unlabeled data set. The only dissimilarity between these approaches is that DA can access…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

Single-domain generalization aims to learn a model from single source domain data to achieve generalized performance on other unseen target domains. Existing works primarily focus on improving the generalization ability of static networks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Deng Li , Aming Wu , Yaowei Wang , Yahong Han

LLMs are sensitive to prompting, with task performance often hinging on subtle, sometimes imperceptible variations in phrasing. As a result, crafting effective prompts manually remains challenging and time-consuming. Recent automatic…

Computation and Language · Computer Science 2025-12-01 Pawel Batorski , Paul Swoboda

Recent studies show that prompt tuning can better leverage the power of large language models than fine-tuning on downstream natural language understanding tasks. However, the existing prompt tuning methods have training instability issues,…

Computation and Language · Computer Science 2023-05-05 Lichang Chen , Heng Huang , Minhao Cheng

Domain generalization (DG) aims to learn from multiple source domains a model that can generalize well on unseen target domains. Existing DG methods mainly learn the representations with invariant marginal distribution of the input…

Machine Learning · Computer Science 2023-05-26 Junkun Yuan , Xu Ma , Ruoxuan Xiong , Mingming Gong , Xiangyu Liu , Fei Wu , Lanfen Lin , Kun Kuang

Deep learning-based semantic segmentation models achieve impressive results yet remain limited in handling distribution shifts between training and test data. In this paper, we present SDGPA (Synthetic Data Generation and Progressive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jun Luo , Zijing Zhao , Yang Liu