English
Related papers

Related papers: DARA: Domain- and Relation-aware Adapters Make Par…

200 papers

Deep learning-based domain adaptation (DA) methods have shown strong performance by learning transferable representations. However, their reliance on mini-batch training limits global distribution modeling, leading to unstable alignment and…

Machine Learning · Computer Science 2025-11-18 Lingkun Luo , Shiqiang Hu , Liming Chen

Following language instructions to navigate in unseen environments is a challenging task for autonomous embodied agents. With strong representation capabilities, pretrained vision-and-language models are widely used in VLN. However, most of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Ting Liu , Yue Hu , Wansen Wu , Youkai Wang , Kai Xu , Quanjun Yin

With the scale of vision Transformer-based models continuing to grow, finetuning these large-scale pretrained models for new tasks has become increasingly parameter-intensive. Visual prompt tuning is introduced as a parameter-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Runjia Zeng , Cheng Han , Qifan Wang , Chunshu Wu , Tong Geng , Lifu Huang , Ying Nian Wu , Dongfang Liu

Adapting pre-trained vision models using parameter-efficient fine-tuning (PEFT) remains challenging, as it aims to achieve performance comparable to full fine-tuning using a minimal number of trainable parameters. When applied to complex…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Meng Lou , Stanley Yu , Yizhou Yu

Vision-language pre-training (VLP) has recently proven highly effective for various uni- and multi-modal downstream applications. However, most existing end-to-end VLP methods use high-resolution image-text box data to perform well on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shraman Pramanick , Li Jing , Sayan Nag , Jiachen Zhu , Hardik Shah , Yann LeCun , Rama Chellappa

Vision-Language-Action (VLA) models typically bridge the gap between perceptual and action spaces by pre-training a large-scale Vision-Language Model (VLM) on robotic data. While this approach greatly enhances performance, it also incurs…

Current deep domain adaptation methods used in computer vision have mainly focused on learning discriminative and domain-invariant features across different domains. In this paper, we present a novel "deep adversarial transition learning"…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jinyong Hou , Xuejie Ding , Stephen Cranefield , Jeremiah D. Deng

Models should be able to adapt to unseen data during test-time to avoid performance drops caused by inevitable distribution shifts in real-world deployment scenarios. In this work, we tackle the practical yet challenging test-time…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yunhe Gao , Xingjian Shi , Yi Zhu , Hao Wang , Zhiqiang Tang , Xiong Zhou , Mu Li , Dimitris N. Metaxas

Domain adaption (DA) allows machine learning methods trained on data sampled from one distribution to be applied to data sampled from another. It is thus of great practical importance to the application of such methods. Despite the fact…

Computer Vision and Pattern Recognition · Computer Science 2017-07-20 Hao Lu , Lei Zhang , Zhiguo Cao , Wei Wei , Ke Xian , Chunhua Shen , Anton van den Hengel

Parameter-efficient fine-tuning (PEFT) methods, such as LoRA, DoRA, and HiRA, enable lightweight adaptation of large pre-trained models via low-rank updates. However, existing PEFT approaches apply static, input-agnostic updates to all…

Machine Learning · Computer Science 2025-12-23 Jie Ou , Shuaihong Jiang , Yingjun Du , Cees G. M. Snoek

The Segment Anything Model (SAM) has emerged as a powerful visual foundation model for image segmentation. However, adapting SAM to specific downstream tasks, such as medical and agricultural imaging, remains a significant challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Renqi Chen , Haoyang Su , Shixiang Tang

Unsupervised domain adaptation (UDA) is important for applications where large scale annotation of representative data is challenging. For semantic segmentation in particular, it helps deploy on real "target domain" data models that are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tuan-Hung Vu , Himalaya Jain , Maxime Bucher , Matthieu Cord , Patrick Pérez

Domain generalization (DG) aims to avoid the performance degradation of the model when the distribution shift between the limited training data and unseen test data occurs. Recently, foundation models with enormous parameters have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiajun Hu , Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Domain adaptation (DA) enables knowledge transfer from a labeled source domain to an unlabeled target domain by reducing the cross-domain distribution discrepancy. Most prior DA approaches leverage complicated and powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuang Li , Jinming Zhang , Wenxuan Ma , Chi Harold Liu , Wei Li

Domain generalization (DG) remains a significant challenge for perception based on deep neural networks (DNNs), where domain shifts occur due to synthetic data, lighting, weather, or location changes. Vision-language models (VLMs) marked a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Christoph Hümmer , Manuel Schwonberg , Liangwei Zhou , Hu Cao , Alois Knoll , Hanno Gottschalk

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

While retrieval-augmented generation (RAG) has been shown to enhance factuality of large language model (LLM) outputs, LLMs still suffer from hallucination, generating incorrect or irrelevant information. A common detection strategy…

Computation and Language · Computer Science 2025-03-17 Tobias Leemann , Periklis Petridis , Giuseppe Vietri , Dionysis Manousakas , Aaron Roth , Sergul Aydore

Pivot-based neural representation models have lead to significant progress in domain adaptation for NLP. However, previous works that follow this approach utilize only labeled data from the source domain and unlabeled data from the source…

Computation and Language · Computer Science 2020-06-17 Eyal Ben-David , Carmel Rabinovitz , Roi Reichart

Pre-training & fine-tuning can enhance the transferring efficiency and performance in visual tasks. Recent delta-tuning methods provide more options for visual classification tasks. Despite their success, existing visual delta-tuning art…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Dongshuo Yin , Leiyi Hu , Bin Li , Youqun Zhang , Xue Yang

Source-free domain adaptation (SFDA) aims to adapt a model trained in the source domain to perform well in the target domain, with only unlabeled target domain data and the source model. Taking into account that conventional SFDA methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zheang Huai , Hui Tang , Hualiang Wang , Xiaomeng Li