English
Related papers

Related papers: Preserving Domain Generalization in Fine-Tuning vi…

200 papers

Although deep networks have significantly increased the performance of visual recognition methods, it is still challenging to achieve the robustness across visual domains that is necessary for real-world applications. To tackle this issue,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Antonio D'Innocente , Silvia Bucci , Barbara Caputo , Tatiana Tommasi

Feature selection with specific multivariate performance measures is the key to the success of many applications, such as image retrieval and text classification. The existing feature selection methods are usually designed for…

Machine Learning · Computer Science 2015-03-19 Qi Mao , Ivor W. Tsang

This paper introduces a concept of neural network specialization via task-specific domain constraining, aimed at enhancing network performance on data subspace in which the network operates. The study presents experiments on training…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Roman Malashin , Daniil Ilyukhin

In autonomous driving, 3D object detection is essential for accurately identifying and tracking objects. Despite the continuous development of various technologies for this task, a significant drawback is observed in most of them-they…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Hsin-Cheng Lu , Chung-Yi Lin , Winston H. Hsu

Segment Anything Model (SAM) has received remarkable attention as it offers a powerful and versatile solution for object segmentation in images. However, fine-tuning SAM for downstream segmentation tasks under different scenarios remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zelin Peng , Zhengqin Xu , Zhilin Zeng , Xiaokang Yang , Wei Shen

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Large Language Models have demonstrated remarkable progress in general-purpose capabilities and can achieve strong performance in specific domains through fine-tuning on domain-specific data. However, acquiring high-quality data for target…

Artificial Intelligence · Computer Science 2026-05-29 Tong Ye , Hang Yu , Tengfei Ma , Xuhong Zhang , Jianguo Li , Peng Di , Peiyu Liu , Jianwei Yin , Wenhai Wang

When fine-tuning Deep Neural Networks (DNNs) to new data, DNNs are prone to overwriting network parameters required for task-specific functionality on previously learned tasks, resulting in a loss of performance on those tasks. We propose…

Machine Learning · Computer Science 2025-01-22 Christopher Angelini , Nidhal Bouaynaya

Semantic segmentation is a critical step in automated image interpretation and analysis where pixels are classified into one or more predefined semantically meaningful classes. Deep learning approaches for semantic segmentation rely on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Tushar Kataria , Beatrice Knudsen , Shireen Elhabian

Domain generalization (DG) aims to adapt a model using one or multiple source domains to ensure robust performance in unseen target domains. Recently, Parameter-Efficient Fine-Tuning (PEFT) of foundation models has shown promising results…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Seokju Yun , Seunghye Chae , Dongheon Lee , Youngmin Ro

Despite impressive progress in deep learning, generalizing far beyond the training distribution is an important open challenge. In this work, we consider few-shot classification, and aim to shed light on what makes some novel classes easier…

Machine Learning · Computer Science 2022-05-31 Mengye Ren , Eleni Triantafillou , Kuan-Chieh Wang , James Lucas , Jake Snell , Xaq Pitkow , Andreas S. Tolias , Richard Zemel

3D human pose data collected in controlled laboratory settings present challenges for pose estimators that generalize across diverse scenarios. To address this, domain generalization is employed. Current methodologies in domain…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Qucheng Peng , Ce Zheng , Chen Chen

Parameter-efficient fine-tuning (PEFT) has become increasingly important as foundation models continue to grow in both popularity and size. Adapter has been particularly well-received due to their potential for parameter reduction and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Minglei Li , Peng Ye , Yongqi Huang , Lin Zhang , Tao Chen , Tong He , Jiayuan Fan , Wanli Ouyang

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

Universal domain adaptation aims to align the classes and reduce the feature gap between the same category of the source and target domains. The target private category is set as the unknown class during the adaptation process, as it is not…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yuxiang Lai , Yi Zhou , Xinghong Liu , Tao Zhou

Pruning methods have recently grown in popularity as an effective way to reduce the size and computational complexity of deep neural networks. Large numbers of parameters can be removed from trained models with little discernible loss in…

Machine Learning · Computer Science 2024-01-18 Tim Whitaker , Darrell Whitley

Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Xiaotong Li , Zixuan Hu , Jun Liu , Yixiao Ge , Yongxing Dai , Ling-Yu Duan

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan

Domain generalization typically requires data from multiple source domains for model learning. However, such strong assumption may not always hold in practice, especially in medical field where the data sharing is highly concerned and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Quande Liu , Cheng Chen , Qi Dou , Pheng-Ann Heng

Pedestrian detection is the cornerstone of many vision based applications, starting from object tracking to video surveillance and more recently, autonomous driving. With the rapid development of deep learning in object detection,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Irtiza Hasan , Shengcai Liao , Jinpeng Li , Saad Ullah Akram , Ling Shao