中文
相关论文

相关论文: Domain-Aware Fine-Tuning of Foundation Models

200 篇论文

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by…

机器学习 · 计算机科学 2017-10-11 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Although Domain Adaptation in Semantic Scene Segmentation has shown impressive improvement in recent years, the fairness concerns in the domain adaptation have yet to be well defined and addressed. In addition, fairness is one of the most…

计算机视觉与模式识别 · 计算机科学 2023-04-06 Thanh-Dat Truong , Ngan Le , Bhiksha Raj , Jackson Cothren , Khoa Luu

Previous unsupervised domain adaptation methods did not handle the cross-domain problem from the perspective of frequency for computer vision. The images or feature maps of different domains can be decomposed into the low-frequency…

计算机视觉与模式识别 · 计算机科学 2022-09-01 Zhaowen Li , Xu Zhao , Chaoyang Zhao , Ming Tang , Jinqiao Wang

Audio-Language Models (ALM) aim to be general-purpose audio models by providing zero-shot capabilities at test time. The zero-shot performance of ALM improves by using suitable text prompts for each domain. The text prompts are usually…

声音 · 计算机科学 2024-07-23 Soham Deshmukh , Rita Singh , Bhiksha Raj

Large Language Models have demonstrated remarkable progress in general-purpose capabilities and can achieve strong performance in specific domains through fine-tuning on domain-specific data. However, acquiring high-quality data for target…

人工智能 · 计算机科学 2026-05-29 Tong Ye , Hang Yu , Tengfei Ma , Xuhong Zhang , Jianguo Li , Peng Di , Peiyu Liu , Jianwei Yin , Wenhai Wang

Representation learning is the dominant technique for unsupervised domain adaptation, but existing approaches often require the specification of "pivot features" that generalize across domains, which are selected by task-specific…

计算与语言 · 计算机科学 2015-04-17 Yi Yang , Jacob Eisenstein

Standard supervised learning setting assumes that training data and test data come from the same distribution (domain). Domain generalization (DG) methods try to learn a model that when trained on data from multiple domains, would…

计算机视觉与模式识别 · 计算机科学 2020-08-18 Udit Maniyar , Joseph K J , Aniket Anand Deshmukh , Urun Dogan , Vineeth N Balasubramanian

Domain Adaptation (DA) is a highly relevant research topic when it comes to image classification with deep neural networks. Combining multiple source domains in a sophisticated way to optimize a classification model can improve the…

计算机视觉与模式识别 · 计算机科学 2020-10-19 Sebastian Schrom , Stephan Hasler , Jürgen Adamy

Recent vision foundation models can extract universal representations and show impressive abilities in various tasks. However, their application on object detection is largely overlooked, especially without fine-tuning them. In this work,…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Shenghao Fu , Junkai Yan , Qize Yang , Xihan Wei , Xiaohua Xie , Wei-Shi Zheng

Both few-shot learning and domain adaptation sub-fields in Computer Vision have seen significant recent progress in terms of the availability of state-of-the-art algorithms and datasets. Frameworks have been developed for each sub-field;…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Bharadwaj Ravichandran , Alexander Lynch , Sarah Brockman , Brandon RichardWebster , Dawei Du , Anthony Hoogs , Christopher Funk

Few-shot object detection (FSOD) has thrived in recent years to learn novel object classes with limited data by transferring knowledge gained on abundant base classes. FSOD approaches commonly assume that both the scarcely provided examples…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Karim Guirguis , George Eskandar , Matthias Kayser , Bin Yang , Juergen Beyerer

Over the last few years, Unsupervised Domain Adaptation (UDA) techniques have acquired remarkable importance and popularity in computer vision. However, when compared to the extensive literature available for images, the field of videos is…

计算机视觉与模式识别 · 计算机科学 2022-07-27 Victor G. Turrisi da Costa , Giacomo Zara , Paolo Rota , Thiago Oliveira-Santos , Nicu Sebe , Vittorio Murino , Elisa Ricci

There has been a tremendous progress in Domain Adaptation (DA) for visual recognition tasks. Particularly, open-set DA has gained considerable attention wherein the target domain contains additional unseen categories. Existing open-set DA…

计算机视觉与模式识别 · 计算机科学 2020-04-10 Jogendra Nath Kundu , Naveen Venkat , Ambareesh Revanur , Rahul M , R. Venkatesh Babu

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

机器学习 · 统计学 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

The deep learning field is converging towards the use of general foundation models that can be easily adapted for diverse tasks. While this paradigm shift has become common practice within the field of natural language processing, progress…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Joana Palés Huix , Adithya Raju Ganeshan , Johan Fredin Haslum , Magnus Söderberg , Christos Matsoukas , Kevin Smith

For models to generalize under unseen domains (a.k.a domain generalization), it is crucial to learn feature representations that are domain-agnostic and capture the underlying semantics that makes up an object category. Recent advances…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Puneet Mangla , Shivam Chandhok , Milan Aggarwal , Vineeth N Balasubramanian , Balaji Krishnamurthy

Unsupervised domain adaptation (UDA) is important for applications where large scale annotation of representative data is challenging. For semantic segmentation in particular, it helps deploy on real "target domain" data models that are…

计算机视觉与模式识别 · 计算机科学 2019-08-20 Tuan-Hung Vu , Himalaya Jain , Maxime Bucher , Matthieu Cord , Patrick Pérez

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

Zero-shot learning aims at recognizing unseen classes (no training example) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, i.e.,…

计算机视觉与模式识别 · 计算机科学 2020-05-01 Jingcai Guo , Song Guo

MLP-like models built entirely upon multi-layer perceptrons have recently been revisited, exhibiting the comparable performance with transformers. It is one of most promising architectures due to the excellent trade-off between network…

计算机视觉与模式识别 · 计算机科学 2022-03-25 Kecheng Zheng , Yang Cao , Kai Zhu , Ruijing Zhao , Zheng-Jun Zha