English
Related papers

Related papers: Rethinking Cross-Modal Fine-Tuning: Optimizing the…

200 papers

Though semantic segmentation has been heavily explored in vision literature, unique challenges remain in the remote sensing domain. One such challenge is how to handle resolution mismatch between overhead imagery and ground-truth label…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Scott Workman , Armin Hadzic , M. Usman Rafique

We study a problem of best-effort adaptation motivated by several applications and considerations, which consists of determining an accurate predictor for a target domain, for which a moderate amount of labeled samples are available, while…

Machine Learning · Computer Science 2023-05-11 Pranjal Awasthi , Corinna Cortes , Mehryar Mohri

Large Language Models (LLMs) have shown great potential in intelligent visualization systems, especially for domain-specific applications. Integrating LLMs into visualization systems presents challenges, and we categorize these challenges…

Human-Computer Interaction · Computer Science 2024-07-31 Lin Gao , Jing Lu , Zekai Shao , Ziyue Lin , Shengbin Yue , Chiokit Ieong , Yi Sun , Rory James Zauner , Zhongyu Wei , Siming Chen

Despite recent advances in end-to-end speech recognition methods, their output is biased to the training data's vocabulary, resulting in inaccurate recognition of unknown terms or proper nouns. To improve the recognition accuracy for a…

Computation and Language · Computer Science 2024-06-24 Yu Nakagome , Michael Hentschel

Feature matching is a cornerstone task in computer vision, essential for applications such as image retrieval, stereo matching, 3D reconstruction, and SLAM. This survey comprehensively reviews modality-based feature matching, exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Weide Liu , Wei Zhou , Jun Liu , Ping Hu , Jun Cheng , Jungong Han , Weisi Lin

Fine-tuning is the primary mechanism for adapting foundation models to downstream tasks; however, standard approaches largely optimize task objectives in isolation and do not account for secondary yet critical alignment objectives (e.g.,…

Machine Learning · Computer Science 2026-02-06 Gaurav Bhatt , Aditya Chinchure , Jiawei Zhou , Leonid Sigal

Precise action spotting has attracted considerable attention due to its promising applications. While existing methods achieve substantial performance by employing well-designed model architecture, they overlook a significant challenge: the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Masato Tamura

Although the pre-training followed by fine-tuning paradigm is used extensively in many fields, there is still some controversy surrounding the impact of pre-training on the fine-tuning process. Currently, experimental findings based on text…

Machine Learning · Computer Science 2023-09-12 Jiashu Pu , Shiwei Zhao , Ling Cheng , Yongzhu Chang , Runze Wu , Tangjie Lv , Rongsheng Zhang

A recent study finds that existing few-shot learning methods, trained on the source domain, fail to generalize to the novel target domain when a domain gap is observed. This motivates the task of Cross-Domain Few-Shot Learning (CD-FSL). In…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Yuqian Fu , Yanwei Fu , Yu-Gang Jiang

The pretraining-fine-tuning paradigm has been the de facto strategy for transfer learning in modern language modeling. With the understanding that task adaptation in LMs is often a function of parameters shared across tasks, we argue that a…

Computation and Language · Computer Science 2024-06-24 Mandar Sharma , Nikhil Muralidhar , Shengzhe Xu , Raquib Bin Yousuf , Naren Ramakrishnan

Modeling label correlations has always played a pivotal role in multi-label image classification (MLC), attracting significant attention from researchers. However, recent studies have overemphasized co-occurrence relationships among labels,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 LeiLei Ma , Shuo Xu , MingKun Xie , Lei Wang , Dengdi Sun , Haifeng Zhao

In recent years, pre-trained visual-linguistic models have demonstrated tremendous potential, becoming a crucial foundational framework for numerous downstream tasks. However, the information density between text and images is not uniformly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Mengyuan Tian , Qiyan Zhao , Yanan Wang , Da-Han Wang

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

Machine Learning · Computer Science 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

Partial domain adaptation aims to adapt knowledge from a larger and more diverse source domain to a smaller target domain with less number of classes, which has attracted appealing attention. Recent practice on domain adaptation manages to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Taotao Jing , Ming Shao , Zhengming Ding

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Unsupervised domain adaptation aims to train a classification model from the labeled source domain for the unlabeled target domain. Since the data distributions of the two domains are different, the model often performs poorly on the target…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Jieren Cheng , Le Liu , Xiangyan Tang , Wenxuan Tu , Boyi Liu , Ke Zhou , Qiaobo Da , Yue Yang

Pre-trained vision-language models (VLMs) exhibit strong zero-shot generalization but remain vulnerable to adversarial perturbations. Existing classification-guided adversarial fine-tuning methods often disrupt pre-trained cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yubo Cui , Xianchao Guan , Zijun Xiong , Zheng Zhang

Few-shot fine-tuning and in-context learning are two alternative strategies for task adaptation of pre-trained language models. Recently, in-context learning has gained popularity over fine-tuning due to its simplicity and improved…

Computation and Language · Computer Science 2023-05-31 Marius Mosbach , Tiago Pimentel , Shauli Ravfogel , Dietrich Klakow , Yanai Elazar

Model editing, the process of efficiently modifying factual knowledge in pre-trained language models, is critical for maintaining their accuracy and relevance. However, existing editing methods often introduce unintended side effects,…

Computation and Language · Computer Science 2025-09-23 Tsung-Hsuan Pan , Chung-Chi Chen , Hen-Hsen Huang , Hsin-Hsi Chen