English
Related papers

Related papers: Tuning Vision Foundation Model via Test-Time Promp…

200 papers

Foundation models encompass an extensive knowledge base and offer remarkable transferability. However, this knowledge becomes outdated or insufficient over time. The challenge lies in continuously updating foundation models to accommodate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenxuan Zhang , Paul Janson , Rahaf Aljundi , Mohamed Elhoseiny

Few-shot learning has been studied to adapt models to tasks with very few samples. It holds profound significance, particularly in clinical tasks, due to the high annotation cost of medical images. Several works have explored few-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Kaipeng Zheng , Weiran Huang , Lichao Sun

Few-shot segmentation~(FSS) performance has been extensively promoted by introducing episodic training and class-wise prototypes. However, the FSS problem remains challenging due to three limitations: (1) Models are distracted by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Jian-Wei Zhang , Lei Lv , Yawei Luo , Hao-Zhe Feng , Yi Yang , Wei Chen

Deep learning methods have been shown to be effective for the automatic segmentation of structures and pathologies in medical imaging. However, they require large annotated datasets, whose manual segmentation is a tedious and time-consuming…

Image and Video Processing · Electrical Eng. & Systems 2022-09-27 Bella Specktor Fadida , Daphna Link Sourani , Liat Ben Sira Elka Miller , Dafna Ben Bashat , Leo Joskowicz

Incremental Few-Shot Semantic Segmentation (iFSS) tackles a task that requires a model to continually expand its segmentation capability on novel classes using only a few annotated examples. Typical incremental approaches encounter a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Wenbo Xu , Yanan Wu , Haoran Jiang , Yang Wang , Qiang Wu , Jian Zhang

Vision Foundation Models (VFMs) are large-scale, pre-trained models that serve as general-purpose backbones for various computer vision tasks. As VFMs' popularity grows, there is an increasing interest in understanding their effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Volodymyr Havrylov , Haiwen Huang , Dan Zhang , Andreas Geiger

Semi-supervised learning (SSL) has become a promising solution to alleviate the annotation burden of deep learning-based medical image segmentation models. While recent advances in foundation model-driven SSL have pushed the boundary to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yichi Zhang , Le Xue , Bichun Xu , Judong Luo , Zhigang Wu , Yu Fu , Zixin Hu , Yuan Cheng , Yuan Qi

An old-school recipe for training a classifier is to (i) learn a good feature extractor and (ii) optimize a linear layer atop. When only a handful of samples are available per category, as in Few-Shot Adaptation (FSA), data are insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Matteo Farina , Massimiliano Mancini , Giovanni Iacca , Elisa Ricci

The current modus operandi in adapting pre-trained models involves updating all the backbone parameters, ie, full fine-tuning. This paper introduces Visual Prompt Tuning (VPT) as an efficient and effective alternative to full fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Menglin Jia , Luming Tang , Bor-Chun Chen , Claire Cardie , Serge Belongie , Bharath Hariharan , Ser-Nam Lim

Foundation models encode rich representations that can be adapted to downstream tasks by fine-tuning. However, fine-tuning a model on one data distribution often degrades performance under distribution shifts. Current approaches to robust…

Machine Learning · Computer Science 2024-03-15 Caroline Choi , Yoonho Lee , Annie Chen , Allan Zhou , Aditi Raghunathan , Chelsea Finn

The demand for high-resolution subsurface imaging and continuous Earth monitoring has driven rapid growth in active and passive seismic data from dense geophone deployments, distributed acoustic sensing (DAS) arrays, and large-scale 2D and…

Geophysics · Physics 2026-05-13 Jiahua Zhao , Umair bin Waheed , Jing Sun , Yang Cui , Nikos Savva , Eric Verschuur

Source-free test-time adaptation for medical image segmentation aims to enhance the adaptability of segmentation models to diverse and previously unseen test sets of the target domain, which contributes to the generalizability and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Yanyu Ye , Zhenxi Zhang , Wei Wei , Chunna Tian

Few-Shot Segmentation (FSS) aims to segment novel classes using only a few annotated images. Despite considerable progress under pixel-wise support annotation, current FSS methods still face three issues: the inflexibility of backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shuai Chen , Fanman Meng , Chenhao Wu , Haoran Wei , Runtong Zhang , Qingbo Wu , Linfeng Xu , Hongliang Li

Accurate visual fault detection in freight trains remains a critical challenge for intelligent transportation system maintenance, due to complex operational environments, structurally repetitive components, and frequent occlusions or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guodong Sun , Qihang Liang , Xingyu Pan , Moyun Liu , Yang Zhang

Foundation models have become a promising paradigm for advancing medical image analysis, particularly for segmentation tasks where downstream applications often emerge sequentially. Existing fine-tuning strategies, however, remain limited:…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Yiwen Ye , Yicheng Wu , Xiangde Luo , He Zhang , Ziyang Chen , Ting Dang , Yanning Zhang , Yong Xia

Vision foundation models (VFMs) such as DINOv2 and CLIP have achieved impressive results on various downstream tasks, but their limited feature resolution hampers performance in applications requiring pixel-level understanding. Feature…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Haiwen Huang , Anpei Chen , Volodymyr Havrylov , Andreas Geiger , Dan Zhang

Recently, Vision-Language foundation models like CLIP and ALIGN, which are pre-trained on large-scale data have shown remarkable zero-shot generalization to diverse datasets with different classes and even domains. In this work, we take a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Debarshi Brahma , Anuska Roy , Soma Biswas

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Vision Foundation Models (VFMs) have become a de facto choice for many downstream vision tasks, like image classification, image segmentation, and object localization. However, they can also provide significant utility for downstream 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Johannes Spoecklberger , Wei Lin , Pedro Hermosilla , Sivan Doveh , Horst Possegger , M. Jehanzeb Mirza

Fine-tuning plays a crucial role in adapting models to downstream tasks with minimal training efforts. However, the rapidly increasing size of foundation models poses a daunting challenge for accommodating foundation model fine-tuning in…

Machine Learning · Computer Science 2025-04-18 Shiwei Ding , Lan Zhang , Zhenlin Wang , Giuseppe Ateniese , Xiaoyong Yuan