English
Related papers

Related papers: Singular Value Fine-tuning: Few-shot Segmentation …

200 papers

Just like other few-shot learning problems, few-shot segmentation aims to minimize the need for manual annotation, which is particularly costly in segmentation tasks. Even though the few-shot setting reduces this cost for novel test…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mustafa Sercan Amac , Ahmet Sencan , Orhun Bugra Baran , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

Recent work has shown that label-efficient few-shot learning through self-supervision can achieve promising medical image segmentation results. However, few-shot segmentation models typically rely on prototype representations of the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Stine Hansen , Srishti Gautam , Robert Jenssen , Michael Kampffmeyer

Unlike the field of visual scene recognition where tremendous advances have taken place due to the availability of very large datasets to train deep neural networks, inference from medical images is often hampered by the fact that only…

Numerical Analysis · Mathematics 2023-06-21 Jiahui Liu , Keqiang Fan , Xiaohao Cai , Mahesan Niranjan

Recent advances in fine-tuning Vision-Language Models (VLMs) have witnessed the success of prompt tuning and adapter tuning, while the classic model fine-tuning on inherent parameters seems to be overlooked. It is believed that fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Li , Jike Zhong , Chenxin Li , Liuzhuozheng Li , Nie Lin , Masashi Sugiyama

Deployment of deep neural networks in real-world settings typically requires adaptation to new tasks with few examples. Few-shot classification (FSC) provides a solution to this problem by leveraging pre-trained backbones for fast…

Machine Learning · Computer Science 2025-03-19 Rui Li , Martin Trapp , Marcus Klasson , Arno Solin

Integrating new class information without losing previously acquired knowledge remains a central challenge in artificial intelligence, often referred to as catastrophic forgetting. Few-shot class incremental learning (FSCIL) addresses this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Kyle Stein , Andrew Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Popular PEFT methods reduce trainable parameter count for fine-tuning by parameterizing new low-rank or sparse trainable weights in parallel to the frozen pre-trained weights $W$. However, these weights are trained from scratch, and there…

Machine Learning · Computer Science 2025-08-15 Suhas G Hegde , Shilpy Kaur , Aruna Tiwari

Vision-language models (VLMs) like CLIP have shown impressive zero-shot and few-shot learning capabilities across diverse applications. However, adapting these models to new fine-grained domains remains difficult due to reliance on prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Taha Koleilat , Hassan Rivaz , Yiming Xiao

Popular parameter-efficient fine-tuning (PEFT) methods, such as LoRA and its variants, freeze pre-trained model weights \(W\) and inject learnable matrices \(\Delta W\). These \(\Delta W\) matrices are structured for efficient…

Current few-shot learning models capture visual object relations in the so-called meta-learning setting under a fixed-resolution input. However, such models have a limited generalization ability under the scale and location mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongguang Zhang , Philip H. S. Torr , Piotr Koniusz

Fine-grained few-shot recognition often suffers from the problem of training data scarcity for novel categories.The network tends to overfit and does not generalize well to unseen classes due to insufficient training data. Many methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jingyi Xu , Hieu Le , Mingzhen Huang , ShahRukh Athar , Dimitris Samaras

Domain generalization (DG) aims to adapt a model using one or multiple source domains to ensure robust performance in unseen target domains. Recently, Parameter-Efficient Fine-Tuning (PEFT) of foundation models has shown promising results…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Seokju Yun , Seunghye Chae , Dongheon Lee , Youngmin Ro

Few-shot segmentation aims to devise a generalizing model that segments query images from unseen classes during training with the guidance of a few support images whose class tally with the class of the query. There exist two…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Alper Kayabaşı , Gülin Tüfekci , İlkay Ulusoy

Few-shot segmentation aims at assigning a category label to each image pixel with few annotated samples. It is a challenging task since the dense prediction can only be achieved under the guidance of latent features defined by sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Kai Zhu , Wei Zhai , Zheng-Jun Zha , Yang Cao

Few-shot semantic segmentation (FSS) is a crucial challenge in computer vision, driving extensive research into a diverse range of methods, from advanced meta-learning techniques to simple transfer learning baselines. With the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Reda Bensaid , Vincent Gripon , François Leduc-Primeau , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux

The impressive performance of deep convolutional neural networks in single-view 3D reconstruction suggests that these models perform non-trivial reasoning about the 3D structure of the output space. However, recent work has challenged this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Mateusz Michalkiewicz , Sarah Parisot , Stavros Tsogkas , Mahsa Baktashmotlagh , Anders Eriksson , Eugene Belilovsky

Few-shot segmentation (FSS) has gained significant attention for its ability to generalize to novel classes with limited supervision, yet remains challenged by structural misalignment and cross-view inconsistency under large appearance or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hongli Liu , Yu Wang , Shengjie Zhao

The goal of few-shot learning is to learn a classifier that can recognize unseen classes from limited support data with labels. A common practice for this task is to train a model on the base set first and then transfer to novel classes…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Zhiqiang Shen , Zechun Liu , Jie Qin , Marios Savvides , Kwang-Ting Cheng

Advancements in open-source pre-trained backbones make it relatively easy to fine-tune a model for new tasks. However, this lowered entry barrier poses potential risks, e.g., bad actors developing models for harmful applications. A question…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Amber Yijia Zheng , Chiao-An Yang , Raymond A. Yeh

Few-shot image classification aims to accurately classify unlabeled images using only a few labeled samples. The state-of-the-art solutions are built by deep learning, which focuses on designing increasingly complex deep backbones.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Na Chen , Xianming Kuang , Feiyu Liu , Kehao Wang , Qun Chen