English
Related papers

Related papers: Active Prompt Learning in Vision Language Models

200 papers

In this work, we propose a training-free method to inject visual prompts into Multimodal Large Language Models (MLLMs) through test-time optimization of a learnable latent variable. We observe that attention, as the core module of MLLMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Mingrui Wu , Xinyue Cai , Jiayi Ji , Jiale Li , Oucheng Huang , Gen Luo , Hao Fei , Guannan Jiang , Xiaoshuai Sun , Rongrong Ji

Active learning (AL) has emerged as a crucial methodology for minimizing labeling costs in deep learning by selecting the most valuable samples from a pool of unlabeled data for annotation. Traditional AL operates under a closed-set…

Machine Learning · Computer Science 2026-04-23 Zongyao Lyu , William J. Beksi

The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Felix Buchert , Nassir Navab , Seong Tae Kim

Active learning is typically used to label data, when the labeling process is expensive. Several active learning algorithms have been theoretically proved to perform better than their passive counterpart. However, these algorithms rely on…

Machine Learning · Computer Science 2021-02-23 Boris Ndjia Njike , Xavier Siebert

Attribute labeling at large scale is typically incomplete and partial, posing significant challenges to model optimization. Existing attribute learning methods often treat the missing labels as negative or simply ignore them all during…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Kongming Liang , Xinran Wang , Rui Wang , Donghui Gao , Ling Jin , Weidong Liu , Xiatian Zhu , Zhanyu Ma , Jun Guo

Most visual recognition studies rely heavily on crowd-labelled data in deep neural networks (DNNs) training, and they usually train a DNN for each single visual recognition task, leading to a laborious and time-consuming visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Jingyi Zhang , Jiaxing Huang , Sheng Jin , Shijian Lu

We revisit and advance visual prompting (VP), an input prompting technique for vision tasks. VP can reprogram a fixed, pre-trained source model to accomplish downstream tasks in the target domain by simply incorporating universal prompts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Aochuan Chen , Yuguang Yao , Pin-Yu Chen , Yihua Zhang , Sijia Liu

Though quite challenging, leveraging large-scale unlabeled or partially labeled data in learning systems (e.g., model/classifier training) has attracted increasing attentions due to its fundamental importance. To address this problem, many…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Keze Wang , Liang Lin , Xiaopeng Yan , Ziliang Chen , Dongyu Zhang , Lei Zhang

While training models and labeling data are resource-intensive, a wealth of pre-trained models and unlabeled data exists. To effectively utilize these resources, we present an approach to actively select pre-trained models while minimizing…

Machine Learning · Computer Science 2025-02-11 Xuefeng Liu , Fangfang Xia , Rick L. Stevens , Yuxin Chen

The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched…

Wildlife camera trap images are being used extensively to investigate animal abundance, habitat associations, and behavior, which is complicated by the fact that experts must first classify the images manually. Artificial intelligence…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Ludwig Bothmann , Lisa Wimmer , Omid Charrakh , Tobias Weber , Hendrik Edelhoff , Wibke Peters , Hien Nguyen , Caryl Benjamin , Annette Menzel

Class-incremental learning requires a learning system to continually learn knowledge of new classes and meanwhile try to preserve previously learned knowledge of old classes. As current state-of-the-art methods based on Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jiantao Tan , Peixian Ma , Tong Yu , Wentao Zhang , Ruixuan Wang

Active learning (AL) optimizes data labeling efficiency by selecting the most informative instances for annotation. A key component in this procedure is an acquisition function that guides the selection process and identifies the suitable…

Machine Learning · Computer Science 2024-10-08 Abdul Hameed Azeemi , Ihsan Ayyub Qazi , Agha Ali Raza

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

An active learner is given a class of models, a large set of unlabeled examples, and the ability to interactively query labels of a subset of these examples; the goal of the learner is to learn a model in the class that fits the data well.…

Machine Learning · Computer Science 2015-06-09 Kamalika Chaudhuri , Sham Kakade , Praneeth Netrapalli , Sujay Sanghavi

Learning from noisy labels (LNL) is a challenge that arises in many real-world scenarios where collected training data can contain incorrect or corrupted labels. Most existing solutions identify noisy labels and adopt active learning to…

Machine Learning · Computer Science 2025-04-07 Bo Yuan , Yulin Chen , Yin Zhang , Wei Jiang

This paper proposes a novel framework for multi-label image recognition without any training data, called data-free framework, which uses knowledge of pre-trained Large Language Model (LLM) to learn prompts to adapt pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shuo Yang , Zirui Shang , Yongqi Wang , Derong Deng , Hongwei Chen , Qiyuan Cheng , Xinxiao Wu

In recent years, there has been a surge in research on Question Difficulty Estimation (QDE) using natural language processing techniques. Transformer-based neural networks achieve state-of-the-art performance, primarily through supervised…

Machine Learning · Computer Science 2024-10-11 Arthur Thuy , Ekaterina Loginova , Dries F. Benoit

Prompt tuning for pre-trained masked language models (MLM) has shown promising performance in natural language processing tasks with few labeled examples. It tunes a prompt for the downstream task, and a verbalizer is used to bridge the…

Computation and Language · Computer Science 2024-03-22 Weisen Jiang , Yu Zhang , James T. Kwok

Neural coreference resolution models trained on one dataset may not transfer to new, low-resource domains. Active learning mitigates this problem by sampling a small subset of data for annotators to label. While active learning is…

Computation and Language · Computer Science 2022-03-30 Michelle Yuan , Patrick Xia , Chandler May , Benjamin Van Durme , Jordan Boyd-Graber
‹ Prev 1 8 9 10 Next ›