English
Related papers

Related papers: Prompt-and-Transfer: Dynamic Class-aware Enhanceme…

200 papers

Pre-trained large language models can efficiently interpolate human-written prompts in a natural way. Multitask prompted learning can help generalization through a diverse set of tasks at once, thus enhancing the potential for more…

Computation and Language · Computer Science 2022-12-22 M Saiful Bari , Aston Zhang , Shuai Zheng , Xingjian Shi , Yi Zhu , Shafiq Joty , Mu Li

We study the problem of few-shot graph classification across domains with nonequivalent feature spaces by introducing three new cross-domain benchmarks constructed from publicly available datasets. We also propose an attention-based graph…

Machine Learning · Computer Science 2022-01-21 Kaveh Hassani

Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed with the common aim of transferring knowledge acquired on a previously…

Machine Learning · Computer Science 2021-10-19 Yuqing Hu , Vincent Gripon , Stéphane Pateux

A few-shot semantic segmentation model is typically composed of a CNN encoder, a CNN decoder and a simple classifier (separating foreground and background pixels). Most existing methods meta-learn all three model components for fast…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Zhihe Lu , Sen He , Xiatian Zhu , Li Zhang , Yi-Zhe Song , Tao Xiang

Event detection (ED) is aimed to identify the key trigger words in unstructured text and predict the event types accordingly. Traditional ED models are too data-hungry to accommodate real applications with scarce labeled data. Besides,…

Computation and Language · Computer Science 2023-05-17 Siyuan Wang , Jianming Zheng , Xuejun Hu , Fei Cai , Chengyu Song , Xueshan Luo

In the evolving landscape of machine learning, the adaptation of pre-trained models through prompt tuning has become increasingly prominent. This trend is particularly observable in the graph domain, where diverse pre-training strategies…

Machine Learning · Computer Science 2026-05-18 Junhyun Lee , Wooseong Yang , Jaewoo Kang

Prompting methods recently achieve impressive success in few-shot learning. These methods modify input samples with prompt sentence pieces, and decode label tokens to map samples to corresponding labels. However, such a paradigm is very…

Computation and Language · Computer Science 2022-04-05 Yutai Hou , Cheng Chen , Xianzhen Luo , Bohan Li , Wanxiang Che

Prompt tuning, a parameter- and data-efficient transfer learning paradigm that tunes only a small number of parameters in a model's input space, has become a trend in the vision community since the emergence of large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yuhang Zang , Wei Li , Kaiyang Zhou , Chen Huang , Chen Change Loy

The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challenging for existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Qin Liu , Jaemin Cho , Mohit Bansal , Marc Niethammer

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

Vision Transformer (ViT) models have recently emerged as powerful and versatile models for various visual tasks. Recently, a work called PMF has achieved promising results in few-shot image classification by utilizing pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Junjie Zhu , Yiying Li , Chunping Qiu , Ke Yang , Naiyang Guan , Xiaodong Yi

Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), have shown promise as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yimu Pan , Sitao Zhang , Alison D. Gernand , Jeffery A. Goldstein , James Z. Wang

As a novel and effective fine-tuning paradigm based on large-scale pre-trained language models (PLMs), prompt-tuning aims to reduce the gap between downstream tasks and pre-training objectives. While prompt-tuning has yielded continuous…

Computation and Language · Computer Science 2024-03-21 Jiangmeng Li , Fei Song , Yifan Jin , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

Few-shot Class-Incremental Learning (FSCIL) aims to continuously learn new classes based on very limited training data without forgetting the old ones encountered. Existing studies solely relied on pure visual networks, while in this paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Zitong Huang , Ze Chen , Zhixing Chen , Erjin Zhou , Xinxing Xu , Rick Siow Mong Goh , Yong Liu , Wangmeng Zuo , Chunmei Feng

Few-shot intent classification and slot filling are important but challenging tasks due to the scarcity of finely labeled data. Therefore, current works first train a model on source domains with sufficiently labeled data, and then transfer…

Computation and Language · Computer Science 2023-12-22 Jie Han , Yixiong Zou , Haozhao Wang , Jun Wang , Wei Liu , Yao Wu , Tao Zhang , Ruixuan Li

This paper presents a simple and effective visual prompting method for adapting pre-trained models to downstream recognition tasks. Our method includes two key designs. First, rather than directly adding together the prompt and the image,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Junyang Wu , Xianhang Li , Chen Wei , Huiyu Wang , Alan Yuille , Yuyin Zhou , Cihang Xie

Training a computer vision system to segment a novel class typically requires collecting and painstakingly annotating lots of images with objects from that class. Few-shot segmentation techniques reduce the required number of images to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shreyas Chandgothia , Ardhendu Sekhar , Amit Sethi

Semantic segmentation, which aims to acquire a detailed understanding of images, is an essential issue in computer vision. However, in practical scenarios, new categories that are different from the categories in training usually appear.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Haiyang Liu , Yichen Wang , Jiayi Zhao , Guowu Yang , Fengmao Lv

In task-based few-shot learning paradigms, it is commonly assumed that different tasks are independently and identically distributed (i.i.d.). However, in real-world scenarios, the distribution encountered in few-shot learning can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiajun Chen , Hongpeng Yin , Yifu Yang

Existing cross-domain few-shot learning (CDFSL) methods, which develop source-domain training strategies to enhance model transferability, face challenges with large-scale pre-trained models (LMs) due to inaccessible source data and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Huali Xu , Li Liu , Tianpeng Liu , Shuaifeng Zhi , Shuzhou Sun , Ming-Ming Cheng