English
Related papers

Related papers: Learning Label Modular Prompts for Text Classifica…

200 papers

Text matching is a fundamental technique in both information retrieval and natural language processing. Text matching tasks share the same paradigm that determines the relationship between two given texts. The relationships vary from task…

Information Retrieval · Computer Science 2022-08-23 Shicheng Xu , Liang Pang , Huawei Shen , Xueqi Cheng

Soft prompt tuning is a parameter-efficient method for adapting LLMs to specific tasks, but suffers from a lack of interpretability. Building on recent work on interpreting soft prompts (Ramati et al., 2024), we explore how training a…

Computation and Language · Computer Science 2026-05-28 Pitipat Kongsomjit , Suryansh Goyal , Jacob Whitehill

Fine-tuning Large Language Models (LLMs) is now a common approach for text classification in a wide range of applications. When labeled documents are scarce, active learning helps save annotation efforts but requires retraining of massive…

Machine Learning · Computer Science 2024-02-27 Artem Vysogorets , Achintya Gopal

In multi-label classification, each training instance is associated with multiple class labels simultaneously. Unfortunately, collecting the fully precise class labels for each training instance is time- and labor-consuming for real-world…

Machine Learning · Computer Science 2024-03-26 Meng Wei , Zhongnian Li , Peng Ying , Yong Zhou , Xinzheng Xu

Large Language Model (LLM) has demonstrated significant ability in various Natural Language Processing tasks. However, their effectiveness is highly dependent on the phrasing of the task prompt, leading to research on automatic prompt…

Computation and Language · Computer Science 2024-02-06 Moxin Li , Wenjie Wang , Fuli Feng , Yixin Cao , Jizhi Zhang , Tat-Seng Chua

Prompt learning has become one of the most efficient paradigms for adapting large pre-trained vision-language models to downstream tasks. Current state-of-the-art methods, like CoOp and ProDA, tend to adopt soft prompts to learn an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Sifan Long , Zhen Zhao , Junkun Yuan , Zichang Tan , Jiangjiang Liu , Luping Zhou , Shengsheng Wang , Jingdong Wang

Recent advancements in pre-trained Vision-Language Models (VLMs) have highlighted the significant potential of prompt tuning for adapting these models to a wide range of downstream tasks. However, existing prompt tuning methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xinyang Wang , Yi Yang , Minfeng Zhu , Kecheng Zheng , Shi Liu , Wei Chen

Many NLP learning tasks can be decomposed into several distinct sub-tasks, each associated with a partial label. In this paper we focus on a popular class of learning problems, sequence prediction applied to several sentiment analysis…

Computation and Language · Computer Science 2019-06-05 Xiao Zhang , Dan Goldwasser

Prompt-based learning (i.e., prompting) is an emerging paradigm for exploiting knowledge learned by a pretrained language model. In this paper, we propose Automatic Multi-Label Prompting (AMuLaP), a simple yet effective method to…

Computation and Language · Computer Science 2022-04-15 Han Wang , Canwen Xu , Julian McAuley

Conventional approaches to text classification typically assume the existence of a fixed set of predefined labels to which a given text can be classified. However, in real-world applications, there exists an infinite label space for…

Computation and Language · Computer Science 2023-05-29 Christopher Clarke , Yuzhao Heng , Yiping Kang , Krisztian Flautner , Lingjia Tang , Jason Mars

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Prompt-based learning, with its capability to tackle zero-shot and few-shot NLP tasks, has gained much attention in community. The main idea is to bridge the gap between NLP downstream tasks and language modeling (LM), by mapping these…

Computation and Language · Computer Science 2022-11-21 Yulong Chen , Yang Liu , Li Dong , Shuohang Wang , Chenguang Zhu , Michael Zeng , Yue Zhang

In-context learning enables language models (LM) to adapt to downstream data or tasks by incorporating few samples as demonstrations within the prompts. It offers strong performance without the expense of fine-tuning. However, the…

Computation and Language · Computer Science 2024-10-15 Jian Gu , Aldeida Aleti , Chunyang Chen , Hongyu Zhang

Vision-language models such as CLIP learn a generic text-image embedding from large-scale training data. A vision-language model can be adapted to a new classification task through few-shot prompt tuning. We find that such a prompt tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Cheng-En Wu , Yu Tian , Haichao Yu , Heng Wang , Pedro Morgado , Yu Hen Hu , Linjie Yang

With the emergence of large pre-trained vison-language model like CLIP, transferable representations can be adapted to a wide range of downstream tasks via prompt tuning. Prompt tuning tries to probe the beneficial information for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Yinghui Xing , Qirui Wu , De Cheng , Shizhou Zhang , Guoqiang Liang , Peng Wang , Yanning Zhang

Tabular data is arguably one of the most commonly used data structures in various practical domains, including finance, healthcare and e-commerce. The inherent heterogeneity allows tabular data to store rich information. However, based on a…

Machine Learning · Computer Science 2023-06-01 Kuan-Yu Chen , Ping-Han Chiang , Hsin-Rung Chou , Ting-Wei Chen , Tien-Hao Chang

Visual transfer learning for unseen categories presents an active research topic yet a challenging task, due to the inherent conflict between preserving category-specific representations and acquiring transferable knowledge. Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Xiao Shi , Yangjun Ou , Zhenzhong Chen

Vision-language models (VLMs), such as CLIP, have shown strong generalization under zero-shot settings, yet adapting them to downstream tasks with limited supervision remains a significant challenge. Existing multi-modal prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Silin Cheng , Kai Han

The rapid evolution of large language models (LLMs) has transformed prompt engineering from a localized craft into a systems-level governance challenge. As models scale and update across generations, prompt behavior becomes sensitive to…

Computation and Language · Computer Science 2026-02-27 Hyunwoo Kim , Hanau Yi , Jaehee Bae , Yumin Kim

Large Language Models (LLMs) have revolutionized human-AI interaction by enabling intuitive task execution through natural language prompts. Despite their potential, designing effective prompts remains a significant challenge, as small…

Software Engineering · Computer Science 2025-04-08 Yuetian Mao , Junjie He , Chunyang Chen