English
Related papers

Related papers: Prompt Pool based Class-Incremental Continual Lear…

200 papers

It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language…

Computation and Language · Computer Science 2023-05-30 Xianjun Yang , Wei Cheng , Xujiang Zhao , Wenchao Yu , Linda Petzold , Haifeng Chen

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue…

Computation and Language · Computer Science 2024-10-17 Pietro Lesci , Yoshinari Fujinuma , Momchil Hardalov , Chao Shang , Yassine Benajiba , Lluis Marquez

The key challenge of cross-modal domain-incremental learning (DIL) is to enable the learning model to continuously learn from novel data with different feature distributions under the same task without forgetting old ones. However, existing…

Computation and Language · Computer Science 2024-08-05 Yu Feng , Zhen Tian , Yifan Zhu , Zongfu Han , Haoran Luo , Guangwei Zhang , Meina Song

Prompt learning has emerged as a valuable technique in enhancing vision-language models (VLMs) such as CLIP for downstream tasks in specific domains. Existing work mainly focuses on designing various learning forms of prompts, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zheng Li , Xiang Li , Xinyi Fu , Xin Zhang , Weiqiang Wang , Shuo Chen , Jian Yang

Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal…

Computation and Language · Computer Science 2020-02-21 Adarsh Kumar , Peter Ku , Anuj Kumar Goyal , Angeliki Metallinou , Dilek Hakkani-Tur

We introduce Directional Stimulus Prompting, a novel framework for guiding black-box large language models (LLMs) toward specific desired outputs. Instead of directly adjusting LLMs, our method employs a small tunable policy model (e.g.,…

Computation and Language · Computer Science 2023-10-11 Zekun Li , Baolin Peng , Pengcheng He , Michel Galley , Jianfeng Gao , Xifeng Yan

In dialogue state tracking (DST), in-context learning comprises a retriever that selects labeled dialogues as in-context examples and a DST model that uses these examples to infer the dialogue state of the query dialogue. Existing methods…

Computation and Language · Computer Science 2025-06-04 Haesung Pyun , Yoonah Park , Yohan Jo

While traditional machine learning can effectively tackle a wide range of problems, it primarily operates within a closed-world setting, which presents limitations when dealing with streaming data. As a solution, incremental learning…

Machine Learning · Computer Science 2025-03-11 Hai-Long Sun , Da-Wei Zhou , De-Chuan Zhan , Han-Jia Ye

Pre-trained vision-language models (VLMs) have shown impressive performance on various downstream tasks by utilizing knowledge learned from large data. In general, the performance of VLMs on target tasks can be further improved by prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Eulrang Cho , Jooyeon Kim , Hyunwoo J. Kim

Recently introduced language model prompting methods can achieve high accuracy in zero- and few-shot settings while requiring few to no learned task-specific parameters. Nevertheless, these methods still often trail behind full model…

Computation and Language · Computer Science 2022-10-24 Zhaofeng Wu , Robert L. Logan , Pete Walsh , Akshita Bhagia , Dirk Groeneveld , Sameer Singh , Iz Beltagy

Implicit discourse relation recognition (IDRR) aims at recognizing the discourse relation between two text segments without an explicit connective. Recently, the prompt learning has just been applied to the IDRR task with great performance…

Computation and Language · Computer Science 2023-09-15 Bang Wang , Zhenglin Wang , Wei Xiang , Yijun Mo

The data privacy constraint in online continual learning (OCL), where the data can be seen only once, complicates the catastrophic forgetting problem in streaming data. A common approach applied by the current SOTAs in OCL is with the use…

Machine Learning · Computer Science 2025-07-17 M. Anwar Ma'sum , Mahardhika Pratama , Savitha Ramasamy , Lin Liu , Habibullah Habibullah , Ryszard Kowalczyk

We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic…

Recent studies have demonstrated that incorporating trainable prompts into pretrained models enables effective incremental learning. However, the application of prompts in incremental object detection (IOD) remains underexplored. Our study…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zijia An , Boyu Diao , Ruiqi Liu , Libo Huang , Chuanguang Yang , Fei Wang , Zhulin An , Yongjun Xu

The task of dialogue generation aims to automatically provide responses given previous utterances. Tracking dialogue states is an important ingredient in dialogue generation for estimating users' intention. However, the \emph{expensive…

Computation and Language · Computer Science 2018-09-03 Xisen Jin , Wenqiang Lei , Zhaochun Ren , Hongshen Chen , Shangsong Liang , Yihong Zhao , Dawei Yin

Dialogue state tracking (DST) aims to predict the current dialogue state given the dialogue history. Existing methods generally exploit the utterances of all dialogue turns to assign value for each slot. This could lead to suboptimal…

Computation and Language · Computer Science 2022-05-06 Yifan Wang , Jing Zhao , Junwei Bao , Chaoqun Duan , Youzheng Wu , Xiaodong He

Large vision-language models (VLMs) have shown significant performance boost in various application domains. However, adopting them to deal with several sequentially encountered tasks has been challenging because finetuning a VLM on a task…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yuliang Cai , Mohammad Rostami

Class-incremental learning (CIL) aims to enable models to continuously learn new classes while overcoming catastrophic forgetting. The introduction of pre-trained models has brought new tuning paradigms to CIL. In this paper, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Qinhao Zhou , Yuwen Tan , Boqing Gong , Xiang Xiang

This paper proposes an improvement to the existing data-driven Neural Belief Tracking (NBT) framework for Dialogue State Tracking (DST). The existing NBT model uses a hand-crafted belief state update mechanism which involves an expensive…

Computation and Language · Computer Science 2018-05-30 Nikola Mrkšić , Ivan Vulić

Dialogue State Tracking (DST), a crucial component of task-oriented dialogue (ToD) systems, keeps track of all important information pertaining to dialogue history: filling slots with the most probable values throughout the conversation.…

Computation and Language · Computer Science 2023-02-28 Han Zhou , Ignacio Iacobacci , Pasquale Minervini