English
Related papers

Related papers: Prompt Learning for Domain Adaptation in Task-Orie…

200 papers

Aspect term extraction is a fundamental task in fine-grained sentiment analysis, which aims at detecting customer's opinion targets from reviews on product or service. The traditional supervised models can achieve promising results with…

Computation and Language · Computer Science 2023-03-03 Jingli Shi , Weihua Li , Quan Bai , Yi Yang , Jianhua Jiang

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

To help evaluate and understand the latent capabilities of language models, this paper introduces an approach using optimized input embeddings, or 'soft prompts,' as a metric of conditional distance between a model and a target behavior.…

Machine Learning · Computer Science 2025-05-22 Ross Nordby

Computing students increasingly rely on generative AI tools for programming assistance, often without formal instruction or guidance. This highlights a need to teach students how to effectively interact with AI models, particularly through…

Computers and Society · Computer Science 2025-09-15 Victor-Alexandru Pădurean , Paul Denny , Alkis Gotovos , Adish Singla

Prompt tuning in natural language processing (NLP) has become an increasingly popular method for adapting large language models to specific tasks. However, the transferability of these prompts, especially continuous prompts, between…

Computation and Language · Computer Science 2024-07-15 Zijun Wu , Yongkang Wu , Lili Mou

Humans can reason compositionally when presented with new tasks. Previous research shows that appropriate prompting techniques enable large language models (LLMs) to solve artificial compositional generalization tasks such as SCAN. In this…

Computation and Language · Computer Science 2022-10-03 Andrew Drozdov , Nathanael Schärli , Ekin Akyürek , Nathan Scales , Xinying Song , Xinyun Chen , Olivier Bousquet , Denny Zhou

Incorporating explicit domain knowledge into neural-based task-oriented dialogue systems is an effective way to reduce the need of large sets of annotated dialogues. In this paper, we investigate how the use of explicit domain knowledge of…

Complex natural language understanding modules in dialog systems have a richer understanding of user utterances, and thus are critical in providing a better user experience. However, these models are often created from scratch, for specific…

Computation and Language · Computer Science 2021-04-22 Brian Lester , Sagnik Ray Choudhury , Rashmi Prasad , Srinivas Bangalore

In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts…

Computation and Language · Computer Science 2021-09-03 Brian Lester , Rami Al-Rfou , Noah Constant

Prompt-based fine-tuning for pre-trained models has proven effective for many natural language processing tasks under few-shot settings in general domain. However, tuning with prompt in biomedical domain has not been investigated…

Computation and Language · Computer Science 2023-04-17 Haochun Wang , Chi Liu , Nuwa Xi , Sendong Zhao , Meizhi Ju , Shiwei Zhang , Ziheng Zhang , Yefeng Zheng , Bing Qin , Ting Liu

In an enterprise Virtual Assistant (VA) system, intent classification is the crucial component that determines how a user input is handled based on what the user wants. The VA system is expected to be a cost-efficient SaaS service with low…

Computation and Language · Computer Science 2024-08-22 Haode Qi , Cheng Qian , Jian Ni , Pratyush Singh , Reza Fazeli , Gengyu Wang , Zhongzheng Shu , Eric Wayne , Juergen Bross

The rapidly growing market demand for automatic dialogue agents capable of goal-oriented behavior has caused many tech-industry leaders to invest considerable efforts into task-oriented dialog systems. The success of these systems is highly…

Computation and Language · Computer Science 2022-10-25 Ella Rabinovich , Matan Vetzler , David Boaz , Vineet Kumar , Gaurav Pandey , Ateret Anaby-Tavor

The effectiveness of prompt learning has been demonstrated in different pre-trained language models. By formulating suitable template and choosing representative label mapping, prompt learning can be used as an efficient knowledge probe.…

Computation and Language · Computer Science 2022-11-01 Jinta Weng , Yue Hu , Jing Qiu , Heyan Huan

The goal of this work is to establish a scalable pipeline for expanding an object detector towards novel/unseen categories, using zero manual annotations. To achieve that, we make the following four contributions: (i) in pursuit of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chengjian Feng , Yujie Zhong , Zequn Jie , Xiangxiang Chu , Haibing Ren , Xiaolin Wei , Weidi Xie , Lin Ma

Recently, various methods have been proposed to create open-domain conversational agents with Large Language Models (LLMs). These models are able to answer user queries, but in a one-way Q&A format rather than a true conversation.…

Computation and Language · Computer Science 2024-07-02 Ahmed Njifenjou , Virgile Sucal , Bassam Jabaian , Fabrice Lefèvre

Conversational assistants are being progressively adopted by the general population. However, they are not capable of handling complicated information-seeking tasks that involve multiple turns of information exchange. Due to the limited…

Information Retrieval · Computer Science 2019-01-14 Chen Qu , Liu Yang , Bruce Croft , Yongfeng Zhang , Johanne R. Trippas , Minghui Qiu

Current image generation systems produce high-quality images but struggle with ambiguous user prompts, making interpretation of actual user intentions difficult. Many users must modify their prompts several times to ensure the generated…

With the availability of massive general-domain dialogue data, pre-trained dialogue generation appears to be super appealing to transfer knowledge from the general domain to downstream applications. In most existing work, such transferable…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Lemao Liu , Tingchen Fu , Shuming Shi , Dongyan Zhao , Rui Yan

Prompt-based methods with large pre-trained language models (PLMs) have shown impressive unaided performance across many NLP tasks. These models improve even further with the addition of a few labeled in-context exemplars to guide output…

Computation and Language · Computer Science 2023-02-14 Derek Chen , Kun Qian , Zhou Yu

Recent foundational language models have shown state-of-the-art performance in many NLP tasks in zero- and few-shot settings. An advantage of these models over more standard approaches based on fine-tuning is the ability to understand…

Computation and Language · Computer Science 2024-04-16 Aleksandra Edwards , Jose Camacho-Collados