English
Related papers

Related papers: Generate labeled training data using Prompt Progra…

200 papers

Large pre-trained language models (LMs) such as GPT-3 have acquired a surprising ability to perform zero-shot learning. For example, to classify sentiment without any training examples, we can "prompt" the LM with the review and the label…

Computation and Language · Computer Science 2021-09-09 Ruiqi Zhong , Kristy Lee , Zheng Zhang , Dan Klein

Most public instruction finetuning datasets are relatively small compared to the closed source datasets used to train industry models. To study questions about finetuning at scale, such as curricula and learning rate cooldown schedules,…

Computation and Language · Computer Science 2024-06-18 Jiuhai Chen , Rifaa Qadri , Yuxin Wen , Neel Jain , John Kirchenbauer , Tianyi Zhou , Tom Goldstein

This paper describes our contributions to the Shared Task of the 9th Workshop on Argument Mining (2022). Our approach uses Large Language Models for the task of Argument Quality Prediction. We perform prompt engineering using GPT-3, and…

Computation and Language · Computer Science 2022-10-06 Michiel van der Meer , Myrthe Reuver , Urja Khurana , Lea Krause , Selene Báez Santamaría

The creation of instruction data and evaluation benchmarks for serving Large language models often involves enormous human annotation. This issue becomes particularly pronounced when rapidly developing such resources for a non-English…

Computation and Language · Computer Science 2024-03-07 Yikun Sun , Zhen Wan , Nobuhiro Ueda , Sakiko Yahata , Fei Cheng , Chenhui Chu , Sadao Kurohashi

Objective To solve major clinical natural language processing (NLP) tasks using a unified text-to-text learning architecture based on a generative large language model (LLM) via prompt tuning. Methods We formulated 7 key clinical NLP tasks…

Computation and Language · Computer Science 2023-12-12 Cheng Peng , Xi Yang , Aokun Chen , Zehao Yu , Kaleb E Smith , Anthony B Costa , Mona G Flores , Jiang Bian , Yonghui Wu

Automated explanatory feedback systems play a crucial role in facilitating learning for a large cohort of learners by offering feedback that incorporates explanations, significantly enhancing the learning process. However, delivering such…

Computation and Language · Computer Science 2024-07-17 Jionghao Lin , Eason Chen , Zeifei Han , Ashish Gurung , Danielle R. Thomas , Wei Tan , Ngoc Dang Nguyen , Kenneth R. Koedinger

Text entry is an essential task in our day-to-day digital interactions. Numerous intelligent features have been developed to streamline this process, making text entry more effective, efficient, and fluid. These improvements include…

Computation and Language · Computer Science 2023-10-17 Junxiao Shen , John J. Dudley , Jingyao Zheng , Bill Byrne , Per Ola Kristensson

Pretrained language models often do not perform tasks in ways that are in line with our preferences, e.g., generating offensive text or factually incorrect summaries. Recent work approaches the above issue by learning from a simple form of…

Computation and Language · Computer Science 2022-11-18 Jérémy Scheurer , Jon Ander Campos , Jun Shern Chan , Angelica Chen , Kyunghyun Cho , Ethan Perez

Large language models (LLMs) exhibit impressive proficiency in natural language generation, understanding user instructions, and emulating human-like language use, which has led to significant interest in their application to role-playing…

Computation and Language · Computer Science 2024-12-16 Xun Liu , Zhengwei Ni

Despite the many use cases for large language models (LLMs) in creating personalized chatbots, there has been limited research on evaluating the extent to which the behaviors of personalized LLMs accurately and consistently reflect specific…

Computation and Language · Computer Science 2024-04-03 Hang Jiang , Xiajie Zhang , Xubo Cao , Cynthia Breazeal , Deb Roy , Jad Kabbara

When primed with only a handful of training samples, very large, pretrained language models such as GPT-3 have shown competitive results when compared to fully-supervised, fine-tuned, large, pretrained language models. We demonstrate that…

Computation and Language · Computer Science 2022-03-04 Yao Lu , Max Bartolo , Alastair Moore , Sebastian Riedel , Pontus Stenetorp

In this work, we present the Chatbot Interaction with Artificial Intelligence (CI-AI) framework as an approach to the training of deep learning chatbots for task classification. The intelligent system augments human-sourced data via…

Computation and Language · Computer Science 2020-10-23 Jordan J. Bird , Anikó Ekárt , Diego R. Faria

We present a novel framework for designing emotionally agile robots with dynamic personalities and memory-based learning, with the aim of performing adaptive and non-deterministic interactions with humans while conforming to shared social…

Human-Computer Interaction · Computer Science 2025-03-25 Cheng Tang , Chao Tang , Steven Gong , Thomas M. Kwok , Yue Hu

Large "instruction-tuned" language models (i.e., finetuned to respond to instructions) have demonstrated a remarkable ability to generalize zero-shot to new tasks. Nevertheless, they depend heavily on human-written instruction data that is…

Computation and Language · Computer Science 2023-12-25 Samaksh Gulati , Anshit Verma , Manoj Parmar , Palash Chaudhary

Automatic hate speech detection using deep neural models is hampered by the scarcity of labeled datasets, leading to poor generalization. To mitigate this problem, generative AI has been utilized to generate large amounts of synthetic hate…

Computation and Language · Computer Science 2023-11-17 Sagi Pendzel , Tomer Wullach , Amir Adler , Einat Minkov

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

Computation and Language · Computer Science 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Deploying language models (LMs) in customer-facing speech applications requires conversational fluency and adherence to specific stylistic guidelines. This can be challenging to achieve reliably using complex system prompts due to issues…

Machine Learning · Computer Science 2025-07-08 Ingo Marquardt , Philippe Brule

This paper investigates the design of effective prompt strategies for generating realistic datasets using Text-To-Audio (TTA) models. We also analyze different techniques for efficiently combining these datasets to enhance their utility in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-07 Francesca Ronchini , Ho-Hsiang Wu , Wei-Cheng Lin , Fabio Antonacci

With the rapid development of natural language processing (NLP) technology, large-scale pre-trained language models such as GPT-3 have become a popular research object in NLP field. This paper aims to explore sentiment analysis optimization…

Computation and Language · Computer Science 2024-05-17 Tong Zhan , Chenxi Shi , Yadong Shi , Huixiang Li , Yiyu Lin

Generative AI and large language models hold great promise in enhancing programming education by automatically generating individualized feedback for students. We investigate the role of generative AI models in providing human tutor-style…