English
Related papers

Related papers: Learning From Free-Text Human Feedback -- Collect …

200 papers

As it is cumbersome and expensive to acquire a huge amount of data for training neural dialog models, data augmentation is proposed to effectively utilize existing training samples. However, current data augmentation techniques on the…

Computation and Language · Computer Science 2023-03-20 Xiuying Chen , Mingzhe Li , Jiayi Zhang , Xiaoqiang Xia , Chen Wei , Jianwei Cui , Xin Gao , Xiangliang Zhang , Rui Yan

Scaling semantic parsing models for task-oriented dialog systems to new languages is often expensive and time-consuming due to the lack of available datasets. Available datasets suffer from several shortcomings: a) they contain few…

Computation and Language · Computer Science 2021-01-28 Haoran Li , Abhinav Arora , Shuohui Chen , Anchit Gupta , Sonal Gupta , Yashar Mehdad

The development of Open-Domain Dialogue Systems (ODS)is a trending topic due to the large number of research challenges, large societal and business impact, and advances in the underlying technology. However, the development of these kinds…

Computation and Language · Computer Science 2021-12-28 Chen Zhang , João Sedoc , Luis Fernando D'Haro , Rafael Banchs , Alexander Rudnicky

Recent advances in natural language processing (NLP) have contributed to the development of automated writing evaluation (AWE) systems that can correct grammatical errors. However, while these systems are effective at improving text, they…

Computation and Language · Computer Science 2025-08-12 Steven Coyne , Diana Galvan-Sosa , Ryan Spring , Camélia Guerraoui , Michael Zock , Keisuke Sakaguchi , Kentaro Inui

Human annotation of natural language facilitates standardized evaluation of natural language processing systems and supports automated feature extraction. This document consists of instructions for annotating the temporal information in…

cmp-lg · Computer Science 2016-08-31 Tom O'Hara , Janyce Wiebe , Karen Payne

Software development is a cognitively intensive process requiring multitasking, adherence to evolving workflows, and continuous learning. With the rise of large language model (LLM)-based tools, such as conversational agents (CAs), there is…

Software Engineering · Computer Science 2025-05-14 Glaucia Melo , Paulo Alencar , Donald Cowan

Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are…

Computation and Language · Computer Science 2021-10-06 Jing Yang Lee , Kong Aik Lee , Woon Seng Gan

Task transfer, transferring knowledge contained in related tasks, holds the promise of reducing the quantity of labeled data required to fine-tune language models. Dialogue understanding encompasses many diverse tasks, yet task transfer has…

Computation and Language · Computer Science 2022-10-17 Alon Albalak , Yi-Lin Tuan , Pegah Jandaghi , Connor Pryor , Luke Yoffe , Deepak Ramachandran , Lise Getoor , Jay Pujara , William Yang Wang

End-to-end neural approaches are becoming increasingly common in conversational scenarios due to their promising performances when provided with sufficient amount of data. In this paper, we present a novel methodology to address the…

Computation and Language · Computer Science 2019-10-17 Sourabh Majumdar , Serra Sinem Tekiroglu , Marco Guerini

Traditional reinforcement learning from human feedback (RLHF) for large language models (LLMs) relies on expensive human-annotated datasets, while Reinforcement Learning from AI Feedback (RLAIF) also incurs significant costs, requiring the…

Computation and Language · Computer Science 2025-10-09 Shangjian Yin , Zhepei Wei , Xinyu Zhu , Wei-Lin Chen , Yu Meng

Interacting with human via high-quality multi-turn dialogues is a key feature of large language models (LLMs). However, human-based evaluation of such capability involves intensive manual labor. This report provides a preliminary evaluation…

Computation and Language · Computer Science 2023-10-23 Haodong Duan , Jueqi Wei , Chonghua Wang , Hongwei Liu , Yixiao Fang , Songyang Zhang , Dahua Lin , Kai Chen

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2020-11-05 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

Large datasets are essential for neural modeling of many NLP tasks. Current publicly available open-domain dialogue datasets offer a trade-off between quality (e.g., DailyDialog) and size (e.g., Opensubtitles). We narrow this gap by…

Computation and Language · Computer Science 2021-01-25 Richard Csaky , Gabor Recski

For conversational AI and virtual assistants to communicate with humans in a realistic way, they must exhibit human characteristics such as expression of emotion and personality. Current attempts toward constructing human-like dialogue…

Computation and Language · Computer Science 2021-12-03 Aaron W. Li , Veronica Jiang , Steven Y. Feng , Julia Sprague , Wei Zhou , Jesse Hoey

This paper introduces a simple yet effective data-centric approach for the task of improving persona-conditioned dialogue agents. Prior model-centric approaches unquestioningly depend on the raw crowdsourced benchmark datasets such as…

Computation and Language · Computer Science 2022-02-17 Minju Kim , Beong-woo Kwak , Youngwook Kim , Hong-in Lee , Seung-won Hwang , Jinyoung Yeo

High-quality speech dialogue datasets are crucial for Speech-LLM development, yet existing acquisition methods face significant limitations. Human recordings incur high costs and privacy concerns, while synthetic approaches often lack…

Computation and Language · Computer Science 2025-04-01 Minghan Wang , Ye Bai , Yuxia Wang , Thuy-Trang Vu , Ehsan Shareghi , Gholamreza Haffari

In human conversations, due to their personalities in mind, people can easily carry out and maintain the conversations. Giving conversational context with persona information to a chatbot, how to exploit the information to generate diverse…

Artificial Intelligence · Computer Science 2019-05-30 Haoyu Song , Wei-Nan Zhang , Yiming Cui , Dong Wang , Ting Liu

Human feedback on conversations with language language models (LLMs) is central to how these systems learn about the world, improve their capabilities, and are steered toward desirable and safe behaviors. However, this feedback is mostly…

Models trained on large unlabeled corpora of human interactions will learn patterns and mimic behaviors therein, which include offensive or otherwise toxic behavior and unwanted biases. We investigate a variety of methods to mitigate these…

Computation and Language · Computer Science 2021-08-06 Jing Xu , Da Ju , Margaret Li , Y-Lan Boureau , Jason Weston , Emily Dinan

Large Language Models (LLMs), which simulate human users, are frequently employed to evaluate chatbots in applications such as tutoring and customer service. Effective evaluation necessitates a high degree of human-like diversity within…

Computation and Language · Computer Science 2024-09-04 Xiaoyu Lin , Xinkai Yu , Ankit Aich , Salvatore Giorgi , Lyle Ungar