English
Related papers

Related papers: Learning From Free-Text Human Feedback -- Collect …

200 papers

Implicit user feedback, user emotions and demographic information have shown to be promising sources for improving the accuracy and user engagement of responses generated by dialogue systems. However, the influence of such information on…

Computation and Language · Computer Science 2024-11-12 Dominic Petrak , Thy Thy Tran , Iryna Gurevych

Recent advancements in Large Language Models (LLMs) have been reshaping Natural Language Processing (NLP) task in several domains. Their use in the field of Human Resources (HR) has still room for expansions and could be beneficial for…

Computation and Language · Computer Science 2024-02-05 Weijie Xu , Zicheng Huang , Wenxiang Hu , Xi Fang , Rajesh Kumar Cherukuri , Naumaan Nayyar , Lorenzo Malandri , Srinivasan H. Sengamedu

Many open-domain dialogue models pre-trained with social media comments can generate coherent replies but have difficulties producing engaging responses when interacting with real users. This phenomenon might mainly result from the…

Computation and Language · Computer Science 2022-08-31 Hua Lu , Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang

Dialogue State Tracking (DST) is designed to monitor the evolving dialogue state in the conversations and plays a pivotal role in developing task-oriented dialogue systems. However, obtaining the annotated data for the DST task is usually a…

Computation and Language · Computer Science 2024-05-24 Cheng Niu , Xingguang Wang , Xuxin Cheng , Juntong Song , Tong Zhang

Existing personalized dialogue models use human designed persona descriptions to improve dialogue consistency. Collecting such descriptions from existing dialogues is expensive and requires hand-crafted feature designs. In this paper, we…

Computation and Language · Computer Science 2019-05-27 Zhaojiang Lin , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

Dialogue state tracking plays a crucial role in extracting information in task-oriented dialogue systems. However, preceding research are limited to textual modalities, primarily due to the shortage of authentic human audio datasets. We…

Sound · Computer Science 2023-12-05 Jihyun Lee , Yejin Jeon , Wonjun Lee , Yunsu Kim , Gary Geunbae Lee

The ubiquitous nature of chatbots and their interaction with users generate an enormous amount of data. Can we improve chatbots using this data? A self-feeding chatbot improves itself by asking natural language feedback when a user is…

Computation and Language · Computer Science 2020-10-16 Makesh Narsimhan Sreedhar , Kun Ni , Siva Reddy

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

Today, most large-scale conversational AI agents (e.g. Alexa, Siri, or Google Assistant) are built using manually annotated data to train the different components of the system. Typically, the accuracy of the ML models in these components…

Machine Learning · Computer Science 2019-11-07 Pragaash Ponnusamy , Alireza Roshan Ghias , Chenlei Guo , Ruhi Sarikaya

When developing new large language models (LLMs), a key step is evaluating their final performance, often by computing the win-rate against a reference model based on external feedback. Human feedback is the gold standard, particularly for…

Machine Learning · Computer Science 2025-02-26 Zhaoyi Zhou , Yuda Song , Andrea Zanette

Large pre-trained language models have exhibited unprecedented capabilities in producing high-quality text via prompting techniques. This fact introduces new possibilities for data collection and annotation, particularly in situations where…

Computation and Language · Computer Science 2023-05-25 Tiziano Labruna , Sofia Brenna , Andrea Zaninello , Bernardo Magnini

Many recent advances in natural language generation have been fueled by training large language models on internet-scale data. However, this paradigm can lead to models that generate toxic, inaccurate, and unhelpful content, and automatic…

In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback. In a conversational setting such signals are usually unavailable due to the nature of the interactions, and, instead, the evaluation often relies…

Information Retrieval · Computer Science 2024-05-01 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

A major challenge in Natural Language Processing is obtaining annotated data for supervised learning. An option is the use of crowdsourcing platforms for data annotation. However, crowdsourcing introduces issues related to the annotator's…

Dialogue assessment plays a critical role in the development of open-domain dialogue systems. Existing work are uncapable of providing an end-to-end and human-epistemic assessment dataset, while they only provide sub-metrics like coherence…

Computation and Language · Computer Science 2023-10-26 Yukun Zhao , Lingyong Yan , Weiwei Sun , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Most existing dialogue corpora and models have been designed to fit into 2 predominant categories : task-oriented dialogues portray functional goals, such as making a restaurant reservation or booking a plane ticket, while…

Computation and Language · Computer Science 2023-11-27 Armand Stricker , Patrick Paroubek

Human feedback data is a critical component in developing language models. However, collecting this feedback is costly and ultimately not scalable. Inspired by the way human interlocutors provide spontaneous unsolicited feedback to each…

Computation and Language · Computer Science 2025-03-04 Shachar Don-Yehiya , Leshem Choshen , Omri Abend

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. Dialogue systems are increasingly being designed to move beyond just imitating conversation and also…

Computation and Language · Computer Science 2021-11-03 Atharv Singh Patlan , Shiven Tripathi , Shubham Korde

With the rapid development of large language models, researchers have created increasingly advanced spoken dialogue systems that can naturally converse with humans. However, these systems still struggle to handle the full complexity of…

Computation and Language · Computer Science 2025-01-03 Xize Cheng , Dongjie Fu , Xiaoda Yang , Minghui Fang , Ruofan Hu , Jingyu Lu , Bai Jionghao , Zehan Wang , Shengpeng Ji , Rongjie Huang , Linjun Li , Yu Chen , Tao Jin , Zhou Zhao

Enhancing user engagement through personalization in conversational agents has gained significance, especially with the advent of large language models that generate fluent responses. Personalized dialogue generation, however, is…

Computation and Language · Computer Science 2024-07-30 Yi-Pei Chen , Noriki Nishida , Hideki Nakayama , Yuji Matsumoto