English
Related papers

Related papers: Annotation Inconsistency and Entity Bias in MultiW…

200 papers

We present MAFA (Multi-Agent Framework for Annotation), a production-deployed system that transforms enterprise-scale annotation workflows through configurable multi-agent collaboration. Addressing the critical challenge of annotation…

Machine Learning · Computer Science 2026-03-23 Mahmood Hegazy , Aaron Rodrigues , Azzam Naeem

This paper addresses the often overlooked issue of fairness in the autonomous driving domain, particularly in vision-based perception and prediction systems, which play a pivotal role in the overall functioning of Autonomous Vehicles (AVs).…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 David Fernández Llorca , Pedro Frau , Ignacio Parra , Rubén Izquierdo , Emilia Gómez

The primary purpose of dialogue state tracking (DST), a critical component of an end-to-end conversational system, is to build a model that responds well to real-world situations. Although we often change our minds from time to time during…

Computation and Language · Computer Science 2022-10-13 Takyoung Kim , Yukyung Lee , Hoonsang Yoon , Pilsung Kang , Junseong Bang , Misuk Kim

Existing discourse corpora are annotated based on different frameworks, which show significant dissimilarities in definitions of arguments and relations and structural constraints. Despite surface differences, these frameworks share basic…

Computation and Language · Computer Science 2024-04-09 Yingxue Fu

Large-scale conversational assistants like Alexa, Siri, Cortana and Google Assistant process every utterance using multiple models for domain, intent and named entity recognition. Given the decoupled nature of model development and large…

Computation and Language · Computer Science 2021-09-07 Rakesh Chada , Pradeep Natarajan , Darshan Fofadiya , Prathap Ramachandra

Task-oriented conversational datasets often lack topic variability and linguistic diversity. However, with the advent of Large Language Models (LLMs) pretrained on extensive, multilingual and diverse text data, these limitations seem…

Dialogue state tracking (DST) aims to record user queries and goals during a conversational interaction achieved by maintaining a predefined set of slots and their corresponding values. Current approaches decide slot values opaquely, while…

Computation and Language · Computer Science 2024-03-12 Lin Xu , Ningxin Peng , Daquan Zhou , See-Kiong Ng , Jinlan Fu

Entity tags in human-machine dialog are integral to natural language understanding (NLU) tasks in conversational assistants. However, current systems struggle to accurately parse spoken queries with the typical use of text input alone, and…

Computation and Language · Computer Science 2021-09-28 Sahas Dendukuri , Pooja Chitkara , Joel Ruben Antony Moniz , Xiao Yang , Manos Tsagkias , Stephen Pulman

The adoption of pre-trained language models in task-oriented dialogue systems has resulted in significant enhancements of their text generation abilities. However, these architectures are slow to use because of the large number of trainable…

Computation and Language · Computer Science 2023-02-14 Radostin Cholakov , Todor Kolev

Many machine learning systems today are trained on large amounts of human-annotated data. Data annotation tasks that require a high level of competency make data acquisition expensive, while the resulting labels are often subjective,…

Machine Learning · Computer Science 2020-04-08 Emmanouil Antonios Platanios , Maruan Al-Shedivat , Eric Xing , Tom Mitchell

Popular dialog datasets such as MultiWOZ are created by providing crowd workers an instruction, expressed in natural language, that describes the task to be accomplished. Crowd workers play the role of a user and an agent to generate…

Computation and Language · Computer Science 2021-10-22 Biswesh Mohapatra , Gaurav Pandey , Danish Contractor , Sachindra Joshi

Task-oriented dialog (TOD) systems often require interaction with an external knowledge base to retrieve necessary entity (e.g., restaurant) information to support the response generation. Most current end-to-end TOD systems either retrieve…

Computation and Language · Computer Science 2022-09-20 Guanhuan Huang , Xiaojun Quan , Qifan Wang

We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph. A dialogue agent maps each user utterance to a program that extends this graph. Programs include metacomputation operators for…

Conversational agents have become ubiquitous in assisting with daily tasks, and are expected to possess human-like features. One such feature is lexical entrainment (LE), a phenomenon in which speakers in human-human conversations tend to…

Computation and Language · Computer Science 2023-10-17 Zhengxiang Shi , Procheta Sen , Aldo Lipani

Task-oriented dialogue systems are essential for applications ranging from customer service to personal assistants and are widely used across various industries. However, developing effective multi-domain systems remains a significant…

Computation and Language · Computer Science 2024-11-04 Aman Gupta , Anirudh Ravichandran , Ziji Zhang , Swair Shah , Anurag Beniwal , Narayanan Sadagopan

Traditional end-to-end task-oriented dialogue systems have been built with a modularized design. However, such design often causes misalignment between the agent response and external knowledge, due to inadequate representation of…

Computation and Language · Computer Science 2023-05-24 Qingyang Wu , Deema Alnuhait , Derek Chen , Zhou Yu

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role…

Computation and Language · Computer Science 2024-05-31 Jian Wang , Chak Tou Leong , Jiashuo Wang , Dongding Lin , Wenjie Li , Xiao-Yong Wei

Dialogue models are inherently reactive, responding to the current user turn without anticipating upcoming intents, which leads to redundant interactions in multi-intent settings. We address this limitation by introducing a lightweight…

Computation and Language · Computer Science 2026-05-01 Yang Luo

Neural dialog state trackers are generally limited due to the lack of quantity and diversity of annotated training data. In this paper, we address this difficulty by proposing a reinforcement learning (RL) based framework for data…

Computation and Language · Computer Science 2019-11-19 Yichun Yin , Lifeng Shang , Xin Jiang , Xiao Chen , Qun Liu

We present LINGUIST, a method for generating annotated data for Intent Classification and Slot Tagging (IC+ST), via fine-tuning AlexaTM 5B, a 5-billion-parameter multilingual sequence-to-sequence (seq2seq) model, on a flexible instruction…

Computation and Language · Computer Science 2022-09-21 Andy Rosenbaum , Saleh Soltan , Wael Hamza , Yannick Versley , Markus Boese