English
Related papers

Related papers: Annotation Inconsistency and Entity Bias in MultiW…

200 papers

Crowdsourcing has emerged as a popular approach for collecting annotated data to train supervised machine learning models. However, annotator bias can lead to defective annotations. Though there are a few works investigating individual…

Human-Computer Interaction · Computer Science 2021-10-18 Haochen Liu , Joseph Thekinen , Sinem Mollaoglu , Da Tang , Ji Yang , Youlong Cheng , Hui Liu , Jiliang Tang

Dialogue State Tracking (DST) aims to keep track of users' intentions during the course of a conversation. In DST, modelling the relations among domains and slots is still an under-studied problem. Existing approaches that have considered…

Computation and Language · Computer Science 2022-04-18 Yue Feng , Aldo Lipani , Fanghua Ye , Qiang Zhang , Emine Yilmaz

Multi turn intent understanding is central to task oriented chatbots, yet real deployments face tight token budgets and noisy contexts, and most retrieval pipelines emphasize relevance while overlooking set level diversity and confounds…

Artificial Intelligence · Computer Science 2025-10-22 Zhiming Lin

Wake word (WW) spotting is challenging in far-field not only because of the interference in signal transmission but also the complexity in acoustic environments. Traditional WW model training requires large amount of in-domain WW-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-15 Yixin Gao , Yuriy Mishchenko , Anish Shah , Spyros Matsoukas , Shiv Vitaladevuni

Most of the current task-oriented dialogue systems (ToD), despite having interesting results, are designed for a handful of languages like Chinese and English. Therefore, their performance in low-resource languages is still a significant…

Computation and Language · Computer Science 2022-03-16 Phi Nguyen Van , Tung Cao Hoang , Dung Nguyen Manh , Quan Nguyen Minh , Long Tran Quoc

Fine-tuning object detection (OD) models on combined datasets assumes annotation compatibility, yet datasets often encode conflicting spatial definitions for semantically equivalent categories. We propose an agentic label harmonization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Renyu Li , Vladimir Kirilenko , Yao You , Crag Wolfe

Collaborative dialogue relies on participants incrementally establishing common ground, yet in asymmetric settings they may believe they agree while referring to different entities. We introduce a perspectivist annotation scheme for the…

Computation and Language · Computer Science 2026-03-17 Nan Li , Albert Gatt , Massimo Poesio

Majority voting and averaging are common approaches employed to resolve annotator disagreements and derive single ground truth labels from multiple annotations. However, annotators may systematically disagree with one another, often…

Computation and Language · Computer Science 2021-10-13 Aida Mostafazadeh Davani , Mark Díaz , Vinodkumar Prabhakaran

Automated negotiation support systems aim to help human negotiators reach more favorable outcomes in multi-issue negotiations (e.g., an employer and a candidate negotiating over issues such as salary, hours, and promotions before a job…

Computation and Language · Computer Science 2023-07-14 Amogh Mannekote , Bonnie J. Dorr , Kristy Elizabeth Boyer

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

Previous attempts to build effective semantic parsers for Wizard-of-Oz (WOZ) conversations suffer from the difficulty in acquiring a high-quality, manually annotated training set. Approaches based only on dialogue synthesis are…

Computation and Language · Computer Science 2022-04-11 Giovanni Campagna , Sina J. Semnani , Ryan Kearns , Lucas Jun Koba Sato , Silei Xu , Monica S. Lam

Augmentation of task-oriented dialogues has followed standard methods used for plain-text such as back-translation, word-level manipulation, and paraphrasing despite its richly annotated structure. In this work, we introduce an augmentation…

Computation and Language · Computer Science 2022-03-23 Taha Aksu , Zhengyuan Liu , Min-Yen Kan , Nancy F. Chen

Learning with minimal data is one of the key challenges in the development of practical, production-ready goal-oriented dialogue systems. In a real-world enterprise setting where dialogue systems are developed rapidly and are expected to…

Computation and Language · Computer Science 2019-08-19 Igor Shalyminov , Sungjin Lee , Arash Eshghi , Oliver Lemon

Zero-shot cross-domain dialogue state tracking (DST) enables us to handle task-oriented dialogue in unseen domains without the expense of collecting in-domain data. In this paper, we propose a slot description enhanced generative approach…

Computation and Language · Computer Science 2021-05-11 Zhaojiang Lin , Bing Liu , Seungwhan Moon , Paul Crook , Zhenpeng Zhou , Zhiguang Wang , Zhou Yu , Andrea Madotto , Eunjoon Cho , Rajen Subba

Discourse information is difficult to represent and annotate. Among the major frameworks for annotating discourse information, RST, PDTB and SDRT are widely discussed and used, each having its own theoretical foundation and focus. Corpora…

Computation and Language · Computer Science 2022-04-19 Yingxue Fu

Accurate recognition of slot values such as domain specific words or named entities by automatic speech recognition (ASR) systems forms the core of the Goal-oriented Dialogue Systems. Although it is a critical step with direct impact on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-21 Dhanush Bekal , Ashish Shenoy , Monica Sunkara , Sravan Bodapati , Katrin Kirchhoff

Dialogue generation is an important NLP task fraught with many challenges. The challenges become more daunting for low-resource African languages. To enable the creation of dialogue agents for African languages, we contribute the first…

As a crucial component in task-oriented dialog systems, the Natural Language Generation (NLG) module converts a dialog act represented in a semantic form into a response in natural language. The success of traditional template-based or…

Computation and Language · Computer Science 2020-02-28 Baolin Peng , Chenguang Zhu , Chunyuan Li , Xiujun Li , Jinchao Li , Michael Zeng , Jianfeng Gao

Motivated by the needs of resource constrained dialog policy learning, we introduce dialog policy via differentiable inductive logic (DILOG). We explore the tasks of one-shot learning and zero-shot domain transfer with DILOG on SimDial and…

Computation and Language · Computer Science 2020-11-12 Zhenpeng Zhou , Ahmad Beirami , Paul Crook , Pararth Shah , Rajen Subba , Alborz Geramifard

Dialog state tracking (DST) is a crucial component in a task-oriented dialog system for conversational information access. A common practice in current dialog systems is to define the dialog state by a set of slot-value pairs. Such…

Computation and Language · Computer Science 2018-11-06 Yinpei Dai , Zhijian Ou , Dawei Ren , Pengfei Yu