English
Related papers

Related papers: Incorporating Annotator Uncertainty into Represent…

200 papers

Emotion Recognition in Conversations (ERC) has been gaining increasing importance as conversational agents become more and more common. Recognizing emotions is key for effective communication, being a crucial component in the development of…

Computation and Language · Computer Science 2023-06-06 Patrícia Pereira , Helena Moniz , Isabel Dias , Joao Paulo Carvalho

Identifying user preferences in dialogue systems is a pivotal aspect of providing satisfying services. Current research shows that using large language models (LLMs) to fine-tune a task-specific preference extractor yields excellent results…

Computation and Language · Computer Science 2025-08-05 Cheng Wang , ziru Liu , Pengcheng Tang , Mingyu Zhang , Quanyu Dai , Yue Zhu

Speech is a fundamental means of communication that can be seen to provide two channels for transmitting information: the lexical channel of which words are said, and the non-lexical channel of how they are spoken. Both channels shape…

Computation and Language · Computer Science 2026-02-02 Sarenne Wallbridge , Peter Bell , Catherine Lai

Collaborative dialogue relies on participants incrementally establishing common ground, yet in asymmetric settings they may believe they agree while referring to different entities. We introduce a perspectivist annotation scheme for the…

Computation and Language · Computer Science 2026-03-17 Nan Li , Albert Gatt , Massimo Poesio

The aim of this work is to provide a unified framework for ordinal representations of uncertainty lying at the crosswords between possibility and probability theories. Such confidence relations between events are commonly found in monotonic…

Artificial Intelligence · Computer Science 2012-08-07 Didier Dubois , Helene Fargier

The idea that discourse relations are construed through explicit content and shared, or implicit, knowledge between producer and interpreter is ubiquitous in discourse research and linguistics. However, the actual contribution of the…

Computation and Language · Computer Science 2022-08-10 A. Reig-Alamillo , D. Torres-Moreno , E. Morales-González , M. Toledo-Acosta , A. Taroni , J. Hermosillo-Valadez

Without discourse connectives, classifying implicit discourse relations is a challenging task and a bottleneck for building a practical discourse parser. Previous research usually makes use of one kind of discourse framework such as PDTB or…

Computation and Language · Computer Science 2016-03-10 Yang Liu , Sujian Li , Xiaodong Zhang , Zhifang Sui

Typically, when evaluating Theory of Mind, we consider the beliefs of others to be binary: held or not held. But what if someone is unsure about their own beliefs? How can we quantify this uncertainty? We propose a new suite of tasks,…

Computation and Language · Computer Science 2024-09-24 Anthony Sicilia , Malihe Alikhani

Evaluation of conversational naturalness is essential for developing human-like speech agents. However, existing speech naturalness predictors are often designed to assess utterances from a single speaker, failing to capture…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Anfeng Xu , Yashesh Gaur , Naoyuki Kanda , Zhicheng Ouyang , Katerina Zmolikova , Desh Raj , Simone Merello , Anna Sun , Ozlem Kalinli

The recent abundance of conversational data on the Web and elsewhere calls for effective NLP systems for dialog understanding. Complete utterance-level understanding often requires context understanding, defined by nearby utterances. In…

Computation and Language · Computer Science 2020-10-23 Deepanway Ghosal , Navonil Majumder , Rada Mihalcea , Soujanya Poria

This paper investigates the role of text in visualizations, specifically the impact of text position, semantic content, and biased wording. Two empirical studies were conducted based on two tasks (predicting data trends and appraising bias)…

Human-Computer Interaction · Computer Science 2024-01-09 Chase Stokes , Cindy Xiong Bearfield , Marti A. Hearst

Ensuring annotator quality in training and evaluation data is a key piece of machine learning in NLP. Tasks such as sentiment analysis and offensive speech detection are intrinsically subjective, creating a challenging scenario for…

Computation and Language · Computer Science 2024-09-23 Sujan Dutta , Deepak Pandita , Tharindu Cyril Weerasooriya , Marcos Zampieri , Christopher M. Homan , Ashiqur R. KhudaBukhsh

Establishing evaluation schemes for spoken dialogue systems is important, but it can also be challenging. While subjective evaluations are commonly used in user experiments, objective evaluations are necessary for research comparison and…

Computation and Language · Computer Science 2024-01-24 Koji Inoue , Divesh Lala , Keiko Ochi , Tatsuya Kawahara , Gabriel Skantze

The ability to identify and resolve uncertainty is crucial for the robustness of a dialogue system. Indeed, this has been confirmed empirically on systems that utilise Bayesian approaches to dialogue belief tracking. However, such systems…

Computation and Language · Computer Science 2021-09-10 Carel van Niekerk , Andrey Malinin , Christian Geishauser , Michael Heck , Hsien-chin Lin , Nurul Lubis , Shutong Feng , Milica Gašić

Vocal entrainment is a social adaptation mechanism in human interaction, knowledge of which can offer useful insights to an individual's cognitive-behavioral characteristics. We propose a context-aware approach for measuring vocal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Rimita Lahiri , Md Nasir , Catherine Lord , So Hyun Kim , Shrikanth Narayanan

Existing research studies on cross-sentence relation extraction in long-form multi-party conversations aim to improve relation extraction without considering the explainability of such methods. This work addresses that gap by focusing on…

Computation and Language · Computer Science 2022-10-20 Alon Albalak , Varun Embar , Yi-Lin Tuan , Lise Getoor , William Yang Wang

This paper suggests a direction of coreference resolution for online decoding on actively generated input such as dialogue, where the model accepts an utterance and its past context, then finds mentions in the current utterance as well as…

Computation and Language · Computer Science 2022-05-24 Liyan Xu , Jinho D. Choi

Discourse relation classification is an especially difficult task without explicit context markers (Prasad et al., 2008). Current approaches to implicit relation prediction solely rely on two neighboring sentences being targeted, ignoring…

Computation and Language · Computer Science 2024-05-20 Evi Judge , Reece Suchocki , Konner Syed

Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue context from user and…

Computation and Language · Computer Science 2024-08-13 Wonjun Lee , San Kim , Gary Geunbae Lee

A multi-turn dialogue is composed of multiple utterances from two or more different speaker roles. Thus utterance- and speaker-aware clues are supposed to be well captured in models. However, in the existing retrieval-based multi-turn…

Computation and Language · Computer Science 2020-12-15 Longxiang Liu , Zhuosheng Zhang , Hai Zhao , Xi Zhou , Xiang Zhou