English
Related papers

Related papers: AmbiCoref: Evaluating Human and Model Sensitivity …

200 papers

In interactions between users and language model agents, user utterances frequently exhibit ellipsis (omission of words or phrases) or imprecision (lack of exactness) to prioritize efficiency. This can lead to varying interpretations of the…

Computation and Language · Computer Science 2024-10-07 Hyuhng Joon Kim , Youna Kim , Cheonbok Park , Junyeob Kim , Choonghyun Park , Kang Min Yoo , Sang-goo Lee , Taeuk Kim

Diagnostic datasets that can detect biased models are an important prerequisite for bias reduction within natural language processing. However, undesired patterns in the collected data can make such tests incorrect. For example, if the…

Computation and Language · Computer Science 2020-12-16 Vid Kocijan , Oana-Maria Camburu , Thomas Lukasiewicz

Sense embedding learning methods learn different embeddings for the different senses of an ambiguous word. One sense of an ambiguous word might be socially biased while its other senses remain unbiased. In comparison to the numerous prior…

Computation and Language · Computer Science 2022-03-17 Yi Zhou , Masahiro Kaneko , Danushka Bollegala

Despite the frequent challenges posed by ambiguity when representing meaning via natural language, it is often ignored or deliberately removed in tasks mapping language to formally-designed representations, which generally assume a…

Computation and Language · Computer Science 2024-01-23 Elias Stengel-Eskin , Kyle Rawlins , Benjamin Van Durme

Coreference Resolution is a well studied problem in NLP. While widely studied for English and other resource-rich languages, research on coreference resolution in Bengali largely remains unexplored due to the absence of relevant datasets.…

Computation and Language · Computer Science 2023-07-06 Shadman Rohan , Mojammel Hossain , Mohammad Mamun Or Rashid , Nabeel Mohammed

Pronoun resolution is a major area of natural language understanding. However, large-scale training sets are still scarce, since manually labelling data is costly. In this work, we introduce WikiCREM (Wikipedia CoREferences Masked) a…

Computation and Language · Computer Science 2019-10-15 Vid Kocijan , Oana-Maria Camburu , Ana-Maria Cretu , Yordan Yordanov , Phil Blunsom , Thomas Lukasiewicz

Referential ambiguities arise in dialogue when a referring expression does not uniquely identify the intended referent for the addressee. Addressees usually detect such ambiguities immediately and work with the speaker to repair it using…

Computation and Language · Computer Science 2023-07-31 Javier Chiyah-Garcia , Alessandro Suglia , Arash Eshghi , Helen Hastie

Adjective phrases like "a little bit surprised", "completely shocked", or "not stunned at all" are not handled properly by currently published state-of-the-art emotion classification and intensity prediction systems which use pre-dominantly…

Computation and Language · Computer Science 2019-04-08 Laura Bostan , Roman Klinger

Language model users often issue queries that lack specification, where the context under which a query was issued -- such as the user's identity, the query's intent, and the criteria for a response to be useful -- is not explicit. For…

Computation and Language · Computer Science 2025-05-27 Chaitanya Malaviya , Joseph Chee Chang , Dan Roth , Mohit Iyyer , Mark Yatskar , Kyle Lo

Generic sentences express generalisations about the world without explicit quantification. Although generics are central to everyday communication, building a precise semantic framework has proven difficult, in part because speakers use…

Computation and Language · Computer Science 2024-12-17 Gustavo Cilleruelo Calderón , Emily Allaway , Barry Haddow , Alexandra Birch

Idiomatic expressions are an integral part of human languages, often used to express complex ideas in compressed or conventional ways (e.g. eager beaver as a keen and enthusiastic person). However, their interpretations may not be…

Computation and Language · Computer Science 2024-11-06 Wei He , Tiago Kramer Vieira , Marcos Garcia , Carolina Scarton , Marco Idiart , Aline Villavicencio

The classic duck-rabbit illusion reveals that when visual evidence is ambiguous, the human brain must decide what it sees. But where exactly do human observers draw the line between ''duck'' and ''rabbit'', and do machine classifiers draw…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuqi Hu , Vasha DuTell , Ahna R. Girshick , Jennifer E. Corbett

Large language models often respond to ambiguous requests by implicitly committing to one interpretation, frustrating users and creating safety risks when that interpretation is wrong. We propose generating a single structured response that…

Computation and Language · Computer Science 2026-04-15 Irina Saparina , Mirella Lapata

Resolution of lexical ambiguity, commonly termed ``word sense disambiguation'', is expected to improve the analytical accuracy for tasks which are sensitive to lexical semantics. Such tasks include machine translation, information…

cmp-lg · Computer Science 2007-05-23 Atsushi Fujii

Multimodal reference resolution, including phrase grounding, aims to understand the semantic relations between mentions and real-world objects. Phrase grounding between images and their captions is a well-established task. In contrast, for…

Computation and Language · Computer Science 2025-06-03 Shun Inadumi , Nobuhiro Ueda , Koichiro Yoshino

Document-level relation extraction is to extract relation facts from a document consisting of multiple sentences, in which pronoun crossed sentences are a ubiquitous phenomenon against a single sentence. However, most of the previous works…

Computation and Language · Computer Science 2022-02-23 Zhongxuan Xue , Rongzhen Li , Qizhu Dai , Zhong Jiang

Affective computing seeks to support the holistic development of artificial intelligence by enabling machines to engage with human emotion. Recent foundation models, particularly large language models (LLMs), have been trained and evaluated…

Computation and Language · Computer Science 2026-03-16 Sree Bhattacharyya , Evgenii Kuriabov , Lucas Craig , Tharun Dilliraj , Reginald B. Adams, , Jia Li , James Z. Wang

_Uncertainty expressions_ such as "probably" or "highly unlikely" are pervasive in human language. While prior work has established that there is population-level agreement in terms of how humans quantitatively interpret these expressions,…

Computation and Language · Computer Science 2024-11-08 Catarina G Belem , Markelle Kelly , Mark Steyvers , Sameer Singh , Padhraic Smyth

We study the ability of language models to reason about appropriate information disclosure - a central aspect of the evolving field of agentic privacy. Whereas previous works have focused on evaluating a model's ability to align with human…

Artificial Intelligence · Computer Science 2026-01-28 Ren Yi , Octavian Suciu , Adria Gascon , Sarah Meiklejohn , Eugene Bagdasarian , Marco Gruteser

We study the understanding of embodied reference: One agent uses both language and gesture to refer to an object to another agent in a shared physical environment. Of note, this new visual task requires understanding multimodal cues with…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Yixin Chen , Qing Li , Deqian Kong , Yik Lun Kei , Song-Chun Zhu , Tao Gao , Yixin Zhu , Siyuan Huang