English
Related papers

Related papers: Contextualized Evaluations: Judging Language Model…

200 papers

Large language models have advanced web agents, yet current agents lack personalization capabilities. Since users rarely specify every detail of their intent, practical web agents must be able to interpret ambiguous queries by inferring…

Computation and Language · Computer Science 2026-05-28 Serin Kim , Sangam Lee , Dongha Lee

A decision procedure implemented over a computational trust mechanism aims to allow for decisions to be made regarding whether some entity or information should be trusted. As recognised in the literature, trust is contextual, and we…

Other Computer Science · Computer Science 2013-09-20 Federico Cerutti , Alice Toniolo , Nir Oren , Timothy J. Norman

Human conversation relies heavily on conversational implicature, in which speakers convey meanings that are suggested rather than explicitly stated. Although recent large language models exhibit strong conversational fluency, they remain…

Computation and Language · Computer Science 2026-05-26 Hirona Jacqueline Arai , Xiang Ren

Neural sequence to sequence models are well established for applications which can be cast as mapping a single input sequence into a single output sequence. In this work, we focus on cases where generation is conditioned on both a short…

Computation and Language · Computer Science 2019-11-25 Xinyi Wang , Jason Weston , Michael Auli , Yacine Jernite

When reasoning about formal objects whose structures involve binding, it is often necessary to analyze expressions relative to a context that associates types, values, and other related attributes with variables that appear free in the…

Logic in Computer Science · Computer Science 2024-07-10 Terrance Gray , Gopalan Nadathur

User prompts to large language models (LLMs) are often ambiguous or under-specified, and subtle contextual cues shaped by user intentions, prior knowledge, and risk factors strongly influence what constitutes an appropriate response.…

Machine Learning · Computer Science 2025-12-16 Minseon Kim , Lucas Caccia , Zhengyan Shi , Matheus Pereira , Marc-Alexandre Côté , Xingdi Yuan , Alessandro Sordoni

Context is a rich concept and is an elusive concept to define. The concept of context has been studied by philosophers, linguists, psychologists, and recently by computer scientists. Within each research community the term context was…

Human-Computer Interaction · Computer Science 2009-12-10 Kaiyu Wan

Machine learning models are often brittle on production data despite achieving high accuracy on benchmark datasets. Benchmark datasets have traditionally served dual purposes: first, benchmarks offer a standard on which machine learning…

Machine Learning · Computer Science 2022-09-26 Matthew Groh

There is significant evidence that real-world communication cannot be reduced to sending signals with context-independent meaning. In this work, based on a variant of the classical Lewis (1969) signaling model, we explore the conditions for…

Artificial Intelligence · Computer Science 2024-08-06 Krzysztof Główka , Julian Zubek , Joanna Rączaszek-Leonardi

Spellchecking is one of the most fundamental and widely used search features. Correcting incorrectly spelled user queries not only enhances the user experience but is expected by the user. However, most widely available spellchecking…

Computation and Language · Computer Science 2024-04-16 Sanat Sharma , Josep Valls-Vargas , Tracy Holloway King , Francois Guerin , Chirag Arora

Navigating health questions can be daunting in the modern information landscape. Large language models (LLMs) may provide tailored, accessible information, but also risk being inaccurate, biased or misleading. We present insights from 4…

Humans quite frequently interact with conversational agents. The rapid advancement in generative language modeling through neural networks has helped advance the creation of intelligent conversational agents. Researchers typically evaluate…

Computation and Language · Computer Science 2020-02-27 Sashank Santhanam , Alireza Karduni , Samira Shaikh

Statistical models of word-sense disambiguation are often based on a small number of contextual features or on a model that is assumed to characterize the interactions among a set of features. Model selection is presented as an alternative…

cmp-lg · Computer Science 2008-02-03 Ted Pedersen , Rebecca Bruce , Janyce Wiebe

Recent work in neural machine translation has demonstrated both the necessity and feasibility of using inter-sentential context -- context from sentences other than those currently being translated. However, while many current methods…

Computation and Language · Computer Science 2021-06-03 Patrick Fernandes , Kayo Yin , Graham Neubig , André F. T. Martins

Sentence encoders map sentences to real valued vectors for use in downstream applications. To peek into these representations - e.g., to increase interpretability of their results - probing tasks have been designed which query them for…

Computation and Language · Computer Science 2020-10-29 Steffen Eger , Johannes Daxenberger , Iryna Gurevych

Ambiguous words or underspecified references require interlocutors to resolve them, often by relying on shared context and commonsense knowledge. Therefore, we systematically investigate whether Large Language Models (LLMs) can leverage…

Computation and Language · Computer Science 2025-09-22 Lukas Ellinger , Georg Groh

Our work is generally focused on recommending for small or medium-sized e-commerce portals, where explicit feedback is absent and thus the usage of implicit feedback is necessary. Nonetheless, for some implicit feedback features, the…

Information Retrieval · Computer Science 2016-12-16 Ladislav Peska

We study the settings for which deep contextual embeddings (e.g., BERT) give large improvements in performance relative to classic pretrained embeddings (e.g., GloVe), and an even simpler baseline---random word embeddings---focusing on the…

Computation and Language · Computer Science 2020-05-20 Simran Arora , Avner May , Jian Zhang , Christopher Ré

We present a context-aware neural ranking model to exploit users' on-task search activities and enhance retrieval performance. In particular, a two-level hierarchical recurrent neural network is introduced to learn search context…

Information Retrieval · Computer Science 2019-06-07 Wasi Uddin Ahmad , Kai-Wei Chang , Hongning Wang

Models for question answering, dialogue agents, and summarization often interpret the meaning of a sentence in a rich context and use that meaning in a new context. Taking excerpts of text can be problematic, as key pieces may not be…

Computation and Language · Computer Science 2021-02-11 Eunsol Choi , Jennimaria Palomaki , Matthew Lamm , Tom Kwiatkowski , Dipanjan Das , Michael Collins