English
Related papers

Related papers: Clarify When Necessary: Resolving Ambiguity Throug…

200 papers

Large language models (LLMs) are increasingly expected to function as collaborative partners, engaging in back-and-forth dialogue to solve complex, ambiguous problems. However, current LLMs often falter in real-world settings, defaulting to…

Artificial Intelligence · Computer Science 2025-07-30 Tenghao Huang , Sihao Chen , Muhao Chen , Jonathan May , Longqi Yang , Mengting Wan , Pei Zhou

In information retrieval (IR), providing appropriate clarifications to better understand users' information needs is crucial for building a proactive search-oriented dialogue system. Due to the strong in-context learning ability of large…

Information Retrieval · Computer Science 2025-04-29 Anfu Tang , Laure Soulier , Vincent Guigue

Large language models (LLMs) have shown strong capabilities, enabling concise, context-aware answers in question answering (QA) tasks. The lack of transparency in complex LLMs has inspired extensive research aimed at developing methods to…

Computation and Language · Computer Science 2025-09-22 Yangyi Li , Mengdi Huai

Signal Temporal Logic (STL) is a formal language for specifying real-time behaviors of cyber-physical systems (CPS). Automatically transforming natural language requirements into STL specifications has received growing attention. Recent…

Software Engineering · Computer Science 2026-05-05 Yue Fang , Zhi Jin , Jie An , Hongshen Chen , Xiaohong Chen , Naijun Zhan

Large Language Models (LLMs) are increasingly used as coding assistants. However, the ambiguity of the developer's prompt often leads to incorrect code generation, as current models struggle to infer user intent without extensive prompt…

Artificial Intelligence · Computer Science 2025-07-30 Harsh Darji , Thibaud Lutellier

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

Computation and Language · Computer Science 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

When automating plan generation for a real-world sequential decision problem, the goal is often not to replace the human planner, but to facilitate an iterative reasoning and elicitation process, where the human's role is to guide the AI…

Artificial Intelligence · Computer Science 2026-04-10 Guilhem Fouilhé , Rebecca Eifler , Antonin Poché , Sylvie Thiébaux , Nicholas Asher

This study addresses the challenge of ambiguity in knowledge graph question answering (KGQA). While recent KGQA systems have made significant progress, particularly with the integration of large language models (LLMs), they typically assume…

Computation and Language · Computer Science 2025-04-15 Liqiang Wen , Guanming Xiong , Tong Mo , Bing Li , Weiping Li , Wen Zhao

Equipped with the capability to call functions, modern large language models (LLMs) can leverage external tools for addressing a range of tasks unattainable through language skills alone. However, the effective execution of these tools…

Computation and Language · Computer Science 2026-04-30 Wenxuan Wang , Juluan Shi , Zixuan Ling , Yuk-Kit Chan , Chaozheng Wang , Cheryl Lee , Youliang Yuan , Jen-tse Huang , Wenxiang Jiao , Michael R. Lyu

Large language models (LLMs) must often respond to highly ambiguous user requests. In such cases, the LLM's best response may be to ask a clarifying question to elicit more information. Existing LLMs often respond by presupposing a single…

Computation and Language · Computer Science 2025-03-19 Michael J. Q. Zhang , W. Bradley Knox , Eunsol Choi

Despite the impressive performance of large language models (LLMs) across various benchmarks, their ability to address ambiguously specified problems--frequent in real-world interactions--remains underexplored. To address this gap, we…

Computation and Language · Computer Science 2025-02-10 Katarzyna Kobalczyk , Nicolas Astorga , Tennison Liu , Mihaela van der Schaar

Multi-turn conversations with an Enterprise AI Assistant can be challenging due to conversational dependencies in questions, leading to ambiguities and errors. To address this, we propose an NLU-NLG framework for ambiguity detection and…

Coping with ambiguous questions has been a perennial problem in real-world dialogue systems. Although clarification by asking questions is a common form of human interaction, it is hard to define appropriate questions to elicit more…

Computation and Language · Computer Science 2020-12-18 Xiang Hu , Zujie Wen , Yafang Wang , Xiaolong Li , Gerard de Melo

Natural language reasoning plays an increasingly important role in improving language models' ability to solve complex language understanding tasks. An interesting use case for reasoning is the resolution of context-dependent ambiguity. But…

Computation and Language · Computer Science 2023-10-24 Stefan F. Schouten , Peter Bloem , Ilia Markov , Piek Vossen

Users often formulate their search queries with immature language without well-developed keywords and complete structures. Such queries fail to express their true information needs and raise ambiguity as fragmental language often yield…

Information Retrieval · Computer Science 2021-01-19 Zhenduo Wang , Qingyao Ai

Asking clarifying questions in response to search queries has been recognized as a useful technique for revealing the underlying intent of the query. Clarification has applications in retrieval systems with different interfaces, from the…

Information Retrieval · Computer Science 2020-06-02 Hamed Zamani , Bhaskar Mitra , Everest Chen , Gord Lueck , Fernando Diaz , Paul N. Bennett , Nick Craswell , Susan T. Dumais

Robots operating alongside humans often encounter unfamiliar environments that make autonomous task completion challenging. Though improving models and increasing dataset size can enhance a robot's performance in unseen environments, data…

Robotics · Computer Science 2024-06-10 Ifueko Igbinedion , Sertac Karaman

In interactions between users and language model agents, user utterances frequently exhibit ellipsis (omission of words or phrases) or imprecision (lack of exactness) to prioritize efficiency. This can lead to varying interpretations of the…

Computation and Language · Computer Science 2024-10-07 Hyuhng Joon Kim , Youna Kim , Cheonbok Park , Junyeob Kim , Choonghyun Park , Kang Min Yoo , Sang-goo Lee , Taeuk Kim

Interpretability tools that offer explanations in the form of a dialogue have demonstrated their efficacy in enhancing users' understanding (Slack et al., 2023; Shen et al., 2023), as one-off explanations may fall short in providing…

Computation and Language · Computer Science 2024-04-25 Qianli Wang , Tatiana Anikina , Nils Feldhus , Josef van Genabith , Leonhard Hennig , Sebastian Möller

Clarification-seeking behavior is widely regarded as a desirable property of LLM agents, enabling them to resolve ambiguity before acting on underspecified tasks. However, the security implications of this interaction pattern remain…

Cryptography and Security · Computer Science 2026-05-19 Udari Madhushani Sehwag , Zhengyang Shan , Heming Liu , Dileepa Lakshan , Joseph Brandifino , Max Fenkell