English
Related papers

Related papers: Deciding Whether to Ask Clarifying Questions in La…

200 papers

The rise of large language models has opened new avenues for users seeking legal advice. However, users often lack professional legal knowledge, which can lead to questions that omit critical information. This deficiency makes it…

Computation and Language · Computer Science 2025-02-13 Rujing Yao , Yiquan Wu , Tong Zhang , Xuhui Zhang , Yuting Huang , Yang Wu , Jiayin Yang , Changlong Sun , Fang Wang , Xiaozhong Liu

Lexical ambiguity is widespread in language, allowing for the reuse of economical word forms and therefore making language more efficient. If ambiguous words cannot be disambiguated from context, however, this gain in efficiency might make…

Computation and Language · Computer Science 2024-05-29 Tiago Pimentel , Rowan Hall Maudslay , Damián Blasi , Ryan Cotterell

Despite the widespread application of Large Language Models (LLMs) across various domains, they frequently exhibit overconfidence when encountering uncertain scenarios, yet existing solutions primarily rely on evasive responses (e.g., "I…

Artificial Intelligence · Computer Science 2025-06-03 Jingyu Liu , Jingquan Peng , xiaopeng Wu , Xubin Li , Tiezheng Ge , Bo Zheng , Yong Liu

Large language models (LLMs) define a distribution over text, which can be viewed as a probabilistic representation of uncertainty: sampling K responses yields a belief state - responses a model deems plausible. Existing work exploits this…

Computation and Language · Computer Science 2026-05-26 Joris Baan , Wilker Aziz , Barbara Plank , Raquel Fernández

Questions convey information about the questioner, namely what one does not know. In this paper, we propose a novel approach to allow a learning agent to ask what it considers as tricky to predict, in the course of producing a final output.…

Artificial Intelligence · Computer Science 2018-11-14 Sungmin Kang , David Keetae Park , Jaehyuk Chang , Jaegul Choo

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Natural language as a medium for human-computer interaction has long been anticipated, has been undergoing a sea-change with the advent of Large Language Models (LLMs) with startling capacities for processing and generating language. Many…

Computation and Language · Computer Science 2025-03-25 Riya Naik , Ashwin Srinivasan , Estrid He , Swati Agarwal

Clarifying questions are an integral component of modern information retrieval systems, directly impacting user satisfaction and overall system performance. Poorly formulated questions can lead to user frustration and confusion, negatively…

Information Retrieval · Computer Science 2026-02-03 Hossein A. Rahmani , Xi Wang , Mohammad Aliannejadi , Mohammadmehdi Naghiaei , Emine Yilmaz

Enabling open-domain dialogue systems to ask clarifying questions when appropriate is an important direction for improving the quality of the system response. Namely, for cases when a user request is not specific enough for a conversation…

Computation and Language · Computer Science 2021-09-14 Mohammad Aliannejadi , Julia Kiseleva , Aleksandr Chuklin , Jeffrey Dalton , Mikhail Burtsev

Temporary syntactic ambiguities arise when the beginning of a sentence is compatible with multiple syntactic analyses. We inspect to which extent neural language models (LMs) exhibit uncertainty over such analyses when processing…

Computation and Language · Computer Science 2021-09-17 Laura Aina , Tal Linzen

Large language models (LLMs) often respond even when prompts omit critical details or include misleading information, leading to hallucinations or reinforced misconceptions. We study how to evaluate and improve LLMs' ability to decide when…

Computation and Language · Computer Science 2026-04-22 Jiale Zhao , Ke Fang , Lu Cheng

The ultimate goal of embodied agents is to create collaborators that can interact with humans, not mere executors that passively follow instructions. This requires agents to communicate, coordinate, and adapt their actions based on human…

Robotics · Computer Science 2025-09-22 Xingyao Lin , Xinghao Zhu , Tianyi Lu , Sicheng Xie , Hui Zhang , Xipeng Qiu , Zuxuan Wu , Yu-Gang Jiang

Despite the remarkable abilities of Large Language Models (LLMs) to answer questions, they often display a considerable level of overconfidence even when the question does not have a definitive answer. To avoid providing hallucinated…

Computation and Language · Computer Science 2024-10-03 Yang Deng , Yong Zhao , Moxin Li , See-Kiong Ng , Tat-Seng Chua

The ability to understand a user's underlying needs is critical for conversational systems, especially with limited input from users in a conversation. Thus, in such a domain, Asking Clarification Questions (ACQs) to reveal users' true…

Information Retrieval · Computer Science 2023-05-26 Hossein A. Rahmani , Xi Wang , Yue Feng , Qiang Zhang , Emine Yilmaz , Aldo Lipani

Large language models (LLMs) have significantly improved the ability to perform tasks in the field of code generation. However, there is still a gap between LLMs being capable coders and being top-tier software engineers. Based on the…

Software Engineering · Computer Science 2024-01-23 Jie JW Wu

This paper investigates the formal pragmatics of ambiguous expressions by modeling ambiguity in a multi-agent system. Such a framework allows us to give a more refined notion of the kind of information that is conveyed by ambiguous…

Computation and Language · Computer Science 2007-05-23 Christof Monz

When deciding how to act under uncertainty, agents may choose to act to reduce uncertainty or they may act despite that uncertainty. In communicative settings, an important way of reducing uncertainty is by asking clarification questions…

Computation and Language · Computer Science 2026-05-26 Polina Tsvilodub , Karl Mulligan , Todd Snider , Robert D. Hawkins , Michael Franke

This study addresses the challenge of ambiguity in knowledge graph question answering (KGQA). While recent KGQA systems have made significant progress, particularly with the integration of large language models (LLMs), they typically assume…

Computation and Language · Computer Science 2025-04-15 Liqiang Wen , Guanming Xiong , Tong Mo , Bing Li , Weiping Li , Wen Zhao

Large language models (LLMs) have delivered significant breakthroughs across diverse domains but can still produce unreliable or misleading outputs, posing critical challenges for real-world applications. While many recent studies focus on…

Computation and Language · Computer Science 2025-09-08 Yang Nan , Pengfei He , Ravi Tandon , Han Xu

When automating plan generation for a real-world sequential decision problem, the goal is often not to replace the human planner, but to facilitate an iterative reasoning and elicitation process, where the human's role is to guide the AI…

Artificial Intelligence · Computer Science 2026-04-10 Guilhem Fouilhé , Rebecca Eifler , Antonin Poché , Sylvie Thiébaux , Nicholas Asher