中文
相关论文

相关论文: Multi-Hop Question Answering: When Can Humans Help…

200 篇论文

Large Language Models have been shown to contain extensive world knowledge in their parameters, enabling impressive performance on many knowledge intensive tasks. However, when deployed in novel settings, LLMs often encounter situations…

人工智能 · 计算机科学 2026-02-05 Khurram Yamin , Gaurav Ghosal , Bryan Wilder

Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by…

计算与语言 · 计算机科学 2019-07-02 Sewon Min , Victor Zhong , Luke Zettlemoyer , Hannaneh Hajishirzi

The explainability of a robot's actions is crucial to its acceptance in social spaces. Explaining why a robot fails to complete a given task is particularly important for non-expert users to be aware of the robot's capabilities and…

机器人学 · 计算机科学 2025-06-26 Pradip Pramanick , Silvia Rossi

Machine learning (ML) models can make decisions based on large amounts of data, but they can be missing personal knowledge available to human users about whom predictions are made. For example, a model trained to predict psychiatric…

机器学习 · 计算机科学 2024-06-14 Isaac Lage , Sonali Parbhoo , Finale Doshi-Velez

Real-world multi-hop QA is naturally linked with ambiguity, where a single query can trigger multiple reasoning paths that require independent resolution. Since ambiguity can occur at any stage, models must navigate layered uncertainty…

计算与语言 · 计算机科学 2026-04-16 Jeonghyun Park , Ingeol Baek , Seunghyun Yoon , Haeun Jang , Aparna Garimella , Akriti Jain , Nedim Lipka , Hwanhee Lee

Recent advances in reinforcement learning (RL) and Human-in-the-Loop (HitL) learning have made human-AI collaboration easier for humans to team with AI agents. Leveraging human expertise and experience with AI in intelligent systems can be…

Accurately answering complex questions has consistently been a significant challenge for Large Language Models (LLMs). To address this, this paper proposes a multi-hop question decomposition method for complex questions, building upon…

计算与语言 · 计算机科学 2025-09-08 Zucheng Liang , Wenxin Wei , Kaijie Zhang , Hongyi Chen

Retrieval plays a central role in multi-hop question answering (QA), where answering complex questions requires gathering multiple pieces of evidence. We introduce an Agentic Retrieval System that leverages large language models (LLMs) in a…

计算与语言 · 计算机科学 2025-10-17 Md Mahadi Hasan Nahid , Davood Rafiei

It is popular lately to train large language models to be used as chat assistants, but in the conversation between the user and the chat assistant, there are prompts, require multi-turns between the chat assistant and the user. However,…

计算与语言 · 计算机科学 2025-02-24 Haun Leung , ZiNan Wang

The rapid integration of Large Language Models (LLMs) into scientific writing fundamentally challenges traditional definitions of authorship, responsibility, and scientific integrity. As researchers transition from using computers as…

计算物理 · 物理学 2026-04-07 Yi Zhou

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

人工智能 · 计算机科学 2026-01-13 Pranav Kallem

Artificial intelligence is an emerging topic and will soon be able to perform decisions better than humans. In more complex and creative contexts such as innovation, however, the question remains whether machines are superior to humans.…

人工智能 · 计算机科学 2021-05-10 Dominik Dellermann , Nikolaus Lipusch , Philipp Ebel , Karl Michael Popp , Jan Marco Leimeister

Already today, humans and programming assistants based on large language models (LLMs) collaborate in everyday programming tasks. Clearly, a misalignment between how LLMs and programmers comprehend code can lead to misunderstandings,…

软件工程 · 计算机科学 2025-08-27 Youssef Abdelsalam , Norman Peitek , Anna-Maria Maurer , Mariya Toneva , Sven Apel

Despite recent advances in large language models (LLMs), most QA benchmarks are still confined to single-paragraph or single-document settings, failing to capture the complexity of real-world information-seeking tasks. Practical QA often…

计算与语言 · 计算机科学 2025-08-25 Jiwon Park , Seohyun Pyeon , Jinwoo Kim , Rina Carines Cabal , Yihao Ding , Soyeon Caren Han

Multi-hop questions still stump large language models (LLMs), which struggle to link information across multiple reasoning steps. We introduce Auto-Patch, a novel method that dynamically patches hidden states during inference to enhance…

计算与语言 · 计算机科学 2025-06-03 Aviv Jan , Dean Tahory , Omer Talmi , Omar Abo Mokh

Commonsense knowledge, a major constituent of artificial intelligence (AI), is primarily evaluated in practice by human-prescribed ground-truth labels. An important, albeit implicit, assumption of these labels is that they accurately…

人工智能 · 计算机科学 2026-01-23 Tuan Dung Nguyen , Duncan J. Watts , Mark E. Whiting

Multi-hop reasoning has been widely studied in recent years to obtain more interpretable link prediction. However, we find in experiments that many paths given by these models are actually unreasonable, while little works have been done on…

人工智能 · 计算机科学 2021-09-10 Xin Lv , Yixin Cao , Lei Hou , Juanzi Li , Zhiyuan Liu , Yichi Zhang , Zelin Dai

Question answering plays a pivotal role in human daily life because it involves our acquisition of knowledge about the world. However, due to the dynamic and ever-changing nature of real-world facts, the answer can be completely different…

计算与语言 · 计算机科学 2023-10-23 Xinyu Zhu , Cheng Yang , Bei Chen , Siheng Li , Jian-Guang Lou , Yujiu Yang

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

计算与语言 · 计算机科学 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

This paper is concerned with the task of multi-hop open-domain Question Answering (QA). This task is particularly challenging since it requires the simultaneous performance of textual reasoning and efficient searching. We present a method…

计算与语言 · 计算机科学 2019-06-18 Yair Feldman , Ran El-Yaniv