English
Related papers

Related papers: Multi-Hop Question Answering: When Can Humans Help…

200 papers

Large Language Models have been shown to contain extensive world knowledge in their parameters, enabling impressive performance on many knowledge intensive tasks. However, when deployed in novel settings, LLMs often encounter situations…

Artificial Intelligence · Computer Science 2026-02-05 Khurram Yamin , Gaurav Ghosal , Bryan Wilder

Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by…

Computation and Language · Computer Science 2019-07-02 Sewon Min , Victor Zhong , Luke Zettlemoyer , Hannaneh Hajishirzi

The explainability of a robot's actions is crucial to its acceptance in social spaces. Explaining why a robot fails to complete a given task is particularly important for non-expert users to be aware of the robot's capabilities and…

Robotics · Computer Science 2025-06-26 Pradip Pramanick , Silvia Rossi

Machine learning (ML) models can make decisions based on large amounts of data, but they can be missing personal knowledge available to human users about whom predictions are made. For example, a model trained to predict psychiatric…

Machine Learning · Computer Science 2024-06-14 Isaac Lage , Sonali Parbhoo , Finale Doshi-Velez

Real-world multi-hop QA is naturally linked with ambiguity, where a single query can trigger multiple reasoning paths that require independent resolution. Since ambiguity can occur at any stage, models must navigate layered uncertainty…

Computation and Language · Computer Science 2026-04-16 Jeonghyun Park , Ingeol Baek , Seunghyun Yoon , Haeun Jang , Aparna Garimella , Akriti Jain , Nedim Lipka , Hwanhee Lee

Recent advances in reinforcement learning (RL) and Human-in-the-Loop (HitL) learning have made human-AI collaboration easier for humans to team with AI agents. Leveraging human expertise and experience with AI in intelligent systems can be…

Accurately answering complex questions has consistently been a significant challenge for Large Language Models (LLMs). To address this, this paper proposes a multi-hop question decomposition method for complex questions, building upon…

Computation and Language · Computer Science 2025-09-08 Zucheng Liang , Wenxin Wei , Kaijie Zhang , Hongyi Chen

Retrieval plays a central role in multi-hop question answering (QA), where answering complex questions requires gathering multiple pieces of evidence. We introduce an Agentic Retrieval System that leverages large language models (LLMs) in a…

Computation and Language · Computer Science 2025-10-17 Md Mahadi Hasan Nahid , Davood Rafiei

It is popular lately to train large language models to be used as chat assistants, but in the conversation between the user and the chat assistant, there are prompts, require multi-turns between the chat assistant and the user. However,…

Computation and Language · Computer Science 2025-02-24 Haun Leung , ZiNan Wang

The rapid integration of Large Language Models (LLMs) into scientific writing fundamentally challenges traditional definitions of authorship, responsibility, and scientific integrity. As researchers transition from using computers as…

Computational Physics · Physics 2026-04-07 Yi Zhou

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem

Artificial intelligence is an emerging topic and will soon be able to perform decisions better than humans. In more complex and creative contexts such as innovation, however, the question remains whether machines are superior to humans.…

Artificial Intelligence · Computer Science 2021-05-10 Dominik Dellermann , Nikolaus Lipusch , Philipp Ebel , Karl Michael Popp , Jan Marco Leimeister

Already today, humans and programming assistants based on large language models (LLMs) collaborate in everyday programming tasks. Clearly, a misalignment between how LLMs and programmers comprehend code can lead to misunderstandings,…

Software Engineering · Computer Science 2025-08-27 Youssef Abdelsalam , Norman Peitek , Anna-Maria Maurer , Mariya Toneva , Sven Apel

Despite recent advances in large language models (LLMs), most QA benchmarks are still confined to single-paragraph or single-document settings, failing to capture the complexity of real-world information-seeking tasks. Practical QA often…

Computation and Language · Computer Science 2025-08-25 Jiwon Park , Seohyun Pyeon , Jinwoo Kim , Rina Carines Cabal , Yihao Ding , Soyeon Caren Han

Multi-hop questions still stump large language models (LLMs), which struggle to link information across multiple reasoning steps. We introduce Auto-Patch, a novel method that dynamically patches hidden states during inference to enhance…

Computation and Language · Computer Science 2025-06-03 Aviv Jan , Dean Tahory , Omer Talmi , Omar Abo Mokh

Commonsense knowledge, a major constituent of artificial intelligence (AI), is primarily evaluated in practice by human-prescribed ground-truth labels. An important, albeit implicit, assumption of these labels is that they accurately…

Artificial Intelligence · Computer Science 2026-01-23 Tuan Dung Nguyen , Duncan J. Watts , Mark E. Whiting

Multi-hop reasoning has been widely studied in recent years to obtain more interpretable link prediction. However, we find in experiments that many paths given by these models are actually unreasonable, while little works have been done on…

Artificial Intelligence · Computer Science 2021-09-10 Xin Lv , Yixin Cao , Lei Hou , Juanzi Li , Zhiyuan Liu , Yichi Zhang , Zelin Dai

Question answering plays a pivotal role in human daily life because it involves our acquisition of knowledge about the world. However, due to the dynamic and ever-changing nature of real-world facts, the answer can be completely different…

Computation and Language · Computer Science 2023-10-23 Xinyu Zhu , Cheng Yang , Bei Chen , Siheng Li , Jian-Guang Lou , Yujiu Yang

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

Computation and Language · Computer Science 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

This paper is concerned with the task of multi-hop open-domain Question Answering (QA). This task is particularly challenging since it requires the simultaneous performance of textual reasoning and efficient searching. We present a method…

Computation and Language · Computer Science 2019-06-18 Yair Feldman , Ran El-Yaniv