English
Related papers

Related papers: LitCQD: Multi-Hop Reasoning in Incomplete Knowledg…

200 papers

Multi-hop reasoning over financial disclosures is often a retrieval problem before it becomes a reasoning or generation problem: relevant facts are dispersed across sections, filings, companies, and years, and LLMs often expend excessive…

Computational Finance · Quantitative Finance 2025-10-06 Abhinav Arun , Reetu Raj Harsh , Bhaskarjit Sarmah , Stefano Pasquali

Large language models (LLMs) demonstrate strong reasoning abilities when prompted to generate chain-of-thought (CoT) explanations alongside answers. However, previous research on evaluating LLMs has solely focused on answer accuracy,…

Computation and Language · Computer Science 2024-06-21 Minh-Vuong Nguyen , Linhao Luo , Fatemeh Shiri , Dinh Phung , Yuan-Fang Li , Thuy-Trang Vu , Gholamreza Haffari

Recent work in Natural Language Processing and Computer Vision has been using textual information -- e.g., entity names and descriptions -- available in knowledge graphs to ground neural models to high-quality structured data. However, when…

Artificial Intelligence · Computer Science 2023-11-28 Simone Conia , Min Li , Daniel Lee , Umar Farooq Minhas , Ihab Ilyas , Yunyao Li

Building training-ready multi-hop question answering (QA) datasets that truly stress a model's retrieval and reasoning abilities remains highly challenging recently. While there have been a few recent evaluation datasets that capture the…

Artificial Intelligence · Computer Science 2025-11-26 Bingsen Qiu , Zijian Liu , Xiao Liu , Bingjie Wang , Feier Zhang , Yixuan Qin , Chunyan Li , Haoshen Yang , Zeren Gao

Multi-hop reasoning is an effective approach for query answering (QA) over incomplete knowledge graphs (KGs). The problem can be formulated in a reinforcement learning (RL) setup, where a policy-based agent sequentially extends its…

Artificial Intelligence · Computer Science 2018-09-13 Xi Victoria Lin , Richard Socher , Caiming Xiong

Incorporating multiple knowledge sources is proven to be beneficial for answering complex factoid questions. To utilize multiple knowledge bases (KB), previous works merge all KBs into a single graph via entity alignment and reduce the…

Computation and Language · Computer Science 2023-09-12 Minhao Zhang , Yongliang Ma , Yanzeng Li , Ruoyu Zhang , Lei Zou , Ming Zhou

Recently, end-to-end trained models for multiple-choice commonsense question answering (QA) have delivered promising results. However, such question-answering systems cannot be directly applied in real-world scenarios where answer…

Computation and Language · Computer Science 2023-03-21 Zhen Han , Yue Feng , Mingming Sun

Documents are fundamental to preserving and disseminating information, often incorporating complex layouts, tables, and charts that pose significant challenges for automatic document understanding (DU). While vision-language large models…

Computation and Language · Computer Science 2025-06-19 Negar Foroutan , Angelika Romanou , Matin Ansaripour , Julian Martin Eisenschlos , Karl Aberer , Rémi Lebret

Retrieval of information from graph-structured knowledge bases represents a promising direction for improving the factuality of LLMs. While various solutions have been proposed, a comparison of methods is difficult due to the lack of…

Machine Learning · Computer Science 2025-12-05 Alberto Cattaneo , Carlo Luschi , Daniel Justus

Direct answering of questions that involve multiple entities and relations is a challenge for text-based QA. This problem is most pronounced when answers can be found only by joining evidence from multiple documents. Curated knowledge…

Information Retrieval · Computer Science 2020-12-01 Xiaolu Lu , Soumajit Pramanik , Rishiraj Saha Roy , Abdalghani Abujabal , Yafang Wang , Gerhard Weikum

Multi-hop question answering (QA) requires reasoning across multiple documents, yet existing retrieval-augmented generation (RAG) approaches address this either through graph-based methods requiring additional online processing or iterative…

Computation and Language · Computer Science 2026-03-18 Zhenghua Bao , Yi Shi

Large Language Models (LLMs) provide flexible natural language processing capabilities, while knowledge graphs (KGs) offer explicit and structured knowledge. Integrating these two in a complementary manner enables the development of…

Computation and Language · Computer Science 2026-05-12 Shusaku Egami , Aoi Ohta , Tomoki Tsujimura , Masaki Asada , Tatsuya Ishigaki , Ken Fukuda , Masahiro Hamasaki , Hiroya Takamura

Reasoning over knowledge graphs (KGs) is a challenging task that requires a deep understanding of the complex relationships between entities and the underlying logic of their relations. Current approaches rely on learning geometries to…

Logic in Computer Science · Computer Science 2024-04-02 Nurendra Choudhary , Chandan K. Reddy

Background. In the last decades, several life science resources have structured data using the same framework and made these accessible using the same query language to facilitate interoperability. Knowledge graphs have seen increased…

Multimodal Knowledge Editing (MKE) extends traditional knowledge editing to settings involving both textual and visual modalities. However, existing MKE benchmarks primarily assess final answer correctness while neglecting the quality of…

Artificial Intelligence · Computer Science 2025-12-02 Li Yuan , Qingfei Huang , Bingshan Zhu , Yi Cai , Qingbao Huang , Changmeng Zheng , Zikun Deng , Tao Wang

Constructing Knowledge Graphs (KGs) from unstructured text provides a structured framework for knowledge representation and reasoning, yet current LLM-based approaches struggle with a fundamental trade-off: factual coverage often leads to…

Computation and Language · Computer Science 2026-04-24 Sanghyeok Choi , Woosang Jeon , Kyuseok Yang , Taehyeong Kim

We introduce \textsc{ComplexTempQA},\footnote{Dataset and code available at: https://github.com/DataScienceUIBK/ComplexTempQA} a large-scale dataset consisting of over 100 million question-answer pairs designed to tackle the challenges in…

Computation and Language · Computer Science 2025-08-26 Raphael Gruber , Abdelrahman Abdallah , Michael Färber , Adam Jatowt

Traditional Retrieval-Augmented Generation (RAG) effectively supports single-hop question answering with large language models but faces significant limitations in multi-hop question answering tasks, which require combining evidence from…

Computation and Language · Computer Science 2026-05-26 Junli Liang , Pengfei Zhou , Wangqiu Zhou , Wenjie Qing , Qi Zhao , Ziwen Wang , Qi Song , Xiangyang Li

Effective multi-hop question answering (QA) requires reasoning over multiple scattered paragraphs and providing explanations for answers. Most existing approaches cannot provide an interpretable reasoning process to illustrate how these…

Computation and Language · Computer Science 2022-08-29 Zhenyun Deng , Yonghua Zhu , Yang Chen , Michael Witbrock , Patricia Riddle

Existing question answering (QA) datasets are no longer challenging to most powerful Large Language Models (LLMs). Traditional QA benchmarks like TriviaQA, NaturalQuestions, ELI5 and HotpotQA mainly study ``known unknowns'' with clear…

Computation and Language · Computer Science 2024-02-29 Corby Rosset , Ho-Lam Chung , Guanghui Qin , Ethan C. Chau , Zhuo Feng , Ahmed Awadallah , Jennifer Neville , Nikhil Rao