English
Related papers

Related papers: BMGQ: A Bottom-up Method for Generating Complex Mu…

200 papers

Temporal knowledge graph question answering (TKGQA) involves multi-hop reasoning over temporally constrained entity relationships in the knowledge graph to answer a given question. However, at each hop, large language models (LLMs) retrieve…

Artificial Intelligence · Computer Science 2026-01-06 Wuzhenghong Wen , Chao Xue , Su Pan , Yuwei Sun , Minlong Peng

Multiple-choice questions (MCQs) are widely used across diverse educational fields and levels. Well-designed MCQs should evaluate knowledge application in real-world situations. However, writing such test items in sufficient numbers is…

Human-Computer Interaction · Computer Science 2026-02-10 Tetiana Krushynska , Jani Ursin , Ville Heilala

Retrieval-augmented large language models, when optimized with outcome-level rewards, can achieve strong answer accuracy on multi-hop questions. However, under noisy retrieval, models frequently suffer from "right-answer-wrong-reason…

Computation and Language · Computer Science 2026-03-17 Yu Liu , Wenxiao Zhang , Diandian Guo , Cong Cao , Fangfang Yuan , Qiang Sun , Yanbing Liu , Jin B. Hong , Zhiyuan Ma

This study presents a question-based knowledge encoding approach that improves retrieval-augmented generation (RAG) systems without requiring fine-tuning or traditional chunking. We encode textual content using generated questions that span…

Multi-hop Question Generation is the task of generating questions which require the reader to reason over and combine information spread across multiple passages using several reasoning steps. Chain-of-thought rationale generation has been…

Computation and Language · Computer Science 2022-11-17 Saurabh Kulshreshtha , Anna Rumshisky

Large language model (LLM) driven synthetic data generation has emerged as a powerful method for improving model reasoning capabilities. However, most methods either distill large state-of-the-art models into small students or use natural…

Machine Learning · Computer Science 2025-06-18 Alex Havrilla , Edward Hughes , Mikayel Samvelyan , Jacob Abernethy

With the increasing demand for step-wise, cross-modal, and knowledge-grounded reasoning, multimodal large language models (MLLMs) are evolving beyond the traditional fixed retrieve-then-generate paradigm toward more sophisticated agentic…

Artificial Intelligence · Computer Science 2026-03-03 Xuying Ning , Dongqi Fu , Tianxin Wei , Mengting Ai , Jiaru Zou , Ting-Wei Li , Hanghang Tong , Yada Zhu , Hendrik Hamann , Jingrui He

Recent advancements in large language models (LLMs) with extended context windows have significantly improved tasks such as information extraction, question answering, and complex planning scenarios. In order to achieve success in long…

Computation and Language · Computer Science 2025-05-20 Zhi Chen , Qiguang Chen , Libo Qin , Qipeng Guo , Haijun Lv , Yicheng Zou , Wanxiang Che , Hang Yan , Kai Chen , Dahua Lin

Commonsense question answering (QA) research requires machines to answer questions based on commonsense knowledge. However, this research requires expensive labor costs to annotate data as the basis of research, and models that rely on…

Computation and Language · Computer Science 2023-05-11 Xin Guan , Biwei Cao , Qingqing Gao , Zheng Yin , Bo Liu , Jiuxin Cao

Knowledge-intensive multi-hop question answering (QA) tasks, which require integrating evidence from multiple sources to address complex queries, often necessitate multiple rounds of retrieval and iterative generation by large language…

Computation and Language · Computer Science 2025-06-24 Binquan Ji , Haibo Luo , Yifei Lu , Lei Hei , Jiaqi Wang , Tingjing Liao , Lingyu Wang , Shichao Wang , Feiliang Ren

Current LLM training positions mathematical reasoning as a core capability. With publicly available sources fully tapped, there is unmet demand for diverse and challenging math questions. Relying solely on human experts is both…

Artificial Intelligence · Computer Science 2025-02-04 Vedant Shah , Dingli Yu , Kaifeng Lyu , Simon Park , Jiatong Yu , Yinghui He , Nan Rosemary Ke , Michael Mozer , Yoshua Bengio , Sanjeev Arora , Anirudh Goyal

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

Computation and Language · Computer Science 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Multiple-choice questions (MCQ) are frequently used to assess large language models (LLMs). Typically, an LLM is given a question and selects the answer deemed most probable after adjustments for factors like length. Unfortunately, LLMs may…

Computation and Language · Computer Science 2024-06-12 Aidar Myrzakhan , Sondos Mahmoud Bsharat , Zhiqiang Shen

Multimodal Retrieval Augmented Generation (mRAG) plays an important role in mitigating the "hallucination" issue inherent in multimodal large language models (MLLMs). Although promising, existing heuristic mRAGs typically predefined fixed…

Computation and Language · Computer Science 2025-05-27 Yangning Li , Yinghui Li , Xinyu Wang , Yong Jiang , Zhen Zhang , Xinran Zheng , Hui Wang , Hai-Tao Zheng , Philip S. Yu , Fei Huang , Jingren Zhou

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. Current multi-hop RAG…

Computation and Language · Computer Science 2026-05-28 Yikai Zhu , Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du

Medical reasoning models remain constrained by parametric knowledge and are thus susceptible to forgetting and hallucinations. DeepResearch (DR) models ground outputs in verifiable evidence from tools and perform strongly in general…

Artificial Intelligence · Computer Science 2026-02-05 Zihan Wang , Hao Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yiqun Zhang , Jinghao Lin , Haihua Yang , Xiaozhong Ji

Retrieval-augmented generation (RAG) has become a key paradigm for knowledge-intensive question answering. However, existing multi-hop RAG systems remain inefficient, as they alternate between retrieval and reasoning at each step, resulting…

Computation and Language · Computer Science 2026-02-06 Hao Yang , Zhiyu Yang , Xupeng Zhang , Wei Wei , Yunjie Zhang , Lin Yang

State-of-the-art approaches to reasoning and question answering over knowledge graphs (KGs) usually scale with the number of edges and can only be applied effectively on small instance-dependent subgraphs. In this paper, we address this…

Machine Learning · Computer Science 2021-10-28 Mattia Atzeni , Jasmina Bogojeska , Andreas Loukas

Multi-hop question answering (QA) requires reasoning over multiple documents to answer a complex question and provide interpretable supporting evidence. However, providing supporting evidence is not enough to demonstrate that a model has…

Computation and Language · Computer Science 2022-09-16 Zhenyun Deng , Yonghua Zhu , Yang Chen , Qianqian Qi , Michael Witbrock , Patricia Riddle

Large Language Models (LLMs) have shown remarkable capabilities across various tasks but remain prone to hallucinations in knowledge-intensive scenarios. Knowledge Base Question Answering (KBQA) mitigates this by grounding generation in…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Xixi Wang , Yinan Yu