English
Related papers

Related papers: Evaluating Multi-Hop Reasoning in Large Language M…

200 papers

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in…

Computation and Language · Computer Science 2023-05-29 Jie Huang , Kevin Chen-Chuan Chang

Large language models (LLMs) are being increasingly adopted in the software engineering domain, yet the robustness of their grasp on core software design concepts remains unclear. We conduct an empirical study to systematically evaluate…

Software Engineering · Computer Science 2025-12-30 Mootez Saad , Boqi Chen , José Antonio Hernández López , Dániel Varró , Tushar Sharma

In most current research, large language models (LLMs) are able to perform reasoning tasks by generating chains of thought through the guidance of specific prompts. However, there still exists a significant discrepancy between their…

Computation and Language · Computer Science 2023-05-29 Yuanzhen Xie , Tao Xie , Mingxiong Lin , WenTao Wei , Chenglin Li , Beibei Kong , Lei Chen , Chengxiang Zhuo , Bo Hu , Zang Li

Case-based reasoning is a cornerstone of U.S. legal practice, requiring professionals to argue about a current case by drawing analogies to and distinguishing from past precedents. While Large Language Models (LLMs) have shown remarkable…

Computation and Language · Computer Science 2026-01-21 Li Zhang , Matthias Grabmair , Morgan Gray , Kevin Ashley

Novel research ideas play a critical role in advancing scientific inquiries. Recent advancements in Large Language Models (LLMs) have demonstrated their potential to generate novel research ideas by leveraging large-scale scientific…

Artificial Intelligence · Computer Science 2025-11-05 Keyu Zhao , Weiquan Lin , Qirui Zheng , Fengli Xu , Yong Li

Making inferences in text comprehension to understand the meaning is essential in language processing. This work studies the entailment verification (EV) problem of multi-sentence premises that requires a system to make multiple inferences…

Computation and Language · Computer Science 2024-05-29 Soumya Sanyal , Tianyi Xiao , Jiacheng Liu , Wenya Wang , Xiang Ren

This paper proposes a novel approach to analyzing multi-hop reasoning in language models through Hamiltonian mechanics. We map reasoning chains in embedding spaces to Hamiltonian systems, defining a function that balances reasoning…

Artificial Intelligence · Computer Science 2025-03-11 Javier Marin

Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two…

Computation and Language · Computer Science 2023-10-10 Zhangyin Feng , Xiaocheng Feng , Dezhi Zhao , Maojin Yang , Bing Qin

To fully expedite AI-powered chemical research, high-quality chemical databases are the foundation. Automatic extraction of chemical information from the literature is essential for constructing reaction databases, but it is currently…

Artificial Intelligence · Computer Science 2026-03-09 Yufan Chen , Ching Ting Leung , Bowen Yu , Jianwei Sun , Yong Huang , Linyan Li , Hao Chen , Hanyu Gao

Mathematical reasoning and optimization are fundamental to artificial intelligence and computational problem-solving. Recent advancements in Large Language Models (LLMs) have significantly improved AI-driven mathematical reasoning, theorem…

Artificial Intelligence · Computer Science 2025-03-25 Ali Forootani

Answering multi-hop reasoning questions requires retrieving and synthesizing information from diverse sources. Language models (LMs) struggle to perform such reasoning consistently. We propose an approach to pinpoint and rectify multi-hop…

Computation and Language · Computer Science 2024-11-11 Mansi Sakarvadia

Recent advances in Generative Artificial Intelligence, particularly Large Language Models (LLMs), have stimulated growing interest in automating or assisting Business Process Modeling tasks using natural language. Several approaches have…

Software Engineering · Computer Science 2026-04-16 João Bettencourt , Sérgio Guerreiro

Service composition remains a central challenge in building adaptive and intelligent software systems, often constrained by limited reasoning capabilities or brittle execution mechanisms. This paper explores the integration of two emerging…

Artificial Intelligence · Computer Science 2025-07-28 Ilche Georgievski , Marco Aiello

The growing complexity of factual claims in real-world scenarios presents significant challenges for automated fact verification systems, particularly in accurately aggregating and reasoning over multi-hop evidence. Existing approaches…

Artificial Intelligence · Computer Science 2025-06-10 Liwen Zheng , Chaozhuo Li , Haoran Jia , Xi Zhang

Large reasoning models such as DeepSeek-R1 and OpenAI o1 generate extended chains of thought spanning thousands of tokens, yet their integration with retrieval-augmented generation (RAG) remains fundamentally misaligned. Current RAG systems…

Information Retrieval · Computer Science 2026-04-30 Dongxin Guo , Jikun Wu , Siu Ming Yiu

Recent Large Language Models (LLMs) such as OpenAI o3-mini and DeepSeek-R1 use enhanced reasoning through Chain-of-Thought (CoT). Their potential in hardware design, which relies on expert-driven iterative optimization, remains unexplored.…

Artificial Intelligence · Computer Science 2025-04-15 Luca Collini , Andrew Hennessee , Ramesh Karri , Siddharth Garg

Multi-hop reading comprehension requires not only the ability to reason over raw text but also the ability to combine multiple evidence. We propose a novel learning approach that helps language models better understand difficult multi-hop…

Computation and Language · Computer Science 2022-11-08 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

Computation and Language · Computer Science 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

Computation and Language · Computer Science 2025-04-16 Thilo Hagendorff , Sarah Fabi

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

Computation and Language · Computer Science 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia