English
Related papers

Related papers: In-Context Analogical Reasoning with Pre-Trained L…

200 papers

While LLMs have revolutionized the field of machine learning due to their high performance on a strikingly wide range of problems, they are also known to hallucinate false answers and underperform on less canonical versions of the same…

Machine Learning · Computer Science 2025-09-11 Kavi Gupta , Kate Sanders , Armando Solar-Lezama

Many recent studies have found evidence for emergent reasoning capabilities in large language models (LLMs), but debate persists concerning the robustness of these capabilities, and the extent to which they depend on structured reasoning…

Computation and Language · Computer Science 2025-06-09 Yukang Yang , Declan Campbell , Kaixuan Huang , Mengdi Wang , Jonathan Cohen , Taylor Webb

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

Computation and Language · Computer Science 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

This paper delves into the dynamic landscape of artificial intelligence, specifically focusing on the burgeoning prominence of large language models (LLMs). We underscore the pivotal role of Reinforcement Learning from Human Feedback (RLHF)…

Computers and Society · Computer Science 2024-03-18 Dana Alsagheer , Rabimba Karanjai , Nour Diallo , Weidong Shi , Yang Lu , Suha Beydoun , Qiaoning Zhang

Large Language Models (LLMs) are recruited in applications that span from clinical assistance and legal support to question answering and education. Their success in specialized tasks has led to the claim that they possess human-like…

Computation and Language · Computer Science 2024-07-10 Vittoria Dentella , Fritz Guenther , Elliot Murphy , Gary Marcus , Evelina Leivada

Large Language Models (LLMs) have demonstrated strong generalization across a wide range of tasks. Reasoning with LLMs is central to solving multi-step problems and complex decision-making. To support efficient reasoning, recent studies…

Computation and Language · Computer Science 2025-09-03 Jindong Li , Yali Fu , Li Fan , Jiahong Liu , Yao Shu , Chengwei Qin , Menglin Yang , Irwin King , Rex Ying

In this work, we introduce Contextual Analog Logic with Multimodality (CALM). CALM unites symbolic reasoning with neural generation, enabling systems to make context-sensitive decisions grounded in real-world multi-modal data. Background:…

Artificial Intelligence · Computer Science 2025-06-19 Maxwell J. Jacobson , Corey J. Maley , Yexiang Xue

Analogical reasoning tests a fundamental aspect of human cognition: mapping the relation from one pair of objects to another. Existing evaluations of this ability in multimodal large language models (MLLMs) overlook the ability to compose…

Artificial Intelligence · Computer Science 2026-03-31 Yongkang Du , Xiaohan Zou , Minhao Cheng , Lu Lin

To improve the reasoning capabilities of large language models, test-time compute is typically scaled by generating intermediate tokens before the final answer. However, this couples reasoning to autoregressive generation and thereby…

Computation and Language · Computer Science 2026-05-29 Lukas Aichberger , Sepp Hochreiter

Large Vision-Language Models (LVLMs) are pivotal for real-world AI tasks like embodied intelligence due to their strong vision-language reasoning abilities. However, current LVLMs process entire images at the token level, which is…

Computation and Language · Computer Science 2025-05-20 Run Luo , Renke Shan , Longze Chen , Ziqiang Liu , Lu Wang , Min Yang , Xiaobo Xia

Reasoning is a fundamental cognitive process that enables logical inference, problem-solving, and decision-making. With the rapid advancement of large language models (LLMs), reasoning has emerged as a key capability that distinguishes…

We introduce algebraic machine reasoning, a new reasoning framework that is well-suited for abstract reasoning. Effectively, algebraic machine reasoning reduces the difficult process of novel problem-solving to routine algebraic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jingyi Xu , Tushar Vaidya , Yufei Wu , Saket Chandra , Zhangsheng Lai , Kai Fong Ernest Chong

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

Large language models (LLMs) are increasingly used in domains where causal reasoning matters, yet it remains unclear whether their judgments reflect normative causal computation, human-like shortcuts, or brittle pattern matching. We…

Artificial Intelligence · Computer Science 2026-03-16 Hanna M. Dettki , Charley M. Wu , Bob Rehder

Retrieval-Augmented Language Models (RALMs) have significantly improved performance in open-domain question answering (QA) by leveraging external knowledge. However, RALMs still struggle with unanswerable queries, where the retrieved…

Computation and Language · Computer Science 2024-08-09 Seong-Il Park , Seung-Woo Choi , Na-Hyun Kim , Jay-Yoon Lee

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

Computation and Language · Computer Science 2024-08-07 Philipp Mondorf , Barbara Plank

The continued success of Large Language Models (LLMs) and other generative artificial intelligence approaches highlights the advantages that large information corpora can have over rigidly defined symbolic models, but also serves as a…

Analogical reasoning, the transfer of relational structures across contexts (e.g., planet is to sun as electron is to nucleus), is fundamental to scientific discovery. Yet human insight is often constrained by domain expertise and…

Machine Learning · Computer Science 2025-10-28 Hongyu Guo

Recent advancements in artificial intelligence have propelled the capabilities of Large Language Models, yet their ability to mimic nuanced human reasoning remains limited. This paper introduces a novel conceptual enhancement to LLMs,…

Human-Computer Interaction · Computer Science 2024-04-23 Sumedh Rasal

A hallmark of human intelligence is the ability to infer abstract rules from limited experience and apply these rules to unfamiliar situations. This capacity is widely studied in the visual domain using the Raven's Progressive Matrices.…

Artificial Intelligence · Computer Science 2025-12-22 Quan Do , Thomas M. Morin , Chantal E. Stern , Michael E. Hasselmo