English
Related papers

Related papers: Formal Reasoning for Intelligent QA Systems: A Cas…

200 papers

Symbolic reasoning, rule-based symbol manipulation, is a hallmark of human intelligence. However, rule-based systems have had limited success competing with learning-based systems outside formalized domains such as automated theorem…

Machine Learning · Computer Science 2021-11-24 Kaiyu Yang , Jia Deng

In recent years, large language models (LLMs) have demonstrated significant success in performing varied natural language tasks such as language translation, question-answering, summarizing, fact-checking, etc. Despite LLMs' impressive…

Computation and Language · Computer Science 2025-03-03 Bishwamittra Ghosh , Sarah Hasan , Naheed Anjum Arafat , Arijit Khan

Large Language Models (LLMs) show promise as planners for embodied AI, but their stochastic nature lacks formal reasoning, preventing strict safety guarantees for physical deployment. Current approaches often rely on unreliable LLMs for…

Artificial Intelligence · Computer Science 2026-04-30 Feiyu Wu , Xu Zheng , Yue Qu , Zhuocheng Wang , Zicheng Feng , Hui Li

With powerful large language models (LLMs) demonstrating superhuman reasoning capabilities, a critical question arises: Do LLMs genuinely reason, or do they merely recall answers from their extensive, web-scraped training datasets? Publicly…

Computation and Language · Computer Science 2025-04-28 Haowei Lin , Xiangyu Wang , Ruilin Yan , Baizhou Huang , Haotian Ye , Jianhua Zhu , Zihao Wang , James Zou , Jianzhu Ma , Yitao Liang

Recent advancements in test time compute, particularly through the use of verifier models, have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). This generator-verifier approach closely resembles the…

Machine Learning · Computer Science 2024-10-11 Jianing Qi , Hao Tang , Zhigang Zhu

Automated theorem proving is essential for the formal verification of safety-critical systems. As the corpus of formal proofs grows, a natural paradigm is to learn from existing proofs. However, current learning-based approaches…

Software Engineering · Computer Science 2026-05-12 Jian Fang , Yixun Yao , Yingfei Xiong

Large Language Models (LLMs) often struggle with complex mathematical reasoning, where prose-based generation leads to unverified and arithmetically unsound solutions. Current prompting strategies like Chain of Thought still operate within…

Computation and Language · Computer Science 2026-01-27 Sina Bagheri Nezhad , Yao Li , Ameeta Agrawal

Chain-of-thought (CoT) reasoning has become the default strategy for enhancing LLM capabilities, yet its application raises a fundamental question: when is explicit reasoning actually beneficial? Empirical evidence reveals a striking…

Machine Learning · Computer Science 2026-05-25 Wei Xia , Haoqing Wang , Zhi-Hong Deng , Yehui Tang

Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this…

Artificial Intelligence · Computer Science 2025-12-01 Lei Zan , Keli Zhang , Ruichu Cai , Lujia Pan

The ability of Large Language Models (LLMs) to perform reasoning tasks such as deduction has been widely investigated in recent years. Yet, their capacity to generate proofs-faithful, human-readable explanations of why conclusions…

Artificial Intelligence · Computer Science 2026-01-21 Hui Yang , Jiaoyan Chen , Uli Sattler

Machine reasoning has made great progress in recent years owing to large language models (LLMs). In the clinical domain, however, most NLP-driven projects mainly focus on clinical classification or reading comprehension, and under-explore…

Computation and Language · Computer Science 2024-05-13 Taeyoon Kwon , Kai Tzu-iunn Ong , Dongjin Kang , Seungjun Moon , Jeong Ryong Lee , Dosik Hwang , Yongsik Sim , Beomseok Sohn , Dongha Lee , Jinyoung Yeo

Vision-language models (VLMs) are increasingly deployed in high-stakes settings where reliable uncertainty quantification (UQ) is as important as predictive accuracy. Extended reasoning via chain-of-thought (CoT) prompting or…

Machine Learning · Computer Science 2026-03-18 Robert Welch , Emir Konuk , Kevin Smith

The advent of Large Language Models (LLMs) and Generative AI has revolutionized natural language applications across various domains. However, high-stakes decision-making tasks in fields such as medical, legal and finance require a level of…

Large language models (LLMs) have revolutionized artificial intelligence by enabling complex reasoning capabilities. While recent advancements in reinforcement learning (RL) have primarily focused on domain-specific reasoning tasks (e.g.,…

In the realm of formal theorem proving, the Coq proof assistant stands out for its rigorous approach to verifying mathematical assertions and software correctness. Despite the advances in artificial intelligence and machine learning, the…

Artificial Intelligence · Computer Science 2024-04-03 Andreas Florath

Large language models (LLMs) have made remarkable progress in various natural language processing tasks as a benefit of their capability to comprehend and reason with factual knowledge. However, a significant amount of factual knowledge is…

Computation and Language · Computer Science 2024-08-23 Sirui Huang , Yanggan Gu , Xuming Hu , Zhonghao Li , Qing Li , Guandong Xu

Advances in the general capabilities of large language models (LLMs) have led to their use for information retrieval, and as components in automated decision systems. A faithful representation of probabilistic reasoning in these models may…

Artificial Intelligence · Computer Science 2025-04-21 Gabriel Freedman , Francesca Toni

Large Language Models (LLMs) have shown impressive reasoning capabilities, yet existing prompting methods face a critical trade-off: simple approaches often struggle with complex tasks and reasoning stability, while more sophisticated…

Computation and Language · Computer Science 2025-07-11 Guangya Wan , Yuqi Wu , Hao Wang , Shengming Zhao , Jie Chen , Sheng Li

Knowledge Graphs (KGs) store structured factual knowledge by linking entities through relationships, crucial for many applications. These applications depend on the KG's factual accuracy, so verifying facts is essential, yet challenging.…

Databases · Computer Science 2026-02-12 Farzad Shami , Stefano Marchesin , Gianmaria Silvello

Video Question Answering (VideoQA) demands models that jointly reason over spatial, temporal, and linguistic cues. However, the task's inherent complexity often requires multi-step reasoning that current large multimodal models (LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jason Nguyen , Ameet Rao , Alexander Chang , Ishaan Kumar , Erin Tan