English
Related papers

Related papers: Explainable Rule Application via Structured Prompt…

200 papers

Explainable Artificial Intelligence (XAI) plays a crucial role in fostering transparency and trust in AI systems, where traditional XAI approaches typically offer one level of abstraction for explanations, often in the form of heatmaps…

As LLM-based agents increasingly operate in high-stakes domains with real-world consequences, ensuring their behavioral safety becomes paramount. The dominant oversight paradigm, LLM-as-a-Judge, faces a fundamental dilemma: how can…

Artificial Intelligence · Computer Science 2026-02-13 Jiayi Zhou , Yang Sheng , Hantao Lou , Yaodong Yang , Jie Fu

General logical reasoning, defined as the ability to reason deductively on domain-agnostic tasks, continues to be a challenge for large language models (LLMs). Current LLMs fail to reason deterministically and are not interpretable. As…

Artificial Intelligence · Computer Science 2025-08-06 Michael K. Chen

Large Language Models (LLMs) are central to reasoning, writing, and decision-support workflows, yet users lack consistent control over how they reason and express outputs. Conventional prompt engineering relies on verbose natural-language…

Programming Languages · Computer Science 2025-10-24 Mostapha Kalami Heris

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Large language models (LLMs) continue to face challenges in reliably solving reasoning tasks, particularly those that require precise rule following, as often found in mathematical reasoning. This paper introduces a novel neurosymbolic…

Machine Learning · Computer Science 2025-11-19 Varun Dhanraj , Chris Eliasmith

Resolving complex information needs that come with multiple constraints should consider enforcing the logical operators encoded in the query (i.e., conjunction, disjunction, negation) on the candidate answer set. Current retrieval systems…

Information Retrieval · Computer Science 2026-02-02 Mohanna Hoveyda , Jelle Piepenbrock , Arjen P de Vries , Maarten de Rijke , Faegheh Hasibi

Large language models (LLMs), such as GPT-3 and GPT-4, have demonstrated exceptional performance in various natural language processing tasks and have shown the ability to solve certain reasoning problems. However, their reasoning…

Artificial Intelligence · Computer Science 2023-07-18 Adam Ishay , Zhun Yang , Joohyung Lee

Recent progress in deep reinforcement learning (DRL) can be largely attributed to the use of neural networks. However, this black-box approach fails to explain the learned policy in a human understandable way. To address this challenge and…

Artificial Intelligence · Computer Science 2021-03-17 Zhihao Ma , Yuzheng Zhuang , Paul Weng , Hankz Hankui Zhuo , Dong Li , Wulong Liu , Jianye Hao

The use of formal language for deductive logical reasoning aligns well with language models (LMs), where translating natural language (NL) into first-order logic (FOL) and employing an external solver results in a verifiable and therefore…

Computation and Language · Computer Science 2026-01-15 Ramya Keerthy Thatikonda , Jiuzhou Han , Wray Buntine , Ehsan Shareghi

An increasing amount of research in Natural Language Inference (NLI) focuses on the application and evaluation of Large Language Models (LLMs) and their reasoning capabilities. Despite their success, however, LLMs are still prone to factual…

Computation and Language · Computer Science 2024-02-02 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Complex logical reasoning tasks require a long sequence of reasoning, which a large language model (LLM) with chain-of-thought prompting still falls short. To alleviate this issue, neurosymbolic approaches incorporate a symbolic solver.…

Computation and Language · Computer Science 2025-07-22 Hyun Ryu , Gyeongman Kim , Hyemin S. Lee , Eunho Yang

Neuro-symbolic reasoning increasingly demands frameworks that unite the formal rigor of logic with the interpretability of large language models (LLMs). We introduce an end to end explainability by construction pipeline integrating the…

Logic in Computer Science · Computer Science 2026-03-16 Yang Xu , Jun Liu , Shuwei Chen , Chris Nugent , Hailing Guo

Large language models (LLMs) have demonstrated strong performance in a wide-range of language tasks without requiring task-specific fine-tuning. However, they remain prone to hallucinations and inconsistencies, and often struggle with…

Computation and Language · Computer Science 2026-03-27 Matt Pauk , Maria Leonor Pacheco

Recent advances in large language models (LLMs) have significantly enhanced automated legal reasoning. Yet, it remains unclear whether their performance reflects genuine legal reasoning ability or artifacts of data contamination. We present…

Artificial Intelligence · Computer Science 2026-05-18 Parisa Kordjamshidi , Samer Aslan , Madhavan Seshadri , Leslie Barrett , Enrico Santus

Large language models (LLMs) have demonstrated strong reasoning and tool-use capabilities, yet they often fail in real-world tool-interactions due to incorrect parameterization, poor tool selection, or misinterpretation of user intent.…

Artificial Intelligence · Computer Science 2025-09-23 Hy Dang , Tianyi Liu , Zhuofeng Wu , Jingfeng Yang , Haoming Jiang , Tao Yang , Pei Chen , Zhengyang Wang , Helen Wang , Huasheng Li , Bing Yin , Meng Jiang

Existing debiasing techniques are typically training-based or require access to the model's internals and output distributions, so they are inaccessible to end-users looking to adapt LLM outputs for their particular needs. In this study, we…

Computation and Language · Computer Science 2024-05-20 Shaz Furniturewala , Surgan Jandial , Abhinav Java , Pragyan Banerjee , Simra Shahid , Sumit Bhatia , Kokil Jaidka

Large Language Models perform well at natural language interpretation and reasoning, but their inherent stochasticity limits their adoption in regulated industries like finance and healthcare that operate under strict policies. To address…

In this paper, we address the issue of using logic rules to explain the results from legal case retrieval. The task is critical to legal case retrieval because the users (e.g., lawyers or judges) are highly specialized and require the…

Information Retrieval · Computer Science 2024-03-05 Zhongxiang Sun , Kepu Zhang , Weijie Yu , Haoyu Wang , Jun Xu

With the emergence of advanced reasoning models like OpenAI o3 and DeepSeek-R1, large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, their ability to perform rigorous logical reasoning remains an open…

Artificial Intelligence · Computer Science 2025-02-14 Hanmeng Liu , Zhizhang Fu , Mengru Ding , Ruoxi Ning , Chaoli Zhang , Xiaozhang Liu , Yue Zhang