English
Related papers

Related papers: Robust and Explainable Identification of Logical F…

200 papers

Counterfactual reasoning, a hallmark of intelligence, consists of three steps: inferring latent variables from observations (abduction), constructing alternatives (interventions), and predicting their outcomes (prediction). This skill is…

Machine Learning · Computer Science 2025-10-03 Aniket Vashishtha , Qirun Dai , Hongyuan Mei , Amit Sharma , Chenhao Tan , Hao Peng

Formal explainability guarantees the rigor of computed explanations, and so it is paramount in domains where rigor is critical, including those deemed high-risk. Unfortunately, since its inception formal explainability has been hampered by…

Artificial Intelligence · Computer Science 2024-12-04 Xuanxiang Huang , Joao Marques-Silva

Existing methods on understanding the capabilities of LLMs in logical reasoning rely on binary entailment classification or synthetically derived rationales, which are not sufficient for proper investigation of model's capabilities. We…

Logical reasoning of text requires understanding critical logical information in the text and performing inference over them. Large-scale pre-trained models for logical reasoning mainly focus on word-level semantics of text while struggling…

Computation and Language · Computer Science 2021-05-11 Siyuan Wang , Wanjun Zhong , Duyu Tang , Zhongyu Wei , Zhihao Fan , Daxin Jiang , Ming Zhou , Nan Duan

Users increasingly rely on Large Language Models (LLMs) for Deep Research, using them to synthesize diverse sources into structured reports that support understanding and action. In this context, the practical reliability of such reports…

Computation and Language · Computer Science 2026-02-24 Jujia Zhao , Zhaoxin Huan , Zihan Wang , Xiaolu Zhang , Jun Zhou , Suzan Verberne , Zhaochun Ren

Translating natural language into formal language such as First-Order Logic (FOL) is a foundational challenge in NLP with wide-ranging applications in automated reasoning, misinformation tracking, and knowledge validation. In this paper, we…

Computation and Language · Computer Science 2025-03-07 Abhinav Lalwani , Tasha Kim , Lovish Chopra , Christopher Hahn , Zhijing Jin , Mrinmaya Sachan

Large Language Models (LLMs) have achieved significant progress in language understanding and reasoning. Evaluating and analyzing their logical reasoning abilities has therefore become essential. However, existing datasets and benchmarks…

Computation and Language · Computer Science 2025-11-20 Zihao Xu , Junchen Ding , Yiling Lou , Kun Zhang , Dong Gong , Yuekang Li

Recent advances in Large Language Models have demonstrated their capabilities across a variety of tasks. However, automatically extracting implicit knowledge from natural language remains a significant challenge, as machines lack active…

Artificial Intelligence · Computer Science 2026-03-06 Anna Sofia Lippolis , Andrea Giovanni Nuzzolese , Aldo Gangemi

We study the detection of propagandistic text fragments in news articles. Instead of merely learning from input-output datapoints in training data, we introduce an approach to inject declarative knowledge of fine-grained propaganda…

Computation and Language · Computer Science 2020-10-06 Ruize Wang , Duyu Tang , Nan Duan , Wanjun Zhong , Zhongyu Wei , Xuanjing Huang , Daxin Jiang , Ming Zhou

Large Language Models (LLMs) show remarkable capabilities, yet their stochastic next-token prediction creates logical inconsistencies and reward hacking that formal symbolic systems avoid. To bridge this gap, we introduce a formal logic…

Machine Learning · Computer Science 2026-02-02 Chuxue Cao , Jinluan Yang , Haoran Li , Kunhao Pan , Zijian Zhao , Zhengyu Chen , Yuchen Tian , Lijun Wu , Conghui He , Sirui Han , Yike Guo

Large language models are increasingly integrated into decision-making in areas such as healthcare, law, finance, engineering, and government. Yet they share a critical limitation: they produce fluent outputs even when their internal…

Artificial Intelligence · Computer Science 2026-04-17 Rikard Rosenbacke , Carl Rosenbacke , Victor Rosenbacke , Martin McKee

In abstract argumentation, multiple argumentation semantics have been proposed that allow to select sets of jointly acceptable arguments from a given argumentation framework, i.e. based only on the attack relation between arguments. The…

Artificial Intelligence · Computer Science 2019-02-28 Marcos Cramer , Mathieu Guillaume

Large reasoning models (e.g., R1, o3) have demonstrated remarkable mathematical problem-solving abilities. However, the high reported accuracy of these advanced models on popular datasets, reliance on purely numerical evaluation and…

Artificial Intelligence · Computer Science 2025-12-10 Dadi Guo , Jiayu Liu , Zhiyuan Fan , Zhitao He , Haoran Li , Yuxin Li , Yumeng Wang , Yi R. Fung

Multi-step reasoning ability is fundamental to many natural language tasks, yet it is unclear what constitutes a good reasoning chain and how to evaluate them. Most existing methods focus solely on whether the reasoning chain leads to the…

Computation and Language · Computer Science 2023-12-04 Archiki Prasad , Swarnadeep Saha , Xiang Zhou , Mohit Bansal

Fallacies are defective arguments with faulty reasoning. Detecting and classifying them is a crucial NLP task to prevent misinformation, manipulative claims, and biased decisions. However, existing fallacy classifiers are limited by the…

Computation and Language · Computer Science 2024-10-22 Fengjun Pan , Xiaobao Wu , Zongrui Li , Anh Tuan Luu

Logical reasoning is a core capability for large language models (LLMs), yet existing benchmarks that rely solely on final-answer accuracy fail to capture the quality of the reasoning process. To address this, we introduce FineLogic, a…

Computation and Language · Computer Science 2025-10-10 Yujun Zhou , Jiayi Ye , Zipeng Ling , Yufei Han , Yue Huang , Haomin Zhuang , Zhenwen Liang , Kehan Guo , Taicheng Guo , Xiangqi Wang , Xiangliang Zhang

The recent enthusiasm for artificial intelligence (AI) is due principally to advances in deep learning. Deep learning methods are remarkably accurate, but also opaque, which limits their potential use in safety-critical applications. To…

Argumentation problems are concerned with determining the acceptability of a set of arguments from their relational structure. When the available information is uncertain, probabilistic argumentation frameworks provide modelling tools to…

Artificial Intelligence · Computer Science 2023-04-18 Pietro Totis , Angelika Kimmig , Luc De Raedt

Despite the impressive adaptability of large language models (LLMs), challenges remain in ensuring their security, transparency, and interpretability. Given their susceptibility to adversarial attacks, LLMs need to be defended with an…

Artificial Intelligence · Computer Science 2024-10-11 Tomas Bueno Momcilovic , Beat Buesser , Giulio Zizzo , Mark Purcell , Dian Balta

We present a computer-supported approach for the logical analysis and conceptual explicitation of argumentative discourse. Computational hermeneutics harnesses recent progresses in automated reasoning for higher-order logics and aims at…

Artificial Intelligence · Computer Science 2022-12-12 David Fuenmayor , Christoph Benzmüller