English
Related papers

Related papers: Logical Negation Augmenting and Debiasing for Prom…

200 papers

Recent research shows that pre-trained language models (PLMs) suffer from "prompt bias" in factual knowledge extraction, i.e., prompts tend to introduce biases toward specific labels. Prompt bias presents a significant challenge in…

Computation and Language · Computer Science 2024-03-27 Ziyang Xu , Keqin Peng , Liang Ding , Dacheng Tao , Xiliang Lu

Negation is a common linguistic feature that is crucial in many language understanding tasks, yet it remains a hard problem due to diversity in its expression in different types of text. Recent work has shown that state-of-the-art NLP…

Computation and Language · Computer Science 2022-05-10 Thinh Hung Truong , Timothy Baldwin , Trevor Cohn , Karin Verspoor

The reasoning abilities of Large Language Models (LLMs) remain a topic of debate. Some methods such as ReAct-based prompting, have gained popularity for claiming to enhance sequential decision-making abilities of agentic LLMs. However, it…

Artificial Intelligence · Computer Science 2024-05-24 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

This paper treats logic programming with three kinds of negation: default, weak and strict negations. A 3-valued logic model theory is discussed for logic programs with three kinds of negation. The procedure is constructed for negations so…

Logic in Computer Science · Computer Science 2007-05-23 Susumu Yamasaki

Large Language Models (LLMs) suffer from critical reasoning gaps, including a tendency to hallucinate and poor accuracy in classifying logical fallacies. This limitation stems from their default System 1 processing, which is fast and…

Artificial Intelligence · Computer Science 2025-10-14 Olivia Peiyu Wang , Tashvi Bansal , Ryan Bai , Emily M. Chui , Leilani H. Gilpin

Despite great performance on many tasks, language models (LMs) still struggle with reasoning, sometimes providing responses that cannot possibly be true because they stem from logical incoherence. We call such responses \textit{strong…

Computation and Language · Computer Science 2024-08-21 Nicholas Asher , Swarnadeep Bhar

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks but their performance in complex logical reasoning tasks remains unsatisfactory. Although some prompting methods, such as Chain-of-Thought, can…

Computation and Language · Computer Science 2025-02-10 Tongxuan Liu , Wenjiang Xu , Weizhe Huang , Yuting Zeng , Jiaxing Wang , Xingyu Wang , Hailong Yang , Jing Li

Large Language Models (LLMs) have been shown to achieve impressive results for many reasoning-based NLP tasks, suggesting a degree of deductive reasoning capability. However, it remains unclear to which extent LLMs, in both informal and…

Computation and Language · Computer Science 2025-08-26 Fabian Hoppe , Filip Ilievski , Jan-Christoph Kalo

In various natural language processing (NLP) tasks, fine-tuning Pre-trained Language Models (PLMs) often leads to the issue of spurious correlations, which negatively impacts performance, particularly when dealing with out-of-distribution…

Computation and Language · Computer Science 2025-04-17 Suyoung Bae , Hyojun Kim , YunSeok Choi , Jee-Hyong Lee

Negation as failure and incomplete information in logic programs have been studied by many researchers In order to explains HOW a negated conclusion was reached, we introduce and proof a different way for negating facts to overcoming…

Artificial Intelligence · Computer Science 2013-03-06 M. A. El-Dosuky , T. T. Hamza , M. Z. Rashad , A. H. Naguib

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet exhibit critical limitations in knowledge-intensive tasks, often generating hallucinations when faced with questions requiring…

Computation and Language · Computer Science 2026-01-08 Yilin Xiao , Chuang Zhou , Yujing Zhang , Qinggang Zhang , Su Dong , Shengyuan Chen , Chang Yang , Xiao Huang

Identifying bias in LLMs is ongoing. Because they are still in development, what is true today may be false tomorrow. We therefore need general strategies for debiasing that will outlive current models. Strategies developed for debiasing…

Artificial Intelligence · Computer Science 2025-07-15 Thomas T. Hills

To address the instability of unguided reasoning paths in standard Chain-of-Thought prompting, recent methods guide large language models (LLMs) by first eliciting a single reasoning strategy. However, relying on just one strategy for each…

Computation and Language · Computer Science 2026-05-21 Po-Chun Chen , Hen-Hsen Huang , Hsin-Hsi Chen

Large language models (LLMs) are increasingly utilized in various complex reasoning tasks due to their excellent instruction following capability. However, the model's performance is highly dependent on the open-ended characteristics of the…

Computation and Language · Computer Science 2026-04-28 Zhenzhen Huang , Chaoning Zhang , Fachrina Dewi Puspitasari , Jiaquan Zhang , Yitian Zhou , Shuxu Chen , Yang Yang

Large Language Models prompting, such as using in-context demonstrations, is a mainstream technique for invoking LLMs to perform high-performance and solid complex reasoning (e.g., mathematical reasoning, commonsense reasoning), and has the…

Artificial Intelligence · Computer Science 2024-10-08 Zhicheng Yang , Yinya Huang , Jing Xiong , Liang Feng , Xiaodan Liang , Yiwei Wang , Jing Tang

Large language models are highly sensitive to prompts, but this sensitivity is usually studied through task-relevant instructions, demonstrations, or reasoning cues. In this paper, we study a different form of prompt sensitivity: whether…

Computation and Language · Computer Science 2026-05-29 Pawel Batorski , Abtin Pourhadi , Jerzy Sarosiek , Przemyslaw Spurek , Paul Swoboda

Negation is a common linguistic phenomenon. Yet language models face challenges with negation in many natural language understanding tasks such as question answering and natural language inference. In this paper, we experiment with seamless…

Computation and Language · Computer Science 2024-06-12 MohammadHossein Rezaei , Eduardo Blanco

Remarkable progress has been made on automated reasoning with natural text, by using Language Models (LMs) and methods such as Chain-of-Thought and Selection-Inference. These techniques search for proofs in the forward direction from axioms…

Artificial Intelligence · Computer Science 2023-05-30 Mehran Kazemi , Najoung Kim , Deepti Bhatia , Xin Xu , Deepak Ramachandran

Logical reading comprehension is a challenging task that entails grasping the underlying semantics of text and applying reasoning to deduce the correct answer. Prior researches have primarily focused on enhancing logical reasoning…

Computation and Language · Computer Science 2025-02-07 Chenxu Wang , Ping Jian , Zhen Yang

Despite the success of chain of thought in enhancing language model reasoning, the underlying process remains less well understood. Although logically sound reasoning appears inherently crucial for chain of thought, prior studies…

Computation and Language · Computer Science 2023-11-17 Yew Ken Chia , Guizhen Chen , Luu Anh Tuan , Soujanya Poria , Lidong Bing