English
Related papers

Related papers: Why Cannot Large Language Models Ever Make True Co…

200 papers

Large language models (LLMs) are increasingly used in situations where human values are at stake, such as decision-making tasks that involve reasoning when performed by humans. We investigate the so-called reasoning capabilities of LLMs…

Computation and Language · Computer Science 2025-12-25 Nathaniël de Leeuw , Marceau Nahon , Mathis Reymond , Raja Chatila , Mehdi Khamassi

With the recent undeniable advancement in reasoning abilities in large language models (LLMs) like ChatGPT and GPT-4, there is a growing trend for using LLMs on various tasks. One area where LLMs can be employed is as an alternative…

Computation and Language · Computer Science 2023-10-23 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing

Large Language Models (LLMs) achieve impressive performance in a wide range of tasks, even if they are often trained with the only objective of chatting fluently with users. Among other skills, LLMs show emergent abilities in mathematical…

Computation and Language · Computer Science 2024-06-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Large language models (LLMs) like ChatGPT have shown significant advancements across diverse natural language understanding (NLU) tasks, including intelligent dialogue and autonomous agents. Yet, lacking widely acknowledged testing…

Computation and Language · Computer Science 2024-05-10 Jinyang Wu , Feihu Che , Xinxin Zheng , Shuai Zhang , Ruihan Jin , Shuai Nie , Pengpeng Shao , Jianhua Tao

Large language models (LLMs) have emerged as powerful tools for many AI problems and exhibit remarkable in-context learning (ICL) capabilities. Compositional ability, solving unseen complex tasks that combine two or more simple tasks, is an…

Computation and Language · Computer Science 2024-08-13 Zhuoyan Xu , Zhenmei Shi , Yingyu Liang

In this paper, we offer a simple argument for the conclusion that the outputs of large language models (LLMs) are meaningless. Our argument is based on two key premises: (a) that certain kinds of intentions are needed in order for LLMs'…

Computation and Language · Computer Science 2025-09-29 Anandi Hattiangadi , Anders J. Schoubye

Large Language Models (LLMs) have demonstrated strong performance across various natural language processing tasks, yet their proficiency in mathematical reasoning remains a key challenge. Addressing the gap between natural and mathematical…

Artificial Intelligence · Computer Science 2025-02-18 Xuhan Huang , Qingning Shen , Yan Hu , Anningzhe Gao , Benyou Wang

Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but they still struggle with some complicated reasoning tasks including logical reasoning. One non-negligible reason for LLMs' suboptimal performance…

Computation and Language · Computer Science 2024-04-09 Yanda Li , Dixuan Wang , Jiaqing Liang , Guochao Jiang , Qianyu He , Yanghua Xiao , Deqing Yang

Large language models (LLMs) have performed well on several reasoning benchmarks, including ones that test analogical reasoning abilities. However, it has been debated whether they are actually performing humanlike abstract reasoning or…

Artificial Intelligence · Computer Science 2024-02-15 Martha Lewis , Melanie Mitchell

Large Language Models (LLMs) are already as persuasive as humans. However, we know very little about how they do it. This paper investigates the persuasion strategies of LLMs, comparing them with human-generated arguments. Using a dataset…

Computation and Language · Computer Science 2024-04-23 Carlos Carrasco-Farre

Large language models (LLMs) are a promising venue for natural language understanding and generation. However, current LLMs are far from reliable: they are prone to generating non-factual information and, more crucially, to contradicting…

Computation and Language · Computer Science 2024-09-24 Diego Calanzone , Stefano Teso , Antonio Vergari

Causal reasoning is a core component of intelligence. Large language models (LLMs) have shown impressive capabilities in generating human-like text, raising questions about whether their responses reflect true understanding or statistical…

Artificial Intelligence · Computer Science 2025-06-09 Hanna M. Dettki , Brenden M. Lake , Charley M. Wu , Bob Rehder

Existing work investigates the reasoning capabilities of large language models (LLMs) to uncover their limitations, human-like biases and underlying processes. Such studies include evaluations of base LLMs (pre-trained on unlabeled corpora…

Computation and Language · Computer Science 2025-11-14 Jason Chan , Zhixue Zhao , Robert Gaizauskas

While the reasoning capabilities of Large Language Models (LLMs) excel in analytical tasks such as mathematics and code generation, their utility for abstractive summarization remains widely assumed but largely unverified. To bridge this…

Computation and Language · Computer Science 2025-12-10 Haohan Yuan , Haopeng Zhang

Honesty is a fundamental principle for aligning large language models (LLMs) with human values, requiring these models to recognize what they know and don't know and be able to faithfully express their knowledge. Despite promising, current…

Computation and Language · Computer Science 2024-09-30 Siheng Li , Cheng Yang , Taiqiang Wu , Chufan Shi , Yuji Zhang , Xinyu Zhu , Zesen Cheng , Deng Cai , Mo Yu , Lemao Liu , Jie Zhou , Yujiu Yang , Ngai Wong , Xixin Wu , Wai Lam

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

The rise of Large Language Models (LLMs) has sparked debate about whether these systems exhibit human-level cognition. In this debate, little attention has been paid to a structural component of human cognition: core beliefs, truths that…

Machine Learning · Computer Science 2026-05-06 Anna Sokol , Marianna B. Ganapini , Nitesh V. Chawla

Studies have underscored how, regardless of the recent breakthrough and swift advances in AI research, even state-of-the-art Large Language models (LLMs) continue to struggle when performing logical and mathematical reasoning. The results…

Artificial Intelligence · Computer Science 2024-12-20 Federico Castagna , Isabel Sassoon , Simon Parsons

Better understanding of Large Language Models' (LLMs) legal analysis abilities can contribute to improving the efficiency of legal services, governing artificial intelligence, and leveraging LLMs to identify inconsistencies in law. This…

Computation and Language · Computer Science 2023-06-13 John J. Nay , David Karamardian , Sarah B. Lawsky , Wenting Tao , Meghana Bhat , Raghav Jain , Aaron Travis Lee , Jonathan H. Choi , Jungo Kasai

Large Language Models (LLMs) have achieved great improvements in recent years. Nevertheless, it still remains unclear how good LLMs are for reasoning tasks, especially for long-chain ones. In this paper, we evaluate LLMs' performance on the…

Artificial Intelligence · Computer Science 2026-05-11 Chun Zheng , Lianlong Wu , Bingqian Li , Lvting Liu , Yi Zhou