English
Related papers

Related papers: Knowledge Model Prompting Increases LLM Performanc…

200 papers

Multimodal Large Language Models (MLLMs) are set to transform how machines process and generate human-like responses by integrating diverse modalities such as text, images, and code. Yet, effectively harnessing their capabilities hinges on…

Artificial Intelligence · Computer Science 2025-04-15 Anwesha Mohanty , Venkatesh Balavadhani Parthasarathy , Arsalan Shahid

Large Language Models (LLMs) have demonstrated strong capabilities in natural language understanding and reasoning. However, their ability to perform exact, deterministic computation remains unclear. In this work, we systematically evaluate…

Artificial Intelligence · Computer Science 2026-05-08 Hongkun Yu

Large language models (LLMs) have recently shown strong performance on Theory of Mind (ToM) tests, prompting debate about the nature and true performance of the underlying capabilities. At the same time, reasoning-oriented LLMs trained via…

Artificial Intelligence · Computer Science 2026-01-26 Ian B. de Haan , Peter van der Putten , Max van Duijn

Large Language Models (LLMs) have demonstrated amazing capabilities in language generation, text comprehension, and knowledge reasoning. While a single powerful model can already handle multiple tasks, relying on a single perspective can…

Computation and Language · Computer Science 2024-06-12 Zining Qin , Chenhao Wang , Huiling Qin , Weijia Jia

Despite the remarkable successes of large language models (LLMs), the underlying Transformer architecture has inherent limitations in handling complex reasoning tasks. Chain-of-thought (CoT) prompting has emerged as a practical workaround,…

Computation and Language · Computer Science 2025-06-03 Xiang Zhang , Juntai Cao , Jiaqi Wei , Chenyu You , Dujian Ding

Large language models (LLMs) have dramatically enhanced the field of language intelligence, as demonstrably evidenced by their formidable empirical performance across a spectrum of complex reasoning tasks. Additionally, theoretical proofs…

Computation and Language · Computer Science 2023-11-21 Zhuosheng Zhang , Yao Yao , Aston Zhang , Xiangru Tang , Xinbei Ma , Zhiwei He , Yiming Wang , Mark Gerstein , Rui Wang , Gongshen Liu , Hai Zhao

This report examines the effectiveness of Chain-of-Thought (CoT) prompting in improving the multi-step reasoning abilities of large language models (LLMs). Inspired by previous studies \cite{Min2022RethinkingWork}, we analyze the impact of…

Computation and Language · Computer Science 2023-09-29 Aayush Mishra , Karan Thakkar

Large language models (LLMs) achieve good performance on challenging reasoning benchmarks, yet could also make basic reasoning mistakes. This contrasting behavior is puzzling when it comes to understanding the mechanisms behind LLMs'…

Computation and Language · Computer Science 2025-03-05 Chulin Xie , Yangsibo Huang , Chiyuan Zhang , Da Yu , Xinyun Chen , Bill Yuchen Lin , Bo Li , Badih Ghazi , Ravi Kumar

Large Language Models (LLMs) have achieved remarkable success in reasoning tasks with the development of prompting methods. However, existing prompting approaches cannot reuse insights of solving similar problems and suffer from accumulated…

Artificial Intelligence · Computer Science 2024-06-18 Junchi Yu , Ran He , Rex Ying

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

Recent studies have discovered that Chain-of-Thought prompting (CoT) can dramatically improve the performance of Large Language Models (LLMs), particularly when dealing with complex tasks involving mathematics or reasoning. Despite the…

Machine Learning · Computer Science 2023-12-27 Guhao Feng , Bohang Zhang , Yuntian Gu , Haotian Ye , Di He , Liwei Wang

Language models (LLMs) offer potential as a source of knowledge for agents that need to acquire new task competencies within a performance environment. We describe efforts toward a novel agent capability that can construct cues (or…

Machine Learning · Computer Science 2022-11-22 James R. Kirk , Robert E. Wray , Peter Lindes , John E. Laird

Recent years have witnessed significant progress in large language models' (LLMs) reasoning, which is largely due to the chain-of-thought (CoT) approaches, allowing models to generate intermediate reasoning steps before reaching the final…

Computation and Language · Computer Science 2025-04-15 Zuoli Tang , Junjie Ou , Kaiqin Hu , Chunwei Wu , Zhaoxin Huan , Chilin Fu , Xiaolu Zhang , Jun Zhou , Chenliang Li

Theory of Mind (ToM) refers to an agent's ability to model the internal states of others. Contributing to the debate whether large language models (LLMs) exhibit genuine ToM capabilities, our study investigates their ToM robustness using…

Computation and Language · Computer Science 2026-02-26 Christian Nickel , Laura Schrewe , Florian Mai , Lucie Flek

Recent studies empirically reveal that large reasoning models (LRMs) can automatically allocate more reasoning strengths (i.e., the number of reasoning tokens) for harder problems, exhibiting difficulty-awareness for better task…

Artificial Intelligence · Computer Science 2026-02-10 Leheng Sheng , An Zhang , Zijian Wu , Weixiang Zhao , Changshuo Shen , Yi Zhang , Xiang Wang , Tat-Seng Chua

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks. Recent advancements in Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have further improved performance in System-2 reasoning…

Computation and Language · Computer Science 2025-08-25 Yang Sui , Yu-Neng Chuang , Guanchu Wang , Jiamu Zhang , Tianyi Zhang , Jiayi Yuan , Hongyi Liu , Andrew Wen , Shaochen Zhong , Na Zou , Hanjie Chen , Xia Hu

Modern large language models (LLMs) are capable of interpreting input strings as instructions, or prompts, and carry out tasks based on them. Unlike traditional learners, LLMs cannot use back-propagation to obtain feedback, and condition…

Computation and Language · Computer Science 2026-03-17 Adrian de Wynter , Xun Wang , Qilong Gu , Si-Qing Chen

Despite the remarkable success of large language models (LLMs) on traditional natural language processing tasks, their planning ability remains a critical bottleneck in tackling complex multi-step reasoning tasks. Existing approaches mainly…

Computation and Language · Computer Science 2024-10-07 Jiaxin Wen , Jian Guan , Hongning Wang , Wei Wu , Minlie Huang

Large Language Models (LLMs) have been applied to automate cyber security activities and processes including cyber investigation and digital forensics. However, the use of such models for cyber investigation and digital forensics should…

Cryptography and Security · Computer Science 2024-04-02 Jonathan Pan , Swee Liang Wong , Xin Wei Chia , Yidi Yuan