English
Related papers

Related papers: InMind: Evaluating LLMs in Capturing and Applying …

200 papers

Large Language Models (LLMs) and Vision Language Models (VLMs) possess extensive knowledge and exhibit promising reasoning abilities, however, they still struggle to perform well in complex, dynamic environments. Real-world tasks require…

Large reasoning models (LRMs) have significantly advanced performance on complex tasks, yet their tendency to overthink introduces inefficiencies. This study investigates the internal mechanisms of reinforcement learning (RL)-trained LRMs…

Artificial Intelligence · Computer Science 2025-05-22 Rongzhi Zhu , Yi Liu , Zequn Sun , Yiwei Wang , Wei Hu

Solving puzzles in natural language poses a long-standing challenge in AI. While large language models (LLMs) have recently shown impressive capabilities in a variety of tasks, they continue to struggle with complex puzzles that demand…

Artificial Intelligence · Computer Science 2025-05-23 Naiqi Li , Peiyuan Liu , Zheng Liu , Tao Dai , Yong Jiang , Shu-Tao Xia

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

This study explores the idea of AI Personality or AInality suggesting that Large Language Models (LLMs) exhibit patterns similar to human personalities. Assuming that LLMs share these patterns with humans, we investigate using…

Computation and Language · Computer Science 2023-12-25 Yang Lu , Jordan Yu , Shou-Hsuan Stephen Huang

Theory of Mind (ToM) is the ability to understand and reflect on the mental states of others. Although this capability is crucial for human interaction, testing on Large Language Models (LLMs) reveals that they possess only a rudimentary…

Computation and Language · Computer Science 2025-01-17 Sneheel Sarangi , Maha Elgarf , Hanan Salam

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

Computation and Language · Computer Science 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

Logical reasoning is a core capability for large language models (LLMs), yet existing benchmarks that rely solely on final-answer accuracy fail to capture the quality of the reasoning process. To address this, we introduce FineLogic, a…

Computation and Language · Computer Science 2025-10-10 Yujun Zhou , Jiayi Ye , Zipeng Ling , Yufei Han , Yue Huang , Haomin Zhuang , Zhenwen Liang , Kehan Guo , Taicheng Guo , Xiangqi Wang , Xiangliang Zhang

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

Computation and Language · Computer Science 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

Inductive reasoning is an essential capability for large language models (LLMs) to achieve higher intelligence, which requires the model to generalize rules from observed facts and then apply them to unseen examples. We present MIRAGE, a…

Computation and Language · Computer Science 2025-03-03 Jiachun Li , Pengfei Cao , Zhuoran Jin , Yubo Chen , Kang Liu , Jun Zhao

Large Language Models (LLMs) are increasingly deployed in roles requiring nuanced psychological understanding, such as emotional support agents, counselors, and decision-making assistants. However, their ability to interpret human…

Computation and Language · Computer Science 2025-09-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

Strategic social deduction games serve as valuable testbeds for evaluating the understanding and inference skills of language models, offering crucial insights into social science, artificial intelligence, and strategic gaming. This paper…

Computation and Language · Computer Science 2024-07-25 Yizhou Chi , Lingjun Mao , Zineng Tang

This paper presents a comprehensive survey of the current status and opportunities for Large Language Models (LLMs) in strategic reasoning, a sophisticated form of reasoning that necessitates understanding and predicting adversary actions…

Computation and Language · Computer Science 2024-04-02 Yadong Zhang , Shaoguang Mao , Tao Ge , Xun Wang , Adrian de Wynter , Yan Xia , Wenshan Wu , Ting Song , Man Lan , Furu Wei

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

Computation and Language · Computer Science 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

An essential element of human mathematical reasoning is our number sense -- an abstract understanding of numbers and their relationships -- which allows us to solve problems involving vast number spaces using limited computational…

Artificial Intelligence · Computer Science 2025-04-02 Roussel Rahman

Modern language models (LMs) can learn to perform new tasks in different ways: in instruction following, the target task is described explicitly in natural language; in few-shot prompting, the task is specified implicitly with a small…

Computation and Language · Computer Science 2024-08-30 Emmy Liu , Graham Neubig , Jacob Andreas

Logical reasoning consistently plays a fundamental and significant role in the domains of knowledge engineering and artificial intelligence. Recently, Large Language Models (LLMs) have emerged as a noteworthy innovation in natural language…

Computation and Language · Computer Science 2024-09-17 Fangzhi Xu , Qika Lin , Jiawei Han , Tianzhe Zhao , Jun Liu , Erik Cambria

Modeling subrational agents, such as humans or economic households, is inherently challenging due to the difficulty in calibrating reinforcement learning models or collecting data that involves human subjects. Existing work highlights the…

Artificial Intelligence · Computer Science 2024-02-15 Andrea Coletta , Kshama Dwarakanath , Penghang Liu , Svitlana Vyetrenko , Tucker Balch

Contemporary artificial intelligence research has been organized around two dominant ambitions: productivity, which treats AI systems as tools for accelerating work and economic output, and alignment, which focuses on ensuring that…

Artificial Intelligence · Computer Science 2026-03-10 W. Russell Neuman , Chad Coleman

In computational cognitive modeling, capturing the full spectrum of human judgment and decision-making processes, beyond just optimal behaviors, is a significant challenge. This study explores whether Large Language Models (LLMs) can…

Artificial Intelligence · Computer Science 2025-02-24 Animesh Nighojkar , Bekhzodbek Moydinboyev , My Duong , John Licato