English
Related papers

Related papers: Meta-Cognitive Analysis: Evaluating Declarative an…

200 papers

In recent years, large language models (LLMs) have spurred a new research paradigm in natural language processing. Despite their excellent capability in knowledge-based question answering and reasoning, their potential to retain faulty or…

Computation and Language · Computer Science 2023-12-11 Nianwen Si , Hao Zhang , Heyu Chang , Wenlin Zhang , Dan Qu , Weiqiang Zhang

Evaluating pragmatic reasoning in large language models (LLMs) remains challenging because model behavior can vary depending on evaluation methods. Previous studies suggest that prompt-based judgments may diverge from models' internal…

Computation and Language · Computer Science 2026-05-12 Ye-eun Cho

Datasets used for emotion recognition tasks typically contain overt cues that can be used in predicting the emotions expressed in a text. However, one challenge is that texts sometimes contain covert contextual cues that are rich in…

Computation and Language · Computer Science 2025-06-03 Gerard Christopher Yeo , Kokil Jaidka

Competency modeling is widely used in human resource management to select, develop, and evaluate talent. However, traditional expert-driven approaches rely heavily on manual analysis of large volumes of interview transcripts, making them…

Computation and Language · Computer Science 2026-02-16 Silin Du , Manqing Xin , Raymond Jia Wang

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

This position paper argues that LLMs should not yet be credited with decision explanation. This matters because recent work increasingly treats accurate behavioral prediction, plausible rationales, and outcome-conditioned reasoning traces…

Artificial Intelligence · Computer Science 2026-05-05 Wenshuo Wang

Large Language Models (LLMs) demonstrate exceptional performance across diverse tasks by leveraging pre-trained (i.e., parametric) and external (i.e., contextual) knowledge. While substantial efforts have been made to enhance the…

Computation and Language · Computer Science 2025-05-19 Hyuhng Joon Kim , Youna Kim , Sang-goo Lee , Taeuk Kim

Presupposition projection in conditionals is central to theories of meaning and pragmatics, yet it remains largely unevaluated in large language models. We address this gap through a parallel behavioral study comparing human judgments and…

Computation and Language · Computer Science 2026-05-19 Tara Azin , Yongan Yu , Raj Singh , Olessia Jouravlev

Large language models (LLMs) are widely used in decision-making, but their reliability, especially in critical tasks like healthcare, is not well-established. Therefore, understanding how LLMs reason and make decisions is crucial for their…

Machine Learning · Computer Science 2025-02-25 Ze Yu Zhang , Arun Verma , Finale Doshi-Velez , Bryan Kian Hsiang Low

Reasoning encompasses two typical types: deductive reasoning and inductive reasoning. Despite extensive research into the reasoning capabilities of Large Language Models (LLMs), most studies have failed to rigorously differentiate between…

Artificial Intelligence · Computer Science 2024-08-08 Kewei Cheng , Jingfeng Yang , Haoming Jiang , Zhengyang Wang , Binxuan Huang , Ruirui Li , Shiyang Li , Zheng Li , Yifan Gao , Xian Li , Bing Yin , Yizhou Sun

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI)…

Artificial Intelligence · Computer Science 2024-08-06 Thuy Ngoc Nguyen , Kasturi Jamale , Cleotilde Gonzalez

When training data is scarce, the incorporation of additional prior knowledge can assist the learning process. While it is common to initialize neural networks with weights that have been pre-trained on other large data sets, pre-training…

Machine Learning · Computer Science 2022-05-24 Laura von Rueden , Sebastian Houben , Kostadin Cvejoski , Christian Bauckhage , Nico Piatkowski

Large language models have recently reached near-parity with classical planners on well-known planning domains, yet this competence relies on world-knowledge exploitation rather than genuine symbolic reasoning. Goal recognition is a…

Artificial Intelligence · Computer Science 2026-05-18 Kin Max Piamolini Gusmão , Nathan Gavenski , Nir Oren , Felipe Meneguzzi

Large language models (LLMs) are highly capable of answering questions, but they are often unaware of their own knowledge boundary, i.e., knowing what they know and what they don't know. As a result, they can generate factually incorrect…

Computation and Language · Computer Science 2026-01-30 Christopher Adrian Kusuma , Muhammad Reza Qorib , Hwee Tou Ng

Recent pre-trained language models (PLMs) equipped with foundation reasoning skills have shown remarkable performance on downstream complex tasks. However, the significant structure reasoning skill has been rarely studied, which involves…

Computation and Language · Computer Science 2023-07-18 Siyuan Wang , Zhongyu Wei , Jiarong Xu , Taishan Li , Zhihao Fan

The integration of large language models (LLMs) and search engines represents a significant evolution in knowledge acquisition methodologies. However, determining the knowledge that an LLM already possesses and the knowledge that requires…

Computation and Language · Computer Science 2024-05-31 Jiejun Tan , Zhicheng Dou , Yutao Zhu , Peidong Guo , Kun Fang , Ji-Rong Wen

Large Language Models (LLMs) are increasingly embedded in evaluative processes, from information filtering to assessing and addressing knowledge gaps through explanation and credibility judgments. This raises the need to examine how such…

Reinforcement learning (RL) has achieved remarkable success in LLM reasoning, but whether it can also improve direct recall of parametric knowledge remains an open question. We study this question in a controlled zero-shot, one-hop,…

Computation and Language · Computer Science 2026-05-11 Wanli Yang , Hongyu Zang , Junwei Zhang , Wenjie Shi , Du Su , Jingang Wang , Xueqi Cheng , Fei Sun

Despite widespread success in language understanding and generation, large language models (LLMs) exhibit unclear and often inconsistent behavior when faced with tasks that require probabilistic reasoning. In this work, we present the first…

Computation and Language · Computer Science 2025-09-29 Mobina Pournemat , Keivan Rezaei , Gaurang Sriramanan , Arman Zarei , Jiaxiang Fu , Yang Wang , Hamid Eghbalzadeh , Soheil Feizi

The organization of latent knowledge within large-scale models poses unique challenges when addressing overlapping representations and optimizing contextual accuracy. Conceptual redundancies embedded across layers often result in…

Computation and Language · Computer Science 2025-03-26 Joseph Sakau , Evander Kozlowski , Roderick Thistledown , Basil Steinberger