English
Related papers

Related papers: RecToM: A Benchmark for Evaluating Machine Theory …

200 papers

Large Language Models (LLMs) have recently shown a promise and emergence of Theory of Mind (ToM) ability and even outperform humans in certain ToM tasks. To evaluate and extend the boundaries of the ToM reasoning ability of LLMs, we propose…

Artificial Intelligence · Computer Science 2024-06-10 Weizhi Tang , Vaishak Belle

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent…

Computation and Language · Computer Science 2023-09-14 Bart Holterman , Kees van Deemter

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

Large Language Models (LLMs), through their contextualized representations, have been empirically proven to encapsulate syntactic, semantic, word sense, and common-sense knowledge. However, there has been limited exploration of their…

Computation and Language · Computer Science 2023-10-12 Yi Ru Wang , Jiafei Duan , Dieter Fox , Siddhartha Srinivasa

Large language models (LLMs) provide excellent text-generation capabilities, but standard prompting and generation methods generally do not lead to intentional or goal-directed agents and might necessitate considerable prompt tuning. This…

Computation and Language · Computer Science 2023-12-01 Marwa Abdulhai , Isadora White , Charlie Snell , Charles Sun , Joey Hong , Yuexiang Zhai , Kelvin Xu , Sergey Levine

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

Recent studies have shown that Theory of Mind (ToM) in large language models (LLMs) has not reached human-level performance yet. Since fine-tuning LLMs on ToM datasets often degrades their generalization, several inference-time methods have…

Computation and Language · Computer Science 2026-01-12 Kazutoshi Shinoda , Nobukatsu Hojo , Kyosuke Nishida , Yoshihiro Yamazaki , Keita Suzuki , Hiroaki Sugiyama , Kuniko Saito

Mental health has attracted substantial attention in recent years and LLM can be an effective technology for alleviating this problem owing to its capability in text understanding and dialogue. However, existing research in this domain…

Computation and Language · Computer Science 2024-12-09 Jinpeng Hu , Tengteng Dong , Luo Gang , Hui Ma , Peng Zou , Xiao Sun , Dan Guo , Xun Yang , Meng Wang

We propose MToMnet - a Theory of Mind (ToM) neural network for predicting beliefs and their dynamics during human social interactions from multimodal input. ToM is key for effective nonverbal human communication and collaboration, yet,…

Artificial Intelligence · Computer Science 2024-08-29 Matteo Bortoletto , Constantin Ruhdorfer , Lei Shi , Andreas Bulling

Resolving the dichotomy between the human-like yet constrained reasoning processes of Cognitive Architectures and the broad but often noisy inference behavior of Large Language Models (LLMs) remains a challenging but exciting pursuit, for…

Artificial Intelligence · Computer Science 2024-08-20 Siyu Wu , Alessandro Oltramari , Jonathan Francis , C. Lee Giles , Frank E. Ritter

Large Language Models (LLMs) have demonstrated potential in predicting mental health outcomes from online text, yet traditional classification methods often lack interpretability and robustness. This study evaluates structured reasoning…

Computation and Language · Computer Science 2026-01-09 Avinash Patil , Amardeep Kour Gedhu

Cognitive Reframing, a core element of Cognitive Behavioral Therapy (CBT), helps individuals reinterpret negative experiences by finding positive meaning. Recent advances in Large Language Models (LLMs) have demonstrated improved…

Computation and Language · Computer Science 2025-04-02 Yilin Qi , Dong Won Lee , Cynthia Breazeal , Hae Won Park

Social intelligence manifests the capability, often referred to as the Theory of Mind (ToM), to discern others' behavioral intentions, beliefs, and other mental states. ToM is especially important in multi-agent and human-machine…

Multiagent Systems · Computer Science 2023-11-09 Zhuoya Zhao , Feifei Zhao , Shiwen Wang , Yinqian Sun , Yi Zeng

Unlike current state-of-the-art language models, young children actively acquire language through interactions with their surrounding environment and caretakers. One mechanism that has been argued to be critical to language learning is the…

Computation and Language · Computer Science 2023-03-03 Andy Liu , Hao Zhu , Emmy Liu , Yonatan Bisk , Graham Neubig

Theory of Mind (ToM), the capacity to comprehend the mental states of distinct individuals, is essential for numerous practical applications. With the development of large language models (LLMs), there is a heated debate about whether they…

Computation and Language · Computer Science 2024-10-29 Xiaomeng Ma , Lingyu Gao , Qihui Xu

Large Language Models (LLMs) achieve strong performance on many reasoning benchmarks, yet these evaluations typically focus on isolated tasks that differ from real-world usage in task-oriented dialogue (TOD). In this setting, LLMs must…

Computation and Language · Computer Science 2026-04-30 Ivan Kartáč , Mateusz Lango , Ondřej Dušek

Game theory, as an analytical tool, is frequently utilized to analyze human behavior in social science research. With the high alignment between the behavior of Large Language Models (LLMs) and humans, a promising research direction is to…

Artificial Intelligence · Computer Science 2023-12-13 Caoyun Fan , Jindou Chen , Yaohui Jin , Hao He

Conversational recommender systems (CRS) enhance user experience through multi-turn interactions, yet evaluating CRS remains challenging. User simulators can provide comprehensive evaluations through interactions with CRS, but building…

Human-Computer Interaction · Computer Science 2025-08-01 Luyu Chen , Quanyu Dai , Zeyu Zhang , Xueyang Feng , Mingyu Zhang , Pengcheng Tang , Xu Chen , Yue Zhu , Zhenhua Dong

Theory of Mind (ToM), the ability to track others epistemic state, makes humans efficient collaborators. AI agents need the same capacity in multi agent settings, yet existing benchmarks mostly test literal ToM by asking direct belief…

Artificial Intelligence · Computer Science 2026-05-19 Gurusha Juneja , Dylan Lu , Saaket Agashe , Parth Diwane , Edward Gunn , Jayanth Srinivasa , Gaowen Liu , William Yang Wang , Yali Du , Xin Eric Wang

While the recommendation system (RS) has advanced significantly through deep learning, current RS approaches usually train and fine-tune models on task-specific datasets, limiting their generalizability to new recommendation tasks and their…

Information Retrieval · Computer Science 2024-03-22 Yancheng Wang , Ziyan Jiang , Zheng Chen , Fan Yang , Yingxue Zhou , Eunah Cho , Xing Fan , Xiaojiang Huang , Yanbin Lu , Yingzhen Yang