中文
相关论文

相关论文: RecToM: A Benchmark for Evaluating Machine Theory …

200 篇论文

Large Language Models (LLMs) have recently shown a promise and emergence of Theory of Mind (ToM) ability and even outperform humans in certain ToM tasks. To evaluate and extend the boundaries of the ToM reasoning ability of LLMs, we propose…

人工智能 · 计算机科学 2024-06-10 Weizhi Tang , Vaishak Belle

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent…

计算与语言 · 计算机科学 2023-09-14 Bart Holterman , Kees van Deemter

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

Large Language Models (LLMs), through their contextualized representations, have been empirically proven to encapsulate syntactic, semantic, word sense, and common-sense knowledge. However, there has been limited exploration of their…

计算与语言 · 计算机科学 2023-10-12 Yi Ru Wang , Jiafei Duan , Dieter Fox , Siddhartha Srinivasa

Large language models (LLMs) provide excellent text-generation capabilities, but standard prompting and generation methods generally do not lead to intentional or goal-directed agents and might necessitate considerable prompt tuning. This…

计算与语言 · 计算机科学 2023-12-01 Marwa Abdulhai , Isadora White , Charlie Snell , Charles Sun , Joey Hong , Yuexiang Zhai , Kelvin Xu , Sergey Levine

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

Recent studies have shown that Theory of Mind (ToM) in large language models (LLMs) has not reached human-level performance yet. Since fine-tuning LLMs on ToM datasets often degrades their generalization, several inference-time methods have…

Mental health has attracted substantial attention in recent years and LLM can be an effective technology for alleviating this problem owing to its capability in text understanding and dialogue. However, existing research in this domain…

计算与语言 · 计算机科学 2024-12-09 Jinpeng Hu , Tengteng Dong , Luo Gang , Hui Ma , Peng Zou , Xiao Sun , Dan Guo , Xun Yang , Meng Wang

We propose MToMnet - a Theory of Mind (ToM) neural network for predicting beliefs and their dynamics during human social interactions from multimodal input. ToM is key for effective nonverbal human communication and collaboration, yet,…

人工智能 · 计算机科学 2024-08-29 Matteo Bortoletto , Constantin Ruhdorfer , Lei Shi , Andreas Bulling

Resolving the dichotomy between the human-like yet constrained reasoning processes of Cognitive Architectures and the broad but often noisy inference behavior of Large Language Models (LLMs) remains a challenging but exciting pursuit, for…

人工智能 · 计算机科学 2024-08-20 Siyu Wu , Alessandro Oltramari , Jonathan Francis , C. Lee Giles , Frank E. Ritter

Large Language Models (LLMs) have demonstrated potential in predicting mental health outcomes from online text, yet traditional classification methods often lack interpretability and robustness. This study evaluates structured reasoning…

计算与语言 · 计算机科学 2026-01-09 Avinash Patil , Amardeep Kour Gedhu

Cognitive Reframing, a core element of Cognitive Behavioral Therapy (CBT), helps individuals reinterpret negative experiences by finding positive meaning. Recent advances in Large Language Models (LLMs) have demonstrated improved…

计算与语言 · 计算机科学 2025-04-02 Yilin Qi , Dong Won Lee , Cynthia Breazeal , Hae Won Park

Social intelligence manifests the capability, often referred to as the Theory of Mind (ToM), to discern others' behavioral intentions, beliefs, and other mental states. ToM is especially important in multi-agent and human-machine…

多智能体系统 · 计算机科学 2023-11-09 Zhuoya Zhao , Feifei Zhao , Shiwen Wang , Yinqian Sun , Yi Zeng

Unlike current state-of-the-art language models, young children actively acquire language through interactions with their surrounding environment and caretakers. One mechanism that has been argued to be critical to language learning is the…

计算与语言 · 计算机科学 2023-03-03 Andy Liu , Hao Zhu , Emmy Liu , Yonatan Bisk , Graham Neubig

Theory of Mind (ToM), the capacity to comprehend the mental states of distinct individuals, is essential for numerous practical applications. With the development of large language models (LLMs), there is a heated debate about whether they…

计算与语言 · 计算机科学 2024-10-29 Xiaomeng Ma , Lingyu Gao , Qihui Xu

Large Language Models (LLMs) achieve strong performance on many reasoning benchmarks, yet these evaluations typically focus on isolated tasks that differ from real-world usage in task-oriented dialogue (TOD). In this setting, LLMs must…

计算与语言 · 计算机科学 2026-04-30 Ivan Kartáč , Mateusz Lango , Ondřej Dušek

Game theory, as an analytical tool, is frequently utilized to analyze human behavior in social science research. With the high alignment between the behavior of Large Language Models (LLMs) and humans, a promising research direction is to…

人工智能 · 计算机科学 2023-12-13 Caoyun Fan , Jindou Chen , Yaohui Jin , Hao He

Conversational recommender systems (CRS) enhance user experience through multi-turn interactions, yet evaluating CRS remains challenging. User simulators can provide comprehensive evaluations through interactions with CRS, but building…

人机交互 · 计算机科学 2025-08-01 Luyu Chen , Quanyu Dai , Zeyu Zhang , Xueyang Feng , Mingyu Zhang , Pengcheng Tang , Xu Chen , Yue Zhu , Zhenhua Dong

Theory of Mind (ToM), the ability to track others epistemic state, makes humans efficient collaborators. AI agents need the same capacity in multi agent settings, yet existing benchmarks mostly test literal ToM by asking direct belief…

While the recommendation system (RS) has advanced significantly through deep learning, current RS approaches usually train and fine-tune models on task-specific datasets, limiting their generalizability to new recommendation tasks and their…

信息检索 · 计算机科学 2024-03-22 Yancheng Wang , Ziyan Jiang , Zheng Chen , Fan Yang , Yingxue Zhou , Eunah Cho , Xing Fan , Xiaojiang Huang , Yanbin Lu , Yingzhen Yang