English
Related papers

Related papers: Multi-ToM: Evaluating Multilingual Theory of Mind …

200 papers

Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. While prior works have leveraged this bias to enhance multilingual performance through…

Computation and Language · Computer Science 2025-04-22 Chaoqun Liu , Wenxuan Zhang , Yiran Zhao , Anh Tuan Luu , Lidong Bing

We introduce DialToM, an annotated Theory of Mind (ToM) benchmark built from naturalistic human-human dialogues using a multiple-choice evaluation framework. Concurrent with recent work showing a gap between explicit mental-state inference…

Computation and Language · Computer Science 2026-05-29 Neemesh Yadav , Palakorn Achananuparp , Jing Jiang , Ee-Peng Lim

Theory of Mind (ToM) is a hallmark of human cognition, allowing individuals to reason about others' beliefs and intentions. Engineers behind recent advances in Artificial Intelligence (AI) have claimed to demonstrate comparable…

Artificial Intelligence · Computer Science 2025-04-01 Nitay Alon , Joseph Barnby , Reuth Mirsky , Stefan Sarkadi

When reading a story, humans can quickly understand new fictional characters with a few observations, mainly by drawing analogies to fictional and real people they already know. This reflects the few-shot and meta-learning essence of…

Computation and Language · Computer Science 2024-02-06 Mo Yu , Qiujing Wang , Shunchi Zhang , Yisi Sang , Kangsheng Pu , Zekai Wei , Han Wang , Liyan Xu , Jing Li , Yue Yu , Jie Zhou

The rapid advancement of artificial intelligence, particularly with the development of Large Language Models (LLMs) built on the transformer architecture, has redefined the capabilities of natural language processing. These models now…

Computation and Language · Computer Science 2025-02-11 Andrea Matarazzo , Riccardo Torlone

Large language models (LLMs) are highly adept at question answering and reasoning tasks, but when reasoning in a situational context, human expectations vary depending on the relevant cultural common ground. As languages are associated with…

Computation and Language · Computer Science 2024-04-02 Chen Cecilia Liu , Fajri Koto , Timothy Baldwin , Iryna Gurevych

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

Multimodal Large Language Models (MLLMs) mimic human perception and reasoning system by integrating powerful Large Language Models (LLMs) with various modality encoders (e.g., vision, audio), positioning LLMs as the "brain" and various…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jiaxing Huang , Jingyi Zhang

Multilingual language models have significantly advanced due to rapid progress in natural language processing. Models like BLOOM 1.7B, trained on diverse multilingual datasets, aim to bridge linguistic gaps. However, their effectiveness in…

Computation and Language · Computer Science 2026-02-03 Santhosh Kakarla , Gautama Shastry Bulusu Venkata , Aishwarya Gaddam , Maheedhar Sai Omtri Mohan

Theory of Mind (ToM) -- the ability to infer what others are thinking (e.g., intentions) from observable cues -- is traditionally considered fundamental to human social interactions. This has sparked growing efforts in building and…

Human-Computer Interaction · Computer Science 2026-02-13 Qiaosi Wang , Jini Kim , Avanita Sharma , Alicia , Lee , Jodi Forlizzi , Hong Shen

In this paper, a pragmatic semantic communication framework that enables effective goal-oriented information sharing between two-intelligent agents is proposed. In particular, semantics is defined as the causal state that encapsulates the…

Information Theory · Computer Science 2023-12-01 Christo Kurisummoottil Thomas , Emilio Calvanese Strinati , Walid Saad

Currently, in the study of multiagent systems, the intentions of agents are usually ignored. Nonetheless, as pointed out by Theory of Mind (ToM), people regularly reason about other's mental states, including beliefs, goals, and intentions,…

Multiagent Systems · Computer Science 2021-10-04 Luyao Yuan , Zipeng Fu , Linqi Zhou , Kexin Yang , Song-Chun Zhu

Advances in the performance of large language models (LLMs) have led some researchers to propose the emergence of theory of mind (ToM) in artificial intelligence (AI). LLMs can attribute beliefs, desires, intentions, and emotions, and they…

Computers and Society · Computer Science 2024-01-29 William Kidder , Jason D'Cruz , Kush R. Varshney

Recently, the field of Multi-Agent Systems (MAS) has gained popularity as researchers are trying to develop artificial intelligence capable of efficient collective reasoning. Agents based on Large Language Models (LLMs) perform well in…

Multiagent Systems · Computer Science 2025-07-30 Adam Kostka , Jarosław A. Chudziak

Large Language Models (LLMs) are becoming increasingly capable across global languages. However, the ability to communicate across languages does not necessarily translate to appropriate cultural representations. A key concern is US-centric…

Computation and Language · Computer Science 2025-09-03 Jonathan Rystrøm , Hannah Rose Kirk , Scott Hale

Theory-of-mind (ToM), a human ability to infer the intentions and thoughts of others, is an essential part of empathetic experiences. We provide here the framework for using NLP models to measure ToM expressed in written texts. For this…

Computation and Language · Computer Science 2021-08-27 Yoon Kyung Lee , Inju Lee , Jae Eun Park , Yoonwon Jung , Jiwon Kim , Sowon Hahn

Large-scale deployment of large language models (LLMs) in various applications, such as chatbots and virtual assistants, requires LLMs to be culturally sensitive to the user to ensure inclusivity. Culture has been widely studied in…

In this study, we reveal an in-context learning (ICL) capability of multilingual large language models (LLMs): by translating the input to several languages, we provide Parallel Input in Multiple Languages (PiM) to LLMs, which significantly…

Computation and Language · Computer Science 2025-06-04 Yongyu Mu , Peinan Feng , Zhiquan Cao , Yuzhang Wu , Bei Li , Chenglong Wang , Tong Xiao , Kai Song , Tongran Liu , Chunliang Zhang , Jingbo Zhu

Effective multi-agent collaboration requires agents to infer the rationale behind others' actions, a capability rooted in Theory-of-Mind (ToM). While recent Large Language Models (LLMs) excel at logical inference, their ability to infer…

Artificial Intelligence · Computer Science 2025-10-07 Fangzhou Liang , Tianshi Zheng , Chunkit Chan , Yauwai Yim , Yangqiu Song

Large language models (LLMs) are typically multilingual due to pretraining on diverse multilingual corpora. But can these models relate corresponding concepts across languages, i.e., be crosslingual? This study evaluates state-of-the-art…

Computation and Language · Computer Science 2025-03-05 Lynn Chua , Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Amer Sinha , Chulin Xie , Chiyuan Zhang