English
Related papers

Related papers: Failures in Perspective-taking of Multimodal AI Sy…

200 papers

The object perception capabilities of humans are impressive, and this becomes even more evident when trying to develop solutions with a similar proficiency in autonomous robots. While there have been notable advancements in the technologies…

Robotics · Computer Science 2026-04-29 Nicolás Navarro-Guerrero , Sibel Toprak , Josip Josifovski , Lorenzo Jamone

Language models have recently advanced into the realm of reasoning, yet it is through multimodal reasoning that we can fully unlock the potential to achieve more comprehensive, human-like cognitive capabilities. This survey provides a…

Computation and Language · Computer Science 2025-03-25 Zhiyu Lin , Yifei Gao , Xian Zhao , Yunfan Yang , Jitao Sang

For decades, neuroscientists and computer scientists have pursued a shared ambition: to understand intelligence and build it. Modern artificial neural networks now rival humans in language, perception, and reasoning, yet it is still largely…

Artificial Intelligence · Computer Science 2025-10-29 Silin Chen , Yuzhong Chen , Zifan Wang , Junhao Wang , Zifeng Jia , Keith M Kendrick , Tuo Zhang , Lin Zhao , Dezhong Yao , Tianming Liu , Xi Jiang

Conventional approaches to dietary assessment are primarily grounded in self-reporting methods or structured interviews conducted under the supervision of dietitians. These methods, however, are often subjective, potentially inaccurate, and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Frank P. -W. Lo , Jianing Qiu , Zeyu Wang , Junhong Chen , Bo Xiao , Wu Yuan , Stamatia Giannarou , Gary Frost , Benny Lo

Multimodal reasoning remains a fundamental challenge in artificial intelligence. Despite substantial advances in text-based reasoning, even state-of-the-art models such as GPT-o3 struggle to maintain strong performance in multimodal…

Computation and Language · Computer Science 2025-09-09 Hao Liang , Ruitao Wu , Bohan Zeng , Junbo Niu , Wentao Zhang , Bin Dong

Recent advancements in multimodal techniques open exciting possibilities for models excelling in diverse tasks involving text, audio, and image processing. Models like GPT-4V, blending computer vision and language modeling, excel in complex…

Computation and Language · Computer Science 2023-10-20 Xiang Zhang , Senyu Li , Zijun Wu , Ning Shi

A fundamental question in cognitive science concerns how social norms are acquired and represented. While humans typically learn norms through embodied social experience, we investigated whether large language models can achieve…

Artificial Intelligence · Computer Science 2025-08-27 Pontus Strimling , Simon Karlsson , Irina Vartanova , Kimmo Eriksson

Artificial intelligence for graphs has achieved remarkable success in modeling complex systems, ranging from dynamic networks in biology to interacting particle systems in physics. However, the increasingly heterogeneous graph datasets call…

Machine Learning · Computer Science 2023-01-25 Yasha Ektefaie , George Dasoulas , Ayush Noori , Maha Farhat , Marinka Zitnik

The cognitive framework of conceptual spaces bridges the gap between symbolic and subsymbolic AI by proposing an intermediate conceptual layer where knowledge is represented geometrically. There are two main approaches for obtaining the…

Machine Learning · Computer Science 2019-08-08 Lucas Bechberger , Elektra Kypridemou

Determining the extent to which the perceptual world can be recovered from language is a longstanding problem in philosophy and cognitive science. We show that state-of-the-art large language models can unlock new insights into this problem…

Computation and Language · Computer Science 2023-06-16 Raja Marjieh , Ilia Sucholutsky , Pol van Rijn , Nori Jacoby , Thomas L. Griffiths

Foundation models have transformed natural language processing and computer vision, and their impact is now reshaping remote sensing image analysis. With powerful generalization and transfer learning capabilities, they align naturally with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Liling Yang , Ning Chen , Jun Yue , Yidan Liu , Jiayi Ma , Pedram Ghamisi , Antonio Plaza , Leyuan Fang

As dialogue systems and chatbots increasingly integrate into everyday interactions, the need for efficient and accurate evaluation methods becomes paramount. This study explores the comparative performance of human and AI assessments across…

Computation and Language · Computer Science 2024-09-11 Ike Ebubechukwu , Johane Takeuchi , Antonello Ceravola , Frank Joublin

Perceptual multistability, observed across species and sensory modalities, offers valuable insights into numerous cognitive functions and dysfunctions. For instance, differences in temporal dynamics and information integration during…

Neurons and Cognition · Quantitative Biology 2025-06-24 Shervin Safavi , Danaé Rolland , Philipp Sterzer , Renaud Jardri , Pantelis Leptourgos

We investigated the potential and limitations of generative artificial intelligence (AI) in reflecting the authors' cognitive processes through creative expression. The focus is on the AI-generated artwork's ability to understand human…

Artificial Intelligence · Computer Science 2023-04-27 Yoon Kyung Lee , Yong-Ha Park , Sowon Hahn

As spatial intelligence becomes an increasingly important capability for foundation models, it remains unclear whether large language models' (LLMs) performance on spatial reasoning benchmarks reflects structured internal spatial…

Computation and Language · Computer Science 2026-03-30 Jiyuan An , Liner Yang , Mengyan Wang , Luming Lu , Weihua An , Erhong Yang

Determining the similarities and differences between humans and artificial intelligence (AI) is an important goal both in computational cognitive neuroscience and machine learning, promising a deeper understanding of human cognition and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Florian P. Mahner , Lukas Muttenthaler , Umut Güçlü , Martin N. Hebart

Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The…

Animal ethology is an crucial aspect of animal research, and animal behavior labeling is the foundation for studying animal behavior. This process typically involves labeling video clips with behavioral semantic tags, a task that is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yiqi Wu , Xiaodan Hu , Ziming Fu , Siling Zhou , Jiangong Li

The fundamental goal of artificial intelligence (AI) is to mimic the core cognitive activities of human. Despite tremendous success in the AI research, most of existing methods have only single-cognitive ability. To overcome this limitation…

Artificial Intelligence · Computer Science 2022-06-09 Nanyi Fei , Zhiwu Lu , Yizhao Gao , Guoxing Yang , Yuqi Huo , Jingyuan Wen , Haoyu Lu , Ruihua Song , Xin Gao , Tao Xiang , Hao Sun , Ji-Rong Wen