English
Related papers

Related papers: MOTOR-Bench: A Real-world Dataset and Multi-agent …

200 papers

A core aspect of human perception is situated awareness, the ability to relate ourselves to the surrounding physical environment and reason over possible actions in context. However, most existing benchmarks for multimodal foundation models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Chuhan Li , Ruilin Han , Joy Hsu , Yongyuan Liang , Rajiv Dhawan , Jiajun Wu , Ming-Hsuan Yang , Xin Eric Wang

Despite rapid advances in vision-language models (VLMs), current benchmarks for multimodal reasoning fall short in three key dimensions. First, they overwhelmingly rely on static images, failing to capture the temporal complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Zikui Cai , Andrew Wang , Anirudh Satheesh , Ankit Nakhawa , Hyunwoo Jae , Keenan Powell , Minghui Liu , Neel Jay , Sungbin Oh , Xiyao Wang , Yongyuan Liang , Tom Goldstein , Furong Huang

Understanding causal relationships across modalities is a core challenge for multimodal models operating in real-world environments. We introduce ISO-Bench, a benchmark for evaluating whether models can infer causal dependencies between…

Computation and Language · Computer Science 2025-08-01 Ananya Sadana , Yash Kumar Lal , Jiawei Zhou

Training and education in human-centered fields require authentic practice, yet realistic simulations of human behavior have remained limited. We present a multi-agent psychological simulation system that models internal cognitive-affective…

Artificial Intelligence · Computer Science 2025-11-05 Xiangen Hu , Jiarui Tong , Sheng Xu

Multi-hop audio-visual reasoning remains challenging for Omni-LLMs, as relevant evidence is often sparse, temporally dispersed, and distributed across both audio and visual streams. Existing benchmarks provide limited investigation of this…

Artificial Intelligence · Computer Science 2026-05-28 Ke Xu , Yuhao Wang , Ziyang Cheng , Hongcheng Liu , Yanfeng Wang , Yu Wang

The adoption of large language models (LLMs) in healthcare has attracted significant research interest. However, their performance in healthcare remains under-investigated and potentially limited, due to i) they lack rich domain-specific…

Artificial Intelligence · Computer Science 2024-05-21 Zishan Gu , Fenglin Liu , Changchang Yin , Ping Zhang

Detecting mental states of human users is crucial for the development of cooperative and intelligent robots, as it enables the robot to understand the user's intentions and desires. Despite their importance, it is difficult to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hendric Voß , Heiko Wersing , Stefan Kopp

Modern vision-language models (VLMs) deliver impressive predictive accuracy yet offer little insight into 'why' a decision is reached, frequently hallucinating facts, particularly when encountering out-of-distribution data. Neurosymbolic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Sanchit Sinha , Guangzhi Xiong , Zhenghao He , Aidong Zhang

Modern AI progress has been driven by ML methods that are generalizable across settings and scalable to larger regimes. As large language models demonstrate advanced capabilities in reasoning, coding, and engineering tasks, it is…

Multi-agent systems (MAS) have recently emerged as promising socio-collaborative companions for emotional and cognitive support. However, these systems frequently suffer from persona collapse--where agents revert to generic, homogenized…

Computation and Language · Computer Science 2026-01-21 Yiyang Wang , Yiqiao Jin , Alex Cabral , Josiah Hester

Spoken Dialogue Models (SDMs) have advanced rapidly, yet their ability to sustain genuinely interactive multi-turn conversations remains underexplored, as most benchmarks focus on single-turn exchanges. We introduce Multi-Bench, the first…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Yayue Deng , Guoqiang Hu , Haiyang Sun , Xiangyu Zhang , Haoyang Zhang , Fei Tian , Xuerui Yang , Gang Yu , Eng Siong Chng

While multi-agent systems (MAS) promise elevated intelligence through coordination of agents, current approaches to automatic MAS design under-deliver. Such shortcomings stem from two key factors: (1) methodological complexity - agent…

Artificial Intelligence · Computer Science 2026-05-25 Zixuan Ke , Yifei Ming , Austin Xu , Ryan Chin , Xuan-Phi Nguyen , Prathyusha Jwalapuram , Jiayu Wang , Semih Yavuz , Caiming Xiong , Shafiq Joty

In Multi-Agent Systems (MAS), agents are designed with social capabilities, allowing them to understand and reason about social concepts such as norms when interacting with others (e.g., inter-robot interactions). In Normative MAS (NorMAS),…

Multiagent Systems · Computer Science 2026-03-05 Oishik Chowdhury , Anushka Debnath , Bastin Tony Roy Savarimuthu

Interactive world models are advancing rapidly, yet existing benchmarks cover only part of the required competencies, leaving no unified standard for systematic evaluation. To fill this gap, we introduce WBench, a comprehensive multi-turn…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kaining Ying , Hengrui Hu , Siyu Ren , Jiamu Li , Fengjiao Chen , Ziwen Wang , Xuezhi Cao , Xunliang Cai , Henghui Ding

As large language models (LLMs) evolve into autonomous agents capable of acting in open-ended environments, ensuring behavioral alignment with human values becomes a critical safety concern. Existing benchmarks, focused on static,…

Computation and Language · Computer Science 2026-03-10 Weixiang Zhao , Haozhen Li , Yanyan Zhao , xuda zhi , Yongbo Huang , Hao He , Bing Qin , Ting Liu

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau

Next-generation AI must manage vast personal data, diverse tools, and multi-step reasoning, yet most benchmarks remain context-free and single-turn. We present ASTRA-bench (Assistant Skills in Tool-use, Reasoning \& Action-planning), a…

Artificial Intelligence · Computer Science 2026-03-03 Zidi Xiu , David Q. Sun , Kevin Cheng , Maitrik Patel , Josh Date , Yizhe Zhang , Jiarui Lu , Omar Attia , Raviteja Vemulapalli , Oncel Tuzel , Meng Cao , Samy Bengio

Autonomous systems have achieved superhuman performance in isolation or simulation, yet they remain brittle in shared, dynamic real-world spaces. This failure stems from the dominant single-agent paradigm for physical applications, where…

Robotics · Computer Science 2026-05-22 Ismail Geles , Leonard Bauersfeld , Markus Wulfmeier , Davide Scaramuzza

Multimodal Large Language Models (MLLM) have made significant progress in the field of document analysis. Despite this, existing benchmarks typically focus only on extracting text and simple layout information, neglecting the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Lei Chen , Feng Yan , Yujie Zhong , Shaoxiang Chen , Zequn Jie , Lin Ma

Multimodal Large Language Models (MLLMs) are rapidly becoming the intelligence brain of end-to-end autonomous driving systems. A key challenge is to assess whether MLLMs can truly understand and follow complex real-world traffic rules.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Enhui Ma , Jiahuan Zhang , Guantian Zheng , Tao Tang , Shengbo Eben Li , Yuhang Lu , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Zhihui Hao , Xianpeng Lang , Kaicheng Yu