English
Related papers

Related papers: ST-BiBench: Benchmarking Multi-Stream Multimodal C…

200 papers

Recent advances in Large Language Models (LLMs) have shown promising results in complex reasoning tasks. However, current evaluations predominantly focus on single-turn reasoning scenarios, leaving interactive tasks largely unexplored. We…

Computation and Language · Computer Science 2026-05-22 Xiaoyuan Li , Keqin Bao , Yubo Ma , Moxin Li , Wenjie Wang , Rui Men , Yichang Zhang , Fuli Feng , Dayiheng Liu

With the integration of multimodal large language models (MLLMs) into robotic systems and AI applications, embedding emotional intelligence (EI) capabilities is essential for enabling these models to perceive, interpret, and respond to…

Computation and Language · Computer Science 2026-04-28 He Hu , Lianzhong You , Hongbo Xu , Qianning Wang , Fei Richard Yu , Fei Ma , Zebang Cheng , Zheng Lian , Yucheng Zhou , Laizhong Cui

Building generalist embodied agents requires a unified system that can interpret multimodal goals, model environment dynamics, and execute reliable actions across diverse real-world tasks. Multimodal large language models (MLLMs) offer…

Artificial Intelligence · Computer Science 2025-12-05 Yu-Wei Zhan , Xin Wang , Pengzhe Mao , Tongtong Feng , Ren Wang , Wenwu Zhu

Multimodal Large Language Models (MLLMs) are rapidly evolving, demonstrating impressive capabilities as multimodal assistants that interact with both humans and their environments. However, this increased sophistication introduces…

Artificial Intelligence · Computer Science 2025-04-24 Kaiwen Zhou , Chengzhi Liu , Xuandong Zhao , Anderson Compalas , Dawn Song , Xin Eric Wang

Multimodal large language models (MLLMs) are increasingly considered as a foundation for embodied agents, yet it remains unclear whether they can reliably reason about the long-term physical consequences of actions from an egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chengjun Yu , Xuhan Zhu , Chaoqun Du , Pengfei Yu , Wei Zhai , Yang Cao , Zheng-Jun Zha

While Multimodal Large Language Models (MLLMs) perform strongly on single-turn chart generation, their ability to support real-world exploratory data analysis remains underexplored. In practice, users iteratively refine visualizations…

Computation and Language · Computer Science 2026-02-18 Manav Nitin Kapadnis , Lawanya Baghel , Atharva Naik , Carolyn Rosé

Multimodal Large Language Models (MLLMs) have shown promising capabilities in mathematical reasoning within visual contexts across various datasets. However, most existing multimodal math benchmarks are limited to single-visual contexts,…

Artificial Intelligence · Computer Science 2025-08-04 Peijie Wang , Zhong-Zhi Li , Fei Yin , Xin Yang , Dekang Ran , Cheng-Lin Liu

Adaptive multimodal reasoning has emerged as a promising frontier in Vision-Language Models (VLMs), aiming to dynamically modulate between tool-augmented visual reasoning and text reasoning to enhance both effectiveness and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xintong Zhang , Xiaowen Zhang , Jingrong Wu , Zhi Gao , Shilin Yan , Zhenxin Diao , Kunpeng Gao , Xuanyan Chen , Yuwei Wu , Yunde Jia , Qing Li

Omni-modal large language models (OLLMs) aim to unify audio, vision, and text understanding within a single framework. While existing benchmarks primarily evaluate general cross-modal question-answering ability, it remains unclear whether…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xingrui Wang , Jiang Liu , Chao Huang , Xiaodong Yu , Ze Wang , Ximeng Sun , Jialian Wu , Alan Yuille , Emad Barsoum , Zicheng Liu

Reasoning and strategic behavior in social interactions is a hallmark of intelligence. This form of reasoning is significantly more sophisticated than isolated planning or reasoning tasks in static settings (e.g., math problem solving). In…

Artificial Intelligence · Computer Science 2025-10-17 Jianzhu Yao , Kevin Wang , Ryan Hsieh , Haisu Zhou , Tianqing Zou , Zerui Cheng , Zhangyang Wang , Pramod Viswanath

The rapid development of large language models (LLMs) has spurred extensive research into their domain-specific capabilities, particularly mathematical reasoning. However, most open-source LLMs focus solely on mathematical reasoning,…

Computation and Language · Computer Science 2024-09-04 Shuai Peng , Di Fu , Liangcai Gao , Xiuqin Zhong , Hongguang Fu , Zhi Tang

Despite growing interest in hallucination in Multimodal Large Language Models, existing studies primarily focus on single-image settings, leaving hallucination in multi-image scenarios largely unexplored. To address this gap, we conduct the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Jiale Li , Mingrui Wu , Zixiang Jin , Hao Chen , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Rongrong Ji

Recent multimodal large language models (MLLMs) have made remarkable progress in visual understanding and language-based reasoning, yet they lack a persistent world-centered representation for spatially consistent reasoning in 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Bo Gu , Zhikang Zhang , Zizhuang Wei , Zhenyuan Chen , Lingyun Li , Zhuoyi Song

Multi-Object Tracking (MOT) is evolving from geometric localization to Semantic MOT (SMOT) to answer complex relational queries, yet progress is hindered by semantic data scarcity and a structural disconnect between tracking architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Yuhua Zhu , Wenhui Zhao , Dingwen Zhang

Understanding the physical world - governed by laws of motion, spatial relations, and causality - poses a fundamental challenge for multimodal large language models (MLLMs). While recent advances such as OpenAI o3 and GPT-4o demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Zhuobai Dong , Junchao Yi , Ziyuan Zheng , Haochen Han , Xiangxi Zheng , Alex Jinpeng Wang , Fangming Liu , Linjie Li

Spatial reasoning is a key capability in the field of artificial intelligence, especially crucial in areas such as robotics, computer vision, and natural language understanding. However, evaluating the ability of multimodal large language…

Artificial Intelligence · Computer Science 2025-11-25 Rui Xu , Dakuan Lu , Zicheng Zhao , Xiaoyu Tan , Xintao Wang , Siyu Yuan , Jiangjie Chen , Yinghui Xu

Bimanual manipulation is challenging due to precise spatial and temporal coordination required between two arms. While there exist several real-world bimanual systems, there is a lack of simulated benchmarks with a large task diversity for…

Robotics · Computer Science 2024-08-01 Markus Grotz , Mohit Shridhar , Tamim Asfour , Dieter Fox

Human-level agentic intelligence extends beyond low-level geometric perception, evolving from recognizing where things are to understanding what they are for. While existing benchmarks effectively evaluate the geometric perception…

Mathematical reasoning, a core aspect of human cognition, is vital across many domains, from educational problem-solving to scientific advancements. As artificial general intelligence (AGI) progresses, integrating large language models…

Computation and Language · Computer Science 2025-05-21 Yibo Yan , Jiamin Su , Jianxiang He , Fangteng Fu , Xu Zheng , Yuanhuiyi Lyu , Kun Wang , Shen Wang , Qingsong Wen , Xuming Hu

Multimodal large language models (MLLMs) have advanced static visual--spatial reasoning, yet they often fail to preserve long-horizon spatial coherence in embodied settings where beliefs must be continuously revised from egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chih-Ting Liao , Xi Xiao , Chunlei Meng , Zhangquan Chen , Yitong Qiao , Weilin Zhou , Tianyang Wang , Xu Zheng , Xin Cao