English
Related papers

Related papers: MageBench: Bridging Large Multimodal Models to Age…

200 papers

Recent advancements have underscored the potential of large language model (LLM)-based agents in financial decision-making. Despite this progress, the field currently encounters two main challenges: (1) the lack of a comprehensive LLM agent…

Game-playing ability serves as an indicator for evaluating the strategic reasoning capability of large language models (LLMs). While most existing studies rely on utility performance metrics, which are not robust enough due to variations in…

Artificial Intelligence · Computer Science 2025-08-19 Hongtao Liu , Zhicheng Du , Zihe Wang , Weiran Shen

As reasoning models scale rapidly, the essential role of multimodality in human cognition has come into sharp relief, driving a growing need to probe vision-centric cognitive behaviors. Yet, existing multimodal benchmarks either…

Recent advancements in Large Vision-Language Models (VLMs), have greatly enhanced their capability to jointly process text and images. However, despite extensive benchmarks evaluating visual comprehension (e.g., diagrams, color schemes, OCR…

Computation and Language · Computer Science 2025-05-27 Benjamin Clavié , Florian Brand

Recent advances in large multimodal models have enabled new opportunities in embodied AI, particularly in robotic manipulation. These models have shown strong potential in generalization and reasoning, but achieving reliable and responsible…

Robotics · Computer Science 2025-12-05 Lei Zhang , Ju Dong , Kaixin Bai , Minheng Ni , Zoltan-Csaba Marton , Zhaopeng Chen , Jianwei Zhang

The rapid evolution of Multi-modality Large Language Models (MLLMs) has catalyzed a shift in computer vision from specialized models to general-purpose foundation models. Nevertheless, there is still an inadequacy in assessing the abilities…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Haoning Wu , Zicheng Zhang , Erli Zhang , Chaofeng Chen , Liang Liao , Annan Wang , Chunyi Li , Wenxiu Sun , Qiong Yan , Guangtao Zhai , Weisi Lin

With the integration of large language models (LLMs), embodied agents have strong capabilities to understand and plan complicated natural language instructions. However, a foreseeable issue is that those embodied agents can also flawlessly…

Cryptography and Security · Computer Science 2025-11-03 Sheng Yin , Xianghe Pang , Yuanzhuo Ding , Menglan Chen , Yutong Bi , Yichen Xiong , Wenhao Huang , Zhen Xiang , Jing Shao , Siheng Chen

Multimodal Large Language Models (MLLMs) have shown promise in single-agent vision tasks, yet benchmarks for evaluating multi-agent collaborative perception remain scarce. This gap is critical, as multi-drone systems provide enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jirong Zha , Yuxuan Fan , Tianyu Zhang , Geng Chen , Yingfeng Chen , Chen Gao , Xinlei Chen

Advanced Large Multimodal Models (LMMs) have demonstrated impressive performance in K-12 reasoning tasks, exhibiting great promise as intelligent tutors. Realizing this potential requires models to navigate real-world examinations…

Artificial Intelligence · Computer Science 2026-05-27 Xiaohan Wang , Mingze Yin , Yilin Zhao , Gang Liu , Dian Li

While Multimodal Large Language Models (MLLMs) have exhibited remarkable general intelligence across diverse domains, their potential in low-altitude applications dominated by Unmanned Aerial Vehicles (UAVs) remains largely underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shiqi Dai , Zizhi Ma , Zhicong Luo , Xuesong Yang , Yibin Huang , Wanyue Zhang , Chi Chen , Zonghao Guo , Wang Xu , Yufei Sun , Maosong Sun

Recent advances in large language models have enabled LLM-based agents to achieve strong performance on a variety of benchmarks. However, their performance in real-world deployments often that observed on benchmark settings, especially in…

Artificial Intelligence · Computer Science 2026-02-19 Ruipeng Wang , Yuxin Chen , Yukai Wang , Chang Wu , Junfeng Fang , Xiaodong Cai , Qi Gu , Hui Su , An Zhang , Xiang Wang , Xunliang Cai , Tat-Seng Chua

Today's AI models learn primarily through mimicry and refining, so it is not surprising that they struggle to solve problems beyond the limits set by existing data. To solve novel problems, agents should acquire skills for exploring and…

Artificial Intelligence · Computer Science 2026-03-25 Raj Ghugare , Roger Creus Castanyer , Catherine Ji , Kathryn Wantlin , Jin Schofield , Karthik Narasimhan , Benjamin Eysenbach

Creativity is a fundamental aspect of intelligence, involving the ability to generate novel and appropriate solutions across diverse contexts. While Large Language Models (LLMs) have been extensively evaluated for their creative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Xinyu Fang , Zhijian Chen , Kai Lan , Lixin Ma , Shengyuan Ding , Yingji Liang , Xiangyu Zhao , Farong Wen , Zicheng Zhang , Guofeng Zhang , Haodong Duan , Kai Chen , Dahua Lin

Multimodal Large Language Models (MLLMs) excel at recognizing individual visual elements and reasoning over simple linear diagrams. However, when faced with complex topological structures involving branching paths, converging flows, and…

Artificial Intelligence · Computer Science 2026-04-24 Qiang Xu , Shengyuan Bai , Yu Wang , He Cao , Leqing Chen , Yuanyuan Liu , Bin Feng , Zijing Liu , Yu Li

As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning. However, existing research on MAD suffers from…

Artificial Intelligence · Computer Science 2026-01-07 Ao Li , Jinghui Zhang , Luyu Li , Yuxiang Duan , Lang Gao , Mingcai Chen , Weijun Qin , Shaopeng Li , Fengxian Ji , Ning Liu , Lizhen Cui , Xiuying Chen , Yuntao Du

As multimodal language models play an increasingly important role in scientific research, materials science offers a critical testbed due to its interdisciplinary, multimodal, and application-driven nature. However, existing materials…

Artificial Intelligence · Computer Science 2026-05-29 Wanhao Liu , Jiaqing Xie , Qian Tan , Weida Wang , Jue Wang , Ran Sun , Zhuo Yang , Wanli Ouyang , Lei Bai , Tianfan Fu , Lu Chen , Xin Chen , Yuqiang Li

The recent development and success of Large Language Models (LLMs) necessitate an evaluation of their performance across diverse NLP tasks in different languages. Although several frameworks have been developed and made publicly available,…

As AI systems progress, we rely more on them to make decisions with us and for us. To ensure that such decisions are aligned with human values, it is imperative for us to understand not only what decisions they make but also how they come…

Multimodal Large Language Models (MLLM) have made significant progress in the field of document analysis. Despite this, existing benchmarks typically focus only on extracting text and simple layout information, neglecting the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Lei Chen , Feng Yan , Yujie Zhong , Shaoxiang Chen , Zequn Jie , Lin Ma

The comprehension of text-rich visual scenes has become a focal point for evaluating Multi-modal Large Language Models (MLLMs) due to their widespread applications. Current benchmarks tailored to the scenario emphasize perceptual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Bin Shan , Xiang Fei , Wei Shi , An-Lan Wang , Guozhi Tang , Lei Liao , Jingqun Tang , Xiang Bai , Can Huang