English
Related papers

Related papers: Agentic Active Omni-Modal Perception for Multi-Hop…

200 papers

While existing benchmarks probe the reasoning abilities of large language models (LLMs) across diverse domains, they predominantly assess passive reasoning, providing models with all the information needed to reach a solution. By contrast,…

Machine Learning · Computer Science 2025-06-11 Zhanke Zhou , Xiao Feng , Zhaocheng Zhu , Jiangchao Yao , Sanmi Koyejo , Bo Han

This paper proposes a group deliberation oriented multi-agent conversational model to address the limitations of single large language models in complex reasoning tasks. The model adopts a three-level role division architecture consisting…

Artificial Intelligence · Computer Science 2026-01-01 Zheyu Shi , Dong Qiu , Shanlong Yu

Artificial intelligence has shown promise in medical imaging, yet most existing systems lack flexibility, interpretability, and adaptability - challenges especially pronounced in ophthalmology, where diverse imaging modalities are…

Automating operations research (OR) with large language models (LLMs) remains limited by hand-crafted reasoning--execution workflows. Complex OR tasks require adaptive coordination among problem interpretation, mathematical formulation,…

Artificial Intelligence · Computer Science 2026-04-21 Jiahao Huang , Peilan Xu , Xiaoya Nan , Wenjian Luo

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…

The rapid advancement of multi-modal language models (MLLMs) like GPT-4o has propelled the development of Omni language models, designed to process and proactively respond to continuous streams of multi-modal data. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuxuan Wang , Yueqian Wang , Bo Chen , Tong Wu , Dongyan Zhao , Zilong Zheng

Multimodal Large Language Models (MLLMs) are a major focus of recent AI research. However, most prior work focuses on static image understanding, while their ability to process sequential audio-video data remains underexplored. This gap…

Artificial Intelligence · Computer Science 2026-05-28 Ahmed Y. Radwan , Christos Emmanouilidis , Hina Tabassum , Deval Pandya , Shaina Raza

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

Machine Learning · Computer Science 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

Earth observation (EO) is essential for understanding the evolving states of the Earth system. Although recent MLLMs have advanced EO research, they still lack the capability to tackle complex tasks that require multi-step reasoning and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Peilin Feng , Zhutao Lv , Junyan Ye , Xiaolei Wang , Xinjie Huo , Jinhua Yu , Wanghan Xu , Wenlong Zhang , Lei Bai , Conghui He , Weijia Li

Recently, multimodal large language models (MLLMs), such as GPT-4o, Gemini 1.5 Pro, and Reka Core, have expanded their capabilities to include vision and audio modalities. While these models demonstrate impressive performance across a wide…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kaixiong Gong , Kaituo Feng , Bohao Li , Yibing Wang , Mofan Cheng , Shijia Yang , Jiaming Han , Benyou Wang , Yutong Bai , Zhuoran Yang , Xiangyu Yue

Active perception, a crucial human capability, involves setting a goal based on the current understanding of the environment and performing actions to achieve that goal. Despite significant efforts in evaluating Multimodal Large Language…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Ziyue Wang , Chi Chen , Fuwen Luo , Yurui Dong , Yuanchi Zhang , Yuzhuang Xu , Xiaolong Wang , Peng Li , Yang Liu

Amodal completion, the task of inferring invisible object parts, faces significant challenges in maintaining semantic consistency and structural integrity. Prior progressive approaches are inherently limited by inference instability and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Hongxing Fan , Shuyu Zhao , Jiayang Ao , Lu Sheng

Personalized digital health support requires long-horizon, cross-dimensional reasoning over heterogeneous lifestyle signals, and recent advances in mobile sensing and large language models (LLMs) make such support increasingly feasible.…

Artificial Intelligence · Computer Science 2026-01-21 Ye Tian , Zihao Wang , Onat Gungor , Xiaoran Fan , Tajana Rosing

Understanding Theory of Mind is essential for building socially intelligent multimodal agents capable of perceiving and interpreting human behavior. We introduce MoMentS (Multimodal Mental States), a comprehensive benchmark designed to…

Long-form video understanding remains challenging due to the extended temporal structure and dense multimodal cues. Despite recent progress, many existing approaches still rely on hand-crafted reasoning pipelines or employ token-consuming…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yufei Yin , Qianke Meng , Minghao Chen , Jiajun Ding , Zhenwei Shao , Zhou Yu

Temporal Awareness, the ability to reason dynamically based on the timestamp when a question is raised, is the key distinction between offline and online video LLMs. Unlike offline models, which rely on complete videos for static, post hoc…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yifei Li , Junbo Niu , Ziyang Miao , Chunjiang Ge , Yuanhang Zhou , Qihao He , Xiaoyi Dong , Haodong Duan , Shuangrui Ding , Rui Qian , Pan Zhang , Yuhang Zang , Yuhang Cao , Conghui He , Jiaqi Wang

Can a multimodal language model learn to manipulate physical objects by reasoning about its own failures-without gradient updates, demonstrations, or reward engineering? We argue the answer is yes, under conditions we characterise…

Robotics · Computer Science 2026-03-06 Vaishak Kumar

Generalization across Agentic tool-calling environments remains a key unsolved challenge in developing reliable agentic reasoning systems. While large language models (LLMs) demonstrate strong performance on isolated benchmarks, their…

Artificial Intelligence · Computer Science 2025-10-28 Vishvesh Bhat , Omkar Ghugarkar , Julian McAuley

Multimodal Large Language Models (MLLMs) have recently made rapid progress toward unified Omni models that integrate vision, language, and audio. However, existing environments largely focus on 2D or 3D visual context and vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yurui Dong , Ziyue Wang , Shuyun Lu , Dairu Liu , Xuechen Liu , Fuwen Luo , Peng Li , Yang Liu

In this paper, we propose XGC-AVis, a multi-agent framework that enhances the audio-video temporal alignment capabilities of multimodal large models (MLLMs) and improves the efficiency of retrieving key video segments through 4 stages:…

Multimedia · Computer Science 2025-09-30 Yuqin Cao , Xiongkuo Min , Yixuan Gao , Wei Sun , Zicheng Zhang , Jinliang Han , Guangtao Zhai
‹ Prev 1 4 5 6 7 8 10 Next ›