English
Related papers

Related papers: Agent-ScanKit: Unraveling Memory and Reasoning of …

200 papers

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Existing benchmarks for multimodal memory reasoning largely evaluate systems within pre-assembled contexts, but under-evaluate whether agents can use evidence distributed across independently originated sources. We argue that…

Computation and Language · Computer Science 2026-05-18 Huacan Chai , Yukai Wang , Yingxuan Yang , Dan Peng , Yuanyi Song , Zhihui Fu , Weiwen Liu , Jianghao Lin , Jun Wang , Weinan Zhang

Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text,…

Artificial Intelligence · Computer Science 2025-11-06 Huawei Lin , Yunzhi Shi , Tong Geng , Weijie Zhao , Wei Wang , Ravender Pal Singh

We introduce M3-Agent, a novel multimodal agent framework equipped with long-term memory. Like humans, M3-Agent can process real-time visual and auditory inputs to build and update episodic and semantic memories, gradually accumulating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Lin Long , Yichen He , Wentao Ye , Yiyuan Pan , Yuan Lin , Hang Li , Junbo Zhao , Wei Li

Despite advances in embodied AI, agent reasoning systems still struggle to capture the fundamental conceptual structures that humans naturally use to understand and interact with their environment. To address this, we propose a novel…

Artificial Intelligence · Computer Science 2025-04-01 François Olivier , Zied Bouraoui

We propose GAM-Agent, a game-theoretic multi-agent framework for enhancing vision-language reasoning. Unlike prior single-agent or monolithic models, GAM-Agent formulates the reasoning process as a non-zero-sum game between base…

Artificial Intelligence · Computer Science 2025-05-30 Jusheng Zhang , Yijia Fan , Wenjun Lin , Ruiqi Chen , Haoyi Jiang , Wenhao Chai , Jian Wang , Keze Wang

Recent multimodal LLMs have shown promise in chart-based visual question answering, but their performance declines sharply on unannotated charts-those requiring precise visual interpretation rather than relying on textual shortcuts. To…

Artificial Intelligence · Computer Science 2026-01-08 Rachneet Kaur , Nishan Srishankar , Zhen Zeng , Sumitra Ganesh , Manuela Veloso

The current remote sensing image analysis task is increasingly evolving from traditional object recognition to complex intelligence reasoning, which places higher requirements on the model's reasoning ability and the flexibility of tool…

Artificial Intelligence · Computer Science 2025-12-04 Chujie Wang , Zhiyuan Luo , Ruiqi Liu , Can Ran , Shenghua Fan , Xi Chen , Chu He

Autonomous agent frameworks still struggle to reconcile long-term experiential learning with real-time, context-sensitive decision-making. In practice, this gap appears as static cognition, rigid workflow dependence, and inefficient context…

Artificial Intelligence · Computer Science 2026-03-11 Xiaoxing Wang , Ning Liao , Shikun Wei , Chen Tang , Feiyu Xiong

Existing multimodal reasoning models and frameworks suffer from fundamental architectural limitations: most lack the human-like ability to autonomously explore diverse reasoning pathways-whether in direct inference, tool-driven visual…

Artificial Intelligence · Computer Science 2025-12-15 Yifu Guo , Zishan Xu , Zhiyuan Yao , Yuquan Lu , Jiaye Lin , Sen Hu , Zhenheng Tang , Huacan Wang , Ronghao Chen

Modern vision-language models (VLMs) deliver impressive predictive accuracy yet offer little insight into 'why' a decision is reached, frequently hallucinating facts, particularly when encountering out-of-distribution data. Neurosymbolic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Sanchit Sinha , Guangzhi Xiong , Zhenghao He , Aidong Zhang

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Multimodal agents offer a promising path to automating complex document-intensive workflows. Yet, a critical question remains: do these agents demonstrate genuine strategic reasoning, or merely stochastic trial-and-error search? To address…

With the growing adoption of large language model agents in persistent real-world roles, they naturally encounter continuous streams of tasks. A key limitation, however, is their failure to learn from the accumulated interaction history,…

The dominant paradigm of monolithic scaling in Vision-Language Models (VLMs) is failing for understanding and reasoning in documents, yielding diminishing returns as it struggles with the inherent need of this domain for document-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Xinlei Yu , Chengming Xu , Zhangquan Chen , Yudong Zhang , Shilin Lu , Cheng Yang , Jiangning Zhang , Shuicheng Yan , Xiaobin Hu

Multimodal Large Language Models have shown promising capabilities in bridging visual and textual reasoning, yet their reasoning capabilities in Open-Vocabulary Human-Object Interaction (OV-HOI) are limited by cross-modal hallucinations and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zhenlong Yuan , Yue Wang , Dapeng Zhang , Kejin Cui , Rui Chen , Jing Tang , Lei Sun , Hongwei Yu , Chengxuan Qian , Xiangxiang Chu , Shuo Li , Yuyin Zhou

Reasoning is a fundamental cognitive process underlying inference, problem-solving, and decision-making. While large language models (LLMs) demonstrate strong reasoning capabilities in closed-world settings, they struggle in open-ended and…

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

AI agents with advanced reasoning and tool use capabilities have demonstrated impressive performance in web browsing for deep search. While existing benchmarks such as BrowseComp evaluate these browsing abilities, they primarily focus on…

Recent advances in large language models have driven the emergence of intelligent agents operating in open-world, multimodal environments. To support long-term reasoning, such agents are typically equipped with external memory systems.…

Artificial Intelligence · Computer Science 2026-03-17 Rongjie Jiang , Jianwei Wang , Gengda Zhao , Chengyang Luo , Kai Wang , Wenjie Zhang
‹ Prev 1 2 3 10 Next ›