中文
相关论文

相关论文: MindWatcher: Toward Smarter Multimodal Tool-Integr…

200 篇论文

The ability for AI agents to "think with images" requires a sophisticated blend of reasoning and perception. However, current open multimodal agents still largely fall short on the reasoning aspect crucial for real-world tasks like…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Kaican Li , Lewei Yao , Jiannan Wu , Tiezheng Yu , Jierun Chen , Haoli Bai , Lu Hou , Lanqing Hong , Wei Zhang , Nevin L. Zhang

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

The adoption of large language models (LLMs) in healthcare has attracted significant research interest. However, their performance in healthcare remains under-investigated and potentially limited, due to i) they lack rich domain-specific…

人工智能 · 计算机科学 2024-05-21 Zishan Gu , Fenglin Liu , Changchang Yin , Ping Zhang

The advent of multimodal agents facilitates effective interaction within graphical user interface (GUI), especially in ubiquitous GUI control. However, their inability to reliably execute toggle control instructions remains a key…

Despite recent advances in AI, the development of systems capable of executing complex, multi-step reasoning tasks involving multiple tools remains a significant challenge. Current benchmarks fall short in capturing the real-world…

计算与语言 · 计算机科学 2025-01-03 Vaskar Nath , Pranav Raja , Claire Yoon , Sean Hendryx

Recently, inference-time scaling of chain-of-thought (CoT) has been demonstrated as a promising approach for addressing multi-modal reasoning tasks. While existing studies have predominantly centered on text-based thinking, the integration…

计算与语言 · 计算机科学 2025-05-27 Yujie Lin , Ante Wang , Moye Chen , Jingyao Liu , Hao Liu , Jinsong Su , Xinyan Xiao

Recently, Interleaved-modal Chain-of-Thought (ICoT) reasoning has achieved remarkable success by leveraging both multimodal inputs and outputs, attracting increasing attention. While achieving promising performance, current ICoT methods…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Xu Liu , Yongheng Zhang , Qiguang Chen , Yao Li , Sheng Wang , Libo Qin

Healthcare and medicine are multimodal disciplines that deal with multimodal data for reasoning and diagnosing multiple diseases. Although some multimodal reasoning models have emerged for reasoning complex tasks in scientific domains,…

人工智能 · 计算机科学 2025-09-16 Susanta Mitra

We introduce LongCat-Flash-Prover, a flagship 560-billion-parameter open-source Mixture-of- Experts (MoE) model that advances Native Formal Reasoning in Lean4 through agentic tool-integrated reasoning (TIR). We decompose the native formal…

Recent progress in reasoning with large language models (LLMs), such as DeepSeek-R1, demonstrates impressive capabilities in domains like mathematics and coding, by exhibiting complex cognitive behaviors such as verification, goal…

人工智能 · 计算机科学 2025-10-14 Xiao Yu , Baolin Peng , Ruize Xu , Michel Galley , Hao Cheng , Suman Nath , Jianfeng Gao , Zhou Yu

Deep Research agents are rapidly emerging as primary consumers of modern retrieval systems. Unlike human users who issue and refine queries without documenting their intermediate thought processes, Deep Research agents generate explicit…

计算与语言 · 计算机科学 2026-03-10 Zijian Chen , Xueguang Ma , Shengyao Zhuang , Jimmy Lin , Akari Asai , Victor Zhong

Chain-of-Thought (CoT) reasoning excels in language models but struggles in vision-language models due to premature visual-to-text conversion that discards continuous information such as geometry and spatial layout. While recent methods…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Weihang You , Qingchan Zhu , David Liu , Yi Pan , Geng Yuan , Hanqi Jiang

As the interest in Artificial Intelligence continues to grow it is becoming more and more important to investigate formalization and tools that allow us to exploit logic to reason about the world. In particular, given the increasing number…

人工智能 · 计算机科学 2019-09-19 Francesco Fabiano

Large language model-based agents operating in long-horizon interactions require memory systems that support temporal consistency, multi-hop reasoning, and evidence-grounded reuse across sessions. Existing approaches largely rely on…

计算与语言 · 计算机科学 2026-01-27 Juexiang Ye , Xue Li , Xinyu Yang , Chengkai Huang , Lanshun Nie , Lina Yao , Dechen Zhan

When large vision-language models are applied to the field of robotics, they encounter problems that are simple for humans yet error-prone for models. Such issues include confusion between third-person and first-person perspectives and a…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Baiyu Pan , Daqin Luo , Junpeng Yang , Jiyuan Wang , Yixuan Zhang , Hailin Shi , Jichao Jiao

Effective human-AI collaboration on complex reasoning tasks requires that users understand and interact with the model's process, not just receive an output. However, the monolithic text from methods like Chain-of-Thought (CoT) prevents…

音频与语音处理 · 电气工程与系统科学 2025-10-21 Yueqian Lin , Zhengmian Hu , Jayakumar Subramanian , Qinsi Wang , Nikos Vlassis , Hai "Helen" Li , Yiran Chen

End-to-end autonomous driving has emerged as a promising approach to unify perception, prediction, and planning within a single framework, reducing information loss and improving adaptability. However, existing methods often rely on fixed…

机器人学 · 计算机科学 2025-07-18 Yuhang Lu , Jiadong Tu , Yuexin Ma , Xinge Zhu

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

机器人学 · 计算机科学 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao

Large Language Models (LLMs) have made remarkable progress in mathematical reasoning, but still continue to struggle with high-precision tasks like numerical computation and formal symbolic manipulation. Integrating external tools has…

人工智能 · 计算机科学 2026-02-11 Qikai Chang , Zhenrong Zhang , Pengfei Hu , Jun Du , Jiefeng Ma , Yicheng Pan , Jianshu Zhang , Quan Liu , Jianqing Gao

Understanding and reasoning over tables is a critical capability for many real-world applications. Large language models (LLMs) have shown promise on this task, but current approaches remain limited. Fine-tuning based methods strengthen…