中文
相关论文

相关论文: Skywork-R1V4: Toward Agentic Multimodal Intelligen…

200 篇论文

Recent agentic search frameworks enable deep research via iterative planning and retrieval, reducing hallucinations and enhancing factual grounding. However, they remain text-centric, overlooking the multimodal evidence that characterizes…

计算与语言 · 计算机科学 2026-04-21 Fangda Ye , Zhifei Xie , Yuxin Hu , Yihang Yin , Shurui Huang , Shikai Dong , Jianzhu Bao , Shuicheng Yan

Coordinating multiple embodied agents in dynamic environments remains a core challenge in artificial intelligence, requiring both perception-driven reasoning and scalable cooperation strategies. While recent works have leveraged large…

人工智能 · 计算机科学 2026-01-23 Li Kang , Xiufeng Song , Heng Zhou , Yiran Qin , Jie Yang , Xiaohong Liu , Philip Torr , Lei Bai , Zhenfei Yin

Reinforcement learning for agentic multimodal models often suffers from interaction collapse, where models learn to reduce tool usage and multi-turn reasoning, limiting the benefits of agentic behavior. We introduce PyVision-RL, a…

人工智能 · 计算机科学 2026-02-25 Shitian Zhao , Shaoheng Lin , Ming Li , Haoquan Zhang , Wenshuo Peng , Kaipeng Zhang , Chen Wei

Existing multimodal retrieval systems excel at semantic matching but implicitly assume that query-image relevance can be measured in isolation. This paradigm overlooks the rich dependencies inherent in realistic visual streams, where…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Chenlong Deng , Mengjie Deng , Junjie Wu , Dun Zeng , Teng Wang , Qingsong Xie , Jiadeng Huang , Shengjie Ma , Changwang Zhang , Zhaoxiang Wang , Jun Wang , Yutao Zhu , Zhicheng Dou

Metasurface inverse design has become central to realizing complex optical functionality, yet translating target responses into executable, solver-compatible workflows still demands specialized expertise in computational electromagnetics…

人工智能 · 计算机科学 2026-04-03 Yi Huang , Bowen Zheng , Yunxi Dong , Hong Tang , Huan Zhao , S. M. Rakibul Hasan Shawon , Hualiang Zhang

Large models are increasingly becoming autonomous agents that interact with real-world environments and use external tools to augment their static capabilities. However, most recent progress has focused on text-only large language models,…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Ruiyang Zhang , Qianguo Sun , Chao Song , Yiyan Qi , Zhedong Zheng

Despite remarkable progress, multimodal foundation models still exhibit surprising deficiencies in spatial intelligence. In this work, we explore scaling up multimodal foundation models to cultivate spatial intelligence within the…

While text-to-image generation has achieved unprecedented fidelity, the vast majority of existing models function fundamentally as static text-to-pixel decoders. Consequently, they often fail to grasp implicit user intentions. Although…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Jun He , Junyan Ye , Zilong Huang , Dongzhi Jiang , Chenjue Zhang , Leqi Zhu , Renrui Zhang , Xiang Zhang , Weijia Li

Recent advancements in Large Language Models (LLMs) have largely focused on depth scaling, where a single agent solves long-horizon problems with multi-turn reasoning and tool use. However, as tasks grow broader, the key bottleneck shifts…

人工智能 · 计算机科学 2026-03-13 Zelai Xu , Zhexuan Xu , Ruize Zhang , Chunyang Zhu , Shi Yu , Weilin Liu , Quanlu Zhang , Wenbo Ding , Chao Yu , Yu Wang

While Large Multimodal Models (LMMs) demonstrate impressive visual perception, they remain epistemically constrained by their static parametric knowledge. To transcend these boundaries, multimodal search models have been adopted to actively…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Yikun Liu , Yuan Liu , Le Tian , Xiao Zhou , Jiangchao Yao , Yanfeng Wang , Weidi Xie

Recent advances in DeepResearch-style agents have demonstrated strong capabilities in autonomous information acquisition and synthesize from real-world web environments. However, existing approaches remain fundamentally limited to text…

人工智能 · 计算机科学 2026-01-15 Xiaohan Yu , Chao Feng , Lang Mei , Chong Chen

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

人工智能 · 计算机科学 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

Traditional workflow-based agents exhibit limited intelligence when addressing real-world problems requiring tool invocation. Tool-integrated reasoning (TIR) agents capable of autonomous reasoning and tool invocation are rapidly emerging as…

Recent advances in agentic AI have led to systems capable of autonomous task execution and language-based reasoning, yet their spatial reasoning abilities remain limited and underexplored, largely constrained to symbolic and sequential…

Recent advances in deep thinking models have demonstrated remarkable reasoning capabilities on mathematical and coding tasks. However, their effectiveness in embodied domains which require continuous interaction with environments through…

The progress of autonomous web navigation has been hindered by the dependence on billions of exploratory interactions via online reinforcement learning, and domain-specific model designs that make it difficult to leverage generalization…

The rapid advances of multimodal agents built on large foundation models have largely overlooked their potential for language-based communication between agents in collaborative tasks. This oversight presents a critical gap in understanding…

人工智能 · 计算机科学 2025-12-17 Timothy Ossowski , Danyal Maqbool , Jixuan Chen , Zefan Cai , Tyler Bradshaw , Junjie Hu

The recent surge in popularity of Nano-Banana and Seedream 4.0 underscores the community's strong interest in multi-image composition tasks. Compared to single-image editing, multi-image composition presents significantly greater challenges…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Hongyang Wei , Hongbo Liu , Zidong Wang , Yi Peng , Baixin Xu , Size Wu , Xuying Zhang , Xianglong He , Zexiang Liu , Peiyu Wang , Xuchen Song , Yangguang Li , Yang Liu , Yahui Zhou

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

机器学习 · 计算机科学 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Multimodal deep search requires an agent to solve open-world problems by chaining search, tool use, and visual reasoning over evolving textual and visual context. Two bottlenecks limit current systems. First, existing tool-use harnesses…

计算与语言 · 计算机科学 2026-05-12 Shijue Huang , Hangyu Guo , Chenxin Li , Junting Lu , Xinyu Geng , Zhaochen Su , Zhenyu Li , Shuang Chen , Hongru Wang , Yi R. Fung