English
Related papers

Related papers: Skywork-R1V4: Toward Agentic Multimodal Intelligen…

200 papers

Recent agentic search frameworks enable deep research via iterative planning and retrieval, reducing hallucinations and enhancing factual grounding. However, they remain text-centric, overlooking the multimodal evidence that characterizes…

Computation and Language · Computer Science 2026-04-21 Fangda Ye , Zhifei Xie , Yuxin Hu , Yihang Yin , Shurui Huang , Shikai Dong , Jianzhu Bao , Shuicheng Yan

Coordinating multiple embodied agents in dynamic environments remains a core challenge in artificial intelligence, requiring both perception-driven reasoning and scalable cooperation strategies. While recent works have leveraged large…

Artificial Intelligence · Computer Science 2026-01-23 Li Kang , Xiufeng Song , Heng Zhou , Yiran Qin , Jie Yang , Xiaohong Liu , Philip Torr , Lei Bai , Zhenfei Yin

Reinforcement learning for agentic multimodal models often suffers from interaction collapse, where models learn to reduce tool usage and multi-turn reasoning, limiting the benefits of agentic behavior. We introduce PyVision-RL, a…

Artificial Intelligence · Computer Science 2026-02-25 Shitian Zhao , Shaoheng Lin , Ming Li , Haoquan Zhang , Wenshuo Peng , Kaipeng Zhang , Chen Wei

Existing multimodal retrieval systems excel at semantic matching but implicitly assume that query-image relevance can be measured in isolation. This paradigm overlooks the rich dependencies inherent in realistic visual streams, where…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Chenlong Deng , Mengjie Deng , Junjie Wu , Dun Zeng , Teng Wang , Qingsong Xie , Jiadeng Huang , Shengjie Ma , Changwang Zhang , Zhaoxiang Wang , Jun Wang , Yutao Zhu , Zhicheng Dou

Metasurface inverse design has become central to realizing complex optical functionality, yet translating target responses into executable, solver-compatible workflows still demands specialized expertise in computational electromagnetics…

Artificial Intelligence · Computer Science 2026-04-03 Yi Huang , Bowen Zheng , Yunxi Dong , Hong Tang , Huan Zhao , S. M. Rakibul Hasan Shawon , Hualiang Zhang

Large models are increasingly becoming autonomous agents that interact with real-world environments and use external tools to augment their static capabilities. However, most recent progress has focused on text-only large language models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruiyang Zhang , Qianguo Sun , Chao Song , Yiyan Qi , Zhedong Zheng

Despite remarkable progress, multimodal foundation models still exhibit surprising deficiencies in spatial intelligence. In this work, we explore scaling up multimodal foundation models to cultivate spatial intelligence within the…

While text-to-image generation has achieved unprecedented fidelity, the vast majority of existing models function fundamentally as static text-to-pixel decoders. Consequently, they often fail to grasp implicit user intentions. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jun He , Junyan Ye , Zilong Huang , Dongzhi Jiang , Chenjue Zhang , Leqi Zhu , Renrui Zhang , Xiang Zhang , Weijia Li

Recent advancements in Large Language Models (LLMs) have largely focused on depth scaling, where a single agent solves long-horizon problems with multi-turn reasoning and tool use. However, as tasks grow broader, the key bottleneck shifts…

Artificial Intelligence · Computer Science 2026-03-13 Zelai Xu , Zhexuan Xu , Ruize Zhang , Chunyang Zhu , Shi Yu , Weilin Liu , Quanlu Zhang , Wenbo Ding , Chao Yu , Yu Wang

While Large Multimodal Models (LMMs) demonstrate impressive visual perception, they remain epistemically constrained by their static parametric knowledge. To transcend these boundaries, multimodal search models have been adopted to actively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yikun Liu , Yuan Liu , Le Tian , Xiao Zhou , Jiangchao Yao , Yanfeng Wang , Weidi Xie

Recent advances in DeepResearch-style agents have demonstrated strong capabilities in autonomous information acquisition and synthesize from real-world web environments. However, existing approaches remain fundamentally limited to text…

Artificial Intelligence · Computer Science 2026-01-15 Xiaohan Yu , Chao Feng , Lang Mei , Chong Chen

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

Artificial Intelligence · Computer Science 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

Traditional workflow-based agents exhibit limited intelligence when addressing real-world problems requiring tool invocation. Tool-integrated reasoning (TIR) agents capable of autonomous reasoning and tool invocation are rapidly emerging as…

Recent advances in agentic AI have led to systems capable of autonomous task execution and language-based reasoning, yet their spatial reasoning abilities remain limited and underexplored, largely constrained to symbolic and sequential…

Artificial Intelligence · Computer Science 2025-09-12 Bui Duc Manh , Soumyaratna Debnath , Zetong Zhang , Shriram Damodaran , Arvind Kumar , Yueyi Zhang , Lu Mi , Erik Cambria , Lin Wang

Recent advances in deep thinking models have demonstrated remarkable reasoning capabilities on mathematical and coding tasks. However, their effectiveness in embodied domains which require continuous interaction with environments through…

Computation and Language · Computer Science 2025-05-15 Wenqi Zhang , Mengna Wang , Gangao Liu , Xu Huixin , Yiwei Jiang , Yongliang Shen , Guiyang Hou , Zhe Zheng , Hang Zhang , Xin Li , Weiming Lu , Peng Li , Yueting Zhuang

The progress of autonomous web navigation has been hindered by the dependence on billions of exploratory interactions via online reinforcement learning, and domain-specific model designs that make it difficult to leverage generalization…

Machine Learning · Computer Science 2024-02-27 Hiroki Furuta , Kuang-Huei Lee , Ofir Nachum , Yutaka Matsuo , Aleksandra Faust , Shixiang Shane Gu , Izzeddin Gur

The rapid advances of multimodal agents built on large foundation models have largely overlooked their potential for language-based communication between agents in collaborative tasks. This oversight presents a critical gap in understanding…

Artificial Intelligence · Computer Science 2025-12-17 Timothy Ossowski , Danyal Maqbool , Jixuan Chen , Zefan Cai , Tyler Bradshaw , Junjie Hu

The recent surge in popularity of Nano-Banana and Seedream 4.0 underscores the community's strong interest in multi-image composition tasks. Compared to single-image editing, multi-image composition presents significantly greater challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Hongyang Wei , Hongbo Liu , Zidong Wang , Yi Peng , Baixin Xu , Size Wu , Xuying Zhang , Xianglong He , Zexiang Liu , Peiyu Wang , Xuchen Song , Yangguang Li , Yang Liu , Yahui Zhou

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Multimodal deep search requires an agent to solve open-world problems by chaining search, tool use, and visual reasoning over evolving textual and visual context. Two bottlenecks limit current systems. First, existing tool-use harnesses…

Computation and Language · Computer Science 2026-05-12 Shijue Huang , Hangyu Guo , Chenxin Li , Junting Lu , Xinyu Geng , Zhaochen Su , Zhenyu Li , Shuang Chen , Hongru Wang , Yi R. Fung