中文
相关论文

相关论文: OpenSearch-VL: An Open Recipe for Frontier Multimo…

200 篇论文

Deep search capabilities have become an indispensable competency for frontier Large Language Model (LLM) agents, yet their development remains dominated by industrial giants. The typical industry recipe involves a highly resource-intensive…

人工智能 · 计算机科学 2026-05-06 Yuwen Du , Rui Ye , Shuo Tang , Keduan Huang , Xinyu Zhu , Yuzhu Cai , Siheng Chen

Recent advancements in large reasoning models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual reasoning, the lack of transparent and reproducible data curation…

人工智能 · 计算机科学 2025-12-08 Kaichen Zhang , Keming Wu , Zuhao Yang , Bo Li , Kairui Hu , Bin Wang , Ziwei Liu , Xingxuan Li , Lidong Bing

Large models are increasingly becoming autonomous agents that interact with real-world environments and use external tools to augment their static capabilities. However, most recent progress has focused on text-only large language models,…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Ruiyang Zhang , Qianguo Sun , Chao Song , Yiyan Qi , Zhedong Zheng

Multimodal large language models (MLLMs) have achieved remarkable success across a broad range of vision tasks. However, constrained by the capacity of their internal world knowledge, prior work has proposed augmenting MLLMs by…

Deep search capabilities have become an indispensable competency for frontier Large Language Model (LLM) agents, yet the development of high-performance search agents remains dominated by industrial giants due to a lack of transparent,…

人工智能 · 计算机科学 2026-03-17 Yuwen Du , Rui Ye , Shuo Tang , Xinyu Zhu , Yijun Lu , Yuzhu Cai , Siheng Chen

We present Innovator-VL, a scientific multimodal large language model designed to advance understanding and reasoning across diverse scientific domains while maintaining excellent performance on general vision tasks. Contrary to the trend…

Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in…

Augmenting large language models (LLMs) with browsing tools substantially improves their potential as deep search agents to solve complex, real-world tasks. Yet, open LLMs still perform poorly in such settings due to limited long-horizon…

计算与语言 · 计算机科学 2025-10-15 Rui Lu , Zhenyu Hou , Zihan Wang , Hanchen Zhang , Xiao Liu , Yujiang Li , Shi Feng , Jie Tang , Yuxiao Dong

Multimodal deep search agents have shown great potential in solving complex tasks by iteratively collecting textual and visual evidence. However, managing the heterogeneous information and high token costs associated with multimodal inputs…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Yifan Du , Zikang Liu , Jinbiao Peng , Jie Wu , Junyi Li , Jinyang Li , Wayne Xin Zhao , Ji-Rong Wen

We aim to develop a multimodal research agent capable of explicit reasoning and planning, multi-tool invocation, and cross-modal information synthesis, enabling it to conduct deep research tasks. However, we observe three main challenges in…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Huanjin Yao , Qixiang Yin , Min Yang , Ziwang Zhao , Yibo Wang , Haotian Luo , Jingyi Zhang , Jiaxing Huang

Multimodal Large Language Models (MLLMs) in real-world applications require access to external knowledge sources and must remain responsive to the dynamic and ever-changing real-world information in order to address information-seeking and…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Kartik Narayan , Yang Xu , Tian Cao , Kavya Nerella , Vishal M. Patel , Navid Shiee , Peter Grasch , Chao Jia , Yinfei Yang , Zhe Gan

Multimodal large language models (MLLMs) have demonstrated strong capabilities in visual understanding, yet they remain limited in complex, multi-step reasoning that requires deep searching and integrating visual evidence with external…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Xiangyu Peng , Can Qin , An Yan , Xinyi Yang , Zeyuan Chen , Ran Xu , Chien-Sheng Wu

Group Relative Policy Optimization (GRPO) has emerged as the de facto Reinforcement Learning (RL) objective driving recent advancements in Multimodal Large Language Models. However, extending this success to open-source multimodal…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Wenbo Hu , Xin Chen , Yan Gao-Tian , Yihe Deng , Nanyun Peng , Kai-Wei Chang

Multimodal Large Language Models (MLLMs) have advanced VQA and now support Vision-DeepResearch systems that use search engines for complex visual-textual fact-finding. However, evaluating these visual and textual search abilities is still…

The performance gap between closed-source and open-source large language models (LLMs) is largely attributed to disparities in access to high-quality training data. To bridge this gap, we introduce a novel framework for the automated…

We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse,…

Large language models (LLMs) can face factual limitations when responding to time-sensitive queries about recent events that arise after their knowledge thresholds in the training corpus. Existing search-augmented approaches fall into two…

信息检索 · 计算机科学 2025-06-11 Wentao Shi , Yiqing Shen

Although RLVR has become an essential component for developing advanced reasoning skills in language models, contemporary studies have documented training plateaus after thousands of optimization steps, i.e., notable decreases in…

人工智能 · 计算机科学 2026-04-08 Fang Wu , Weihao Xuan , Heli Qi , Ximing Lu , Aaron Tu , Li Erran Li , Yejin Choi

Retrieval-Augmented Language Models (RALMs) represent a classic paradigm where models enhance generative capabilities using external knowledge retrieved via a specialized module. Recent advancements in Agent techniques enable Large Language…

计算与语言 · 计算机科学 2025-05-28 Weiqi Wu , Xin Guan , Shen Huang , Yong Jiang , Pengjun Xie , Fei Huang , Jiuxin Cao , Hai Zhao , Jingren Zhou

The reproduction of state-of-the-art multimodal LLM pre-training faces barriers at every stage of the pipeline, including high-quality data filtering, multimodal data mixture strategies, sequence packing techniques, and training frameworks.…

计算与语言 · 计算机科学 2025-04-03 Weizhi Wang , Yu Tian , Linjie Yang , Heng Wang , Xifeng Yan
‹ 上一页 1 2 3 10 下一页 ›