中文
相关论文

相关论文: STEP3-VL-10B Technical Report

200 篇论文

We present Perceiver-VL, a vision-and-language framework that efficiently handles high-dimensional multimodal inputs such as long videos and text. Powered by the iterative latent cross-attention of Perceiver, our framework scales with…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Zineng Tang , Jaemin Cho , Jie Lei , Mohit Bansal

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

机器人学 · 计算机科学 2025-06-13 Yicheng Duan , Kaiyu tang

To effectively exploit the potential of large-scale models, various pre-training strategies supported by massive data from different sources are proposed, including supervised pre-training, weakly-supervised pre-training, and…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Weijie Su , Xizhou Zhu , Chenxin Tao , Lewei Lu , Bin Li , Gao Huang , Yu Qiao , Xiaogang Wang , Jie Zhou , Jifeng Dai

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in domains such as visual understanding and mathematical reasoning. However, their application in the medical domain is constrained by two key challenges: (1)…

计算与语言 · 计算机科学 2025-10-09 Zeyu Liu , Zhitian Hou , Guanghao Zhu , Zhijie Sang , Congkai Xie , Hongxia Yang

End-to-end autonomous driving requires models to understand traffic scenes, infer driving intent, and generate executable motion plans. Recent vision-language-action (VLA) models inherit semantic priors from large-scale vision-language…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Rui Zhao , Jianlin Yu , Zhenhai Gao , Jiaqiao Liu , Fei Gao

Building scalable vision-language models to learn from diverse, multimodal data remains an open challenge. In this paper, we introduce an Efficient Vision-languagE foundation model, namely EVE, which is one unified multimodal Transformer…

计算机视觉与模式识别 · 计算机科学 2024-03-04 Junyi Chen , Longteng Guo , Jia Sun , Shuai Shao , Zehuan Yuan , Liang Lin , Dongyu Zhang

Current multimodal large language models (MLLMs) often underperform on mathematical problem-solving tasks that require fine-grained visual understanding. The limitation is largely attributable to inadequate perception of geometric…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Shan Zhang , Aotian Chen , Yanpeng Sun , Jindong Gu , Yi-Yu Zheng , Piotr Koniusz , Kai Zou , Anton van den Hengel , Yuan Xue

We introduce RoboBrain 2.0, our latest generation of embodied vision-language foundation models, designed to unify perception, reasoning, and planning for complex embodied tasks in physical environments. It comes in two variants: a…

We introduce VARCO-VISION-2.0, an open-weight bilingual vision-language model (VLM) for Korean and English with improved capabilities compared to the previous model VARCO-VISION-14B. The model supports multi-image understanding for complex…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Young-rok Cha , Jeongho Ju , SunYoung Park , Jong-Hyeon Lee , Younghyun Yu , Youngjune Kim

We introduce MUSE-VL, a Unified Vision-Language Model through Semantic discrete Encoding for multimodal understanding and generation. Recently, the research community has begun exploring unified models for visual generation and…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Rongchang Xie , Chen Du , Ping Song , Chang Liu

Robots operating in shared human environments must not only navigate, interact, and detect their surroundings, they must also interpret and respond to dynamic, and often unpredictable, human behaviours. Although recent advances have shown…

We introduce Phoenix-VL 1.5 Medium, a 123B-parameter natively multimodal and multilingual foundation model, adapted to regional languages and the Singapore context. Developed as a sovereign AI asset, it demonstrates that deep domain…

Computer-aided design (CAD) is vital to modern manufacturing, yet model creation remains labor-intensive and expertise-heavy. To enable non-experts to translate intuitive design intent into manufacturable artifacts, recent large language…

人工智能 · 计算机科学 2026-01-21 Xiangyu Shi , Junyang Ding , Xu Zhao , Sinong Zhan , Payal Mohapatra , Daniel Quispe , Kojo Welbeck , Jian Cao , Wei Chen , Ping Guo , Qi Zhu

The practical deployment of medical vision-language models (Med-VLMs) necessitates seamless integration of textual data with diverse visual modalities, including 2D/3D images and videos, yet existing models typically employ separate…

计算与语言 · 计算机科学 2025-04-22 Songtao Jiang , Yuan Wang , Sibo Song , Yan Zhang , Zijie Meng , Bohan Lei , Jian Wu , Jimeng Sun , Zuozhu Liu

We present Nanbeige4.1-3B, a unified generalist language model that simultaneously achieves strong agentic behavior, code generation, and general reasoning with only 3B parameters. To the best of our knowledge, it is the first open-source…

Remote-sensing applications often run on edge hardware that cannot host today's 7B-parameter multimodal language models. This paper introduces TinyRS, the first 2B-parameter multimodal small language model (MSLM) optimized for remote…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Aybora Koksal , A. Aydin Alatan

We propose Skywork-VL Reward, a multimodal reward model that provides reward signals for both multimodal understanding and reasoning tasks. Our technical approach comprises two key components: First, we construct a large-scale multimodal…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Xiaokun Wang , Peiyu Wang , Jiangbo Pei , Wei Shen , Yi Peng , Yunzhuo Hao , Weijie Qiu , Ai Jian , Tianyidan Xie , Xuchen Song , Yang Liu , Yahui Zhou

Contemporary vision-language models (VLMs) perform well on existing multimodal reasoning benchmarks (78-85\% accuracy on MMMU, MathVista). Yet, these results fail to sufficiently distinguish true scientific reasoning articulation…

计算与语言 · 计算机科学 2025-11-13 Arka Mukherjee , Shreya Ghosh

The recent development of Large Language Models (LLMs) with strong reasoning ability has driven research in various domains such as mathematics, coding, and scientific discovery. Meanwhile, 3D visual grounding, as a fundamental task in 3D…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Hsiang-Wei Huang , Kuang-Ming Chen , Wenhao Chai , Cheng-Yen Yang , Jen-Hao Cheng , Jenq-Neng Hwang