English
Related papers

Related papers: STEP3-VL-10B Technical Report

200 papers

We present Perceiver-VL, a vision-and-language framework that efficiently handles high-dimensional multimodal inputs such as long videos and text. Powered by the iterative latent cross-attention of Perceiver, our framework scales with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zineng Tang , Jaemin Cho , Jie Lei , Mohit Bansal

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

Robotics · Computer Science 2025-06-13 Yicheng Duan , Kaiyu tang

To effectively exploit the potential of large-scale models, various pre-training strategies supported by massive data from different sources are proposed, including supervised pre-training, weakly-supervised pre-training, and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Weijie Su , Xizhou Zhu , Chenxin Tao , Lewei Lu , Bin Li , Gao Huang , Yu Qiao , Xiaogang Wang , Jie Zhou , Jifeng Dai

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in domains such as visual understanding and mathematical reasoning. However, their application in the medical domain is constrained by two key challenges: (1)…

Computation and Language · Computer Science 2025-10-09 Zeyu Liu , Zhitian Hou , Guanghao Zhu , Zhijie Sang , Congkai Xie , Hongxia Yang

End-to-end autonomous driving requires models to understand traffic scenes, infer driving intent, and generate executable motion plans. Recent vision-language-action (VLA) models inherit semantic priors from large-scale vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Rui Zhao , Jianlin Yu , Zhenhai Gao , Jiaqiao Liu , Fei Gao

Building scalable vision-language models to learn from diverse, multimodal data remains an open challenge. In this paper, we introduce an Efficient Vision-languagE foundation model, namely EVE, which is one unified multimodal Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Junyi Chen , Longteng Guo , Jia Sun , Shuai Shao , Zehuan Yuan , Liang Lin , Dongyu Zhang

Current multimodal large language models (MLLMs) often underperform on mathematical problem-solving tasks that require fine-grained visual understanding. The limitation is largely attributable to inadequate perception of geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Shan Zhang , Aotian Chen , Yanpeng Sun , Jindong Gu , Yi-Yu Zheng , Piotr Koniusz , Kai Zou , Anton van den Hengel , Yuan Xue

We introduce RoboBrain 2.0, our latest generation of embodied vision-language foundation models, designed to unify perception, reasoning, and planning for complex embodied tasks in physical environments. It comes in two variants: a…

We introduce VARCO-VISION-2.0, an open-weight bilingual vision-language model (VLM) for Korean and English with improved capabilities compared to the previous model VARCO-VISION-14B. The model supports multi-image understanding for complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Young-rok Cha , Jeongho Ju , SunYoung Park , Jong-Hyeon Lee , Younghyun Yu , Youngjune Kim

We introduce MUSE-VL, a Unified Vision-Language Model through Semantic discrete Encoding for multimodal understanding and generation. Recently, the research community has begun exploring unified models for visual generation and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Rongchang Xie , Chen Du , Ping Song , Chang Liu

Robots operating in shared human environments must not only navigate, interact, and detect their surroundings, they must also interpret and respond to dynamic, and often unpredictable, human behaviours. Although recent advances have shown…

We introduce Phoenix-VL 1.5 Medium, a 123B-parameter natively multimodal and multilingual foundation model, adapted to regional languages and the Singapore context. Developed as a sovereign AI asset, it demonstrates that deep domain…

Computer-aided design (CAD) is vital to modern manufacturing, yet model creation remains labor-intensive and expertise-heavy. To enable non-experts to translate intuitive design intent into manufacturable artifacts, recent large language…

Artificial Intelligence · Computer Science 2026-01-21 Xiangyu Shi , Junyang Ding , Xu Zhao , Sinong Zhan , Payal Mohapatra , Daniel Quispe , Kojo Welbeck , Jian Cao , Wei Chen , Ping Guo , Qi Zhu

The practical deployment of medical vision-language models (Med-VLMs) necessitates seamless integration of textual data with diverse visual modalities, including 2D/3D images and videos, yet existing models typically employ separate…

Computation and Language · Computer Science 2025-04-22 Songtao Jiang , Yuan Wang , Sibo Song , Yan Zhang , Zijie Meng , Bohan Lei , Jian Wu , Jimeng Sun , Zuozhu Liu

We present Nanbeige4.1-3B, a unified generalist language model that simultaneously achieves strong agentic behavior, code generation, and general reasoning with only 3B parameters. To the best of our knowledge, it is the first open-source…

Remote-sensing applications often run on edge hardware that cannot host today's 7B-parameter multimodal language models. This paper introduces TinyRS, the first 2B-parameter multimodal small language model (MSLM) optimized for remote…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Aybora Koksal , A. Aydin Alatan

We propose Skywork-VL Reward, a multimodal reward model that provides reward signals for both multimodal understanding and reasoning tasks. Our technical approach comprises two key components: First, we construct a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xiaokun Wang , Peiyu Wang , Jiangbo Pei , Wei Shen , Yi Peng , Yunzhuo Hao , Weijie Qiu , Ai Jian , Tianyidan Xie , Xuchen Song , Yang Liu , Yahui Zhou

Contemporary vision-language models (VLMs) perform well on existing multimodal reasoning benchmarks (78-85\% accuracy on MMMU, MathVista). Yet, these results fail to sufficiently distinguish true scientific reasoning articulation…

Computation and Language · Computer Science 2025-11-13 Arka Mukherjee , Shreya Ghosh

The recent development of Large Language Models (LLMs) with strong reasoning ability has driven research in various domains such as mathematics, coding, and scientific discovery. Meanwhile, 3D visual grounding, as a fundamental task in 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Hsiang-Wei Huang , Kuang-Ming Chen , Wenhao Chai , Cheng-Yen Yang , Jen-Hao Cheng , Jenq-Neng Hwang
‹ Prev 1 4 5 6 7 8 10 Next ›