English
Related papers

Related papers: MiMo-VL Technical Report

200 papers

Recent works on large language models (LLMs) have successfully demonstrated the emergence of reasoning capabilities via reinforcement learning (RL). Although recent efforts leverage group relative policy optimization (GRPO) for MLLMs…

Computation and Language · Computer Science 2025-06-18 Shilin Xu , Yanwei Li , Rui Yang , Tao Zhang , Yueyi Sun , Wei Chow , Linfeng Li , Hang Song , Qi Xu , Yunhai Tong , Xiangtai Li , Hao Fei

We present STEP3-VL-10B, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence. STEP3-VL-10B is realized through two strategic shifts: first, a…

We present HaoMo Vision-Language Model (HMVLM), an end-to-end driving framework that implements the slow branch of a cognitively inspired fast-slow architecture. A fast controller outputs low-level steering, throttle, and brake commands,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Daming Wang , Yuhao Song , Zijian He , Kangliang Chen , Xing Pan , Lu Deng , Weihao Gu

We introduce NVLM 1.0, a family of frontier-class multimodal large language models (LLMs) that achieve state-of-the-art results on vision-language tasks, rivaling the leading proprietary models (e.g., GPT-4o) and open-access models (e.g.,…

Computation and Language · Computer Science 2024-10-24 Wenliang Dai , Nayeon Lee , Boxin Wang , Zhuolin Yang , Zihan Liu , Jon Barker , Tuomas Rintamaki , Mohammad Shoeybi , Bryan Catanzaro , Wei Ping

We present BlueLM-2.5-3B, a compact and unified dense Multimodal Large Language Model (MLLM) designed for efficient edge-device deployment, offering strong general-purpose and reasoning capabilities. To the best of our knowledge, this is…

We introduce a full-stack framework that scales up reasoning in vision-language models (VLMs) to long videos, leveraging reinforcement learning. We address the unique challenges of long video reasoning by integrating three critical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yukang Chen , Wei Huang , Baifeng Shi , Qinghao Hu , Hanrong Ye , Ligeng Zhu , Zhijian Liu , Pavlo Molchanov , Jan Kautz , Xiaojuan Qi , Sifei Liu , Hongxu Yin , Yao Lu , Song Han

Reward models (RMs) are essential for training large language models (LLMs), but remain underexplored for omni models that handle interleaved image and text sequences. We introduce Multimodal RewardBench 2 (MMRB2), the first comprehensive…

Computation and Language · Computer Science 2026-01-21 Yushi Hu , Reyhane Askari-Hemmat , Melissa Hall , Emily Dinan , Luke Zettlemoyer , Marjan Ghazvininejad

The rapid advancement of native multi-modal models and omni-models, exemplified by GPT-4o, Gemini, and o3, with their capability to process and generate content across modalities such as text and images, marks a significant milestone in the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Meng-Hao Guo , Xuanyu Chu , Qianrui Yang , Zhe-Han Mo , Yiqing Shen , Pei-lin Li , Xinjie Lin , Jinnian Zhang , Xin-Sheng Chen , Yi Zhang , Kiyohiro Nakayama , Zhengyang Geng , Houwen Peng , Han Hu , Shi-Min Hu

State-of-the-art large multi-modal models (LMMs) face challenges when processing high-resolution images, as these inputs are converted into enormous visual tokens, many of which are irrelevant to the downstream task. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xinyu Huang , Yuhao Dong , Weiwei Tian , Bo Li , Rui Feng , Ziwei Liu

Reinforcement learning (RL) provides a principled framework for improving Vision-Language Models (VLMs) on complex reasoning tasks. However, existing RL approaches often rely on human-annotated labels or task-specific heuristics to define…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yicheng He , Chengsong Huang , Zongxia Li , Jiaxin Huang , Yonghui Yang

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

We present Phi-4-reasoning-vision-15B, a compact open-weight multimodal reasoning model, and share the motivations, design choices, experiments, and learnings that informed its development. Our goal is to contribute practical insight to the…

Artificial Intelligence · Computer Science 2026-03-05 Jyoti Aneja , Michael Harrison , Neel Joshi , Tyler LaBonte , John Langford , Eduardo Salinas

We introduce Skywork R1V, a multimodal reasoning model extending the an R1-series Large language models (LLM) to visual modalities via an efficient multimodal transfer method. Leveraging a lightweight visual projector, Skywork R1V…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yi Peng , Peiyu Wang , Xiaokun Wang , Yichen Wei , Jiangbo Pei , Weijie Qiu , Ai Jian , Yunzhuo Hao , Jiachun Pan , Tianyidan Xie , Li Ge , Rongxian Zhuang , Xuchen Song , Yang Liu , Yahui Zhou

We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse,…

Artificial Intelligence · Computer Science 2024-03-12 Haoyu Lu , Wen Liu , Bo Zhang , Bingxuan Wang , Kai Dong , Bo Liu , Jingxiang Sun , Tongzheng Ren , Zhuoshu Li , Hao Yang , Yaofeng Sun , Chengqi Deng , Hanwei Xu , Zhenda Xie , Chong Ruan

As Vision-Language Models (VLMs) grow in sophistication, their ability to perform reasoning is coming under increasing supervision. While they excel at many tasks, their grasp of fundamental scientific principles, such as physics, remains…

Machine Learning · Computer Science 2025-09-11 Pranav Pawar , Kavish Shah , Akshat Bhalani , Komal Kasat , Dev Mittal , Hadi Gala , Deepali Patil , Nikita Raichada , Monali Deshmukh

In recent years, multimodal large models have continued to improve on general benchmarks. However, in real-world content moderation and adversarial settings, mainstream models still suffer from degraded generalization and catastrophic…

Artificial Intelligence · Computer Science 2026-04-01 Zhiqian Zhang , Xu Zhao , Xiaoqing Xu , Guangdong Liang , Weijia Wang , Xiaolei Lv , Bo Li , Jun Gao

In this paper, we present ZonUI-3B, a lightweight Vision-Language Model (VLM) that can be fully trained on a single consumer-grade GPU (RTX 4090) while delivering performance comparable to significantly larger models on GUI grounding tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 ZongHan Hsieh , Tzer-Jen Wei , ShengJing Yang

Multimodal Large Language Models (MLLMs) have increasingly localized and interleaved visual evidence for deliberative reasoning. Grounding-based approaches typically focus on regions of interest (RoIs) by injecting cropped image patches or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Guannan Lv , Ren Nie , Hongjian Dou , Tingting Gao

Multimodal reasoning has become a cornerstone of modern AI research. Standardized exam questions offer a uniquely rigorous testbed for such reasoning, providing structured visual contexts and verifiable answers. While recent progress has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Egemen Sert , Şeyda Ertekin

Significant research efforts have been made to scale and improve vision-language model (VLM) training approaches. Yet, with an ever-growing number of benchmarks, researchers are tasked with the heavy burden of implementing each protocol,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Haider Al-Tahan , Quentin Garrido , Randall Balestriero , Diane Bouchacourt , Caner Hazirbas , Mark Ibrahim