中文
相关论文

相关论文: Seed1.5-VL Technical Report

200 篇论文

Perception is a fundamental task in the field of computer vision, encompassing a diverse set of subtasks that can be systematically categorized into four distinct groups based on two dimensions: prediction type and instruction type.…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Wentao Xiang , Haoxian Tan , Cong Wei , Yujie Zhong , Dengjie Li , Yujiu Yang

Recent advancements in Vision Language Models (VLMs) have demonstrated remarkable promise in generating visually grounded responses. However, their application in the medical domain is hindered by unique challenges. For instance, most VLMs…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Lingxiao Luo , Bingda Tang , Xuanzhong Chen , Rong Han , Ting Chen

Vision-language generative reward models (VL-GenRMs) play a crucial role in aligning and evaluating multimodal AI systems, yet their own evaluation remains under-explored. Current assessment methods primarily rely on AI-annotated preference…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Lei Li , Yuancheng Wei , Zhihui Xie , Xuqing Yang , Yifan Song , Peiyi Wang , Chenxin An , Tianyu Liu , Sujian Li , Bill Yuchen Lin , Lingpeng Kong , Qi Liu

As large language models (LLMs) continue to improve in reasoning and decision-making, there is a growing need for realistic and interactive environments where their abilities can be rigorously evaluated. We present VirtualEnv, a…

人工智能 · 计算机科学 2026-02-10 Kabir Swain , Sijie Han , Ayush Raina , Jin Zhang , Shuang Li , Michael Stopa , Antonio Torralba

Multimodal large language models (MLLMs) have demonstrated impressive performance in vision-language tasks across a broad spectrum of domains. However, the large model scale and associated high computational costs pose significant…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Zhangwei Gao , Zhe Chen , Erfei Cui , Yiming Ren , Weiyun Wang , Jinguo Zhu , Hao Tian , Shenglong Ye , Junjun He , Xizhou Zhu , Lewei Lu , Tong Lu , Yu Qiao , Jifeng Dai , Wenhai Wang

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

Recent advances in multi-modal large language models (MLLMs) have demonstrated strong performance across various domains; however, their ability to comprehend driving scenes remains less proven. The complexity of driving scenarios, which…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Sung-Yeon Park , Can Cui , Yunsheng Ma , Ahmadreza Moradipari , Rohit Gupta , Kyungtae Han , Ziran Wang

In this report, we propose PaddleOCR-VL, a SOTA and resource-efficient model tailored for document parsing. Its core component is PaddleOCR-VL-0.9B, a compact yet powerful vision-language model (VLM) that integrates a NaViT-style dynamic…

Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically…

Multimodal large language models (MLLMs) have emerged as powerful tools for visual question answering (VQA), enabling reasoning and contextual understanding across visual and textual modalities. Despite their advancements, the evaluation of…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Nikitha SR

We introduce InternVL 2.5, an advanced multimodal large language model (MLLM) series that builds upon InternVL 2.0, maintaining its core model architecture while introducing significant enhancements in training and testing strategies as…

In this work, we introduce Mini-Gemini, a simple and effective framework enhancing multi-modality Vision Language Models (VLMs). Despite the advancements in VLMs facilitating basic visual dialog and reasoning, a performance gap persists…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Yanwei Li , Yuechen Zhang , Chengyao Wang , Zhisheng Zhong , Yixin Chen , Ruihang Chu , Shaoteng Liu , Jiaya Jia

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Significant research efforts have been made to scale and improve vision-language model (VLM) training approaches. Yet, with an ever-growing number of benchmarks, researchers are tasked with the heavy burden of implementing each protocol,…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Haider Al-Tahan , Quentin Garrido , Randall Balestriero , Diane Bouchacourt , Caner Hazirbas , Mark Ibrahim

A fundamental challenge in autonomous driving is the integration of high-level, semantic reasoning for long-tail events with low-level, reactive control for robust driving. While large vision-language models (VLMs) trained on web-scale data…

We present BlueLM-2.5-3B, a compact and unified dense Multimodal Large Language Model (MLLM) designed for efficient edge-device deployment, offering strong general-purpose and reasoning capabilities. To the best of our knowledge, this is…

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

In this paper, we introduce an open-source Korean-English vision-language model (VLM), VARCO-VISION. We incorporate a step-by-step training strategy that allows a model learn both linguistic and visual information while preserving the…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Jeongho Ju , Daeyoung Kim , SunYoung Park , Youngjune Kim

We introduce MUSE-VL, a Unified Vision-Language Model through Semantic discrete Encoding for multimodal understanding and generation. Recently, the research community has begun exploring unified models for visual generation and…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Rongchang Xie , Chen Du , Ping Song , Chang Liu

Vision-language models (VLMs) achieve remarkable success in single-image tasks. However, real-world scenarios often involve intricate multi-image inputs, leading to a notable performance decline as models struggle to disentangle critical…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Juntian Zhang , Chuanqi cheng , Yuhan Liu , Wei Liu , Jian Luan , Rui Yan