中文
相关论文

相关论文: VARCO-VISION: Expanding Frontiers in Korean Vision…

200 篇论文

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Iryna Hartsock , Ghulam Rasool

Vision-Language Model (VLM) have gained widespread adoption in Open-Vocabulary (OV) object detection and segmentation tasks. Despite they have shown promise on OV-related tasks, their effectiveness in conventional vision tasks has thus far…

Open-Vocabulary Object Detection (OVOD) aims to develop the capability to detect anything. Although myriads of large-scale pre-training efforts have built versatile foundation models that exhibit impressive zero-shot capabilities to…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Guiying Zhu , Bowen Yang , Yin Zhuang , Tong Zhang , Guanqun Wang , Zhihao Che , He Chen , Lianlin Li

Recent progress in vision language foundation models has shown their ability to understand multimodal data and resolve complicated vision language tasks, including robotics manipulation. We seek a straightforward way of making use of…

机器人学 · 计算机科学 2024-02-06 Xinghang Li , Minghuan Liu , Hanbo Zhang , Cunjun Yu , Jie Xu , Hongtao Wu , Chilam Cheang , Ya Jing , Weinan Zhang , Huaping Liu , Hang Li , Tao Kong

We introduce CogVLM, a powerful open-source visual language foundation model. Different from the popular shallow alignment method which maps image features into the input space of language model, CogVLM bridges the gap between the frozen…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Weihan Wang , Qingsong Lv , Wenmeng Yu , Wenyi Hong , Ji Qi , Yan Wang , Junhui Ji , Zhuoyi Yang , Lei Zhao , Xixuan Song , Jiazheng Xu , Bin Xu , Juanzi Li , Yuxiao Dong , Ming Ding , Jie Tang

Despite significant advances in vision-language models (VLMs), most existing work follows an English-centric design process, limiting their effectiveness in multilingual settings. In this work, we provide a comprehensive empirical study…

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

计算与语言 · 计算机科学 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer

Large language models (LLMs) have notably accelerated progress towards artificial general intelligence (AGI), with their impressive zero-shot capacity for user-tailored tasks, endowing them with immense potential across a range of…

计算机视觉与模式识别 · 计算机科学 2023-05-26 Wenhai Wang , Zhe Chen , Xiaokang Chen , Jiannan Wu , Xizhou Zhu , Gang Zeng , Ping Luo , Tong Lu , Jie Zhou , Yu Qiao , Jifeng Dai

Human language is grounded on multimodal knowledge including visual knowledge like colors, sizes, and shapes. However, current large-scale pre-trained language models rely on text-only self-supervised training with massive text data, which…

计算与语言 · 计算机科学 2023-02-28 Weizhi Wang , Li Dong , Hao Cheng , Haoyu Song , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Face verification systems have seen substantial advancements; however, they often lack transparency in their decision-making processes. In this paper, we introduce an innovative Vision-Language Model (VLM) for Face Verification, which not…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Syed Abdul Hannan , Hazim Bukhari , Thomas Cantalapiedra , Eman Ansar , Massa Baali , Rita Singh , Bhiksha Raj

We present jina-vlm, a token-efficient 2.4B parameter vision-language model that achieves state-of-the-art multilingual VQA performance among open 2B-scale VLMs. The model couples a SigLIP2 vision encoder with a Qwen3 language decoder and…

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

机器学习 · 计算机科学 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Visual-language models (VLM) have emerged as a powerful tool for learning a unified embedding space for vision and language. Inspired by large language models, which have demonstrated strong reasoning and multi-task capabilities, visual…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Yifan Li , Zhixin Lai , Wentao Bao , Zhen Tan , Anh Dao , Kewei Sui , Jiayi Shen , Dong Liu , Huan Liu , Yu Kong

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

We present Kimi-VL, an efficient open-source Mixture-of-Experts (MoE) vision-language model (VLM) that offers advanced multimodal reasoning, long-context understanding, and strong agent capabilities - all while activating only 2.8B…

The rapid evolution of Vision Language Models (VLMs) has catalyzed significant advancements in artificial intelligence, expanding research across various disciplines, including Earth Observation (EO). While VLMs have enhanced image…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Xizhe Xue , Guoting Wei , Hao Chen , Haokui Zhang , Feng Lin , Chunhua Shen , Xiao Xiang Zhu

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

Large Language Models (LLMs), with remarkable conversational capability, have emerged as AI assistants that can handle both visual and textual modalities. However, their effectiveness in joint video and language understanding has not been…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Ruipu Luo , Ziwang Zhao , Min Yang , Zheming Yang , Minghui Qiu , Tao Wang , Zhongyu Wei , Yanhao Wang , Cen Chen

Existing vision-language models (VLMs) mostly rely on vision encoders to extract visual features followed by large language models (LLMs) for visual-language tasks. However, the vision encoders set a strong inductive bias in abstracting…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Haiwen Diao , Yufeng Cui , Xiaotong Li , Yueze Wang , Huchuan Lu , Xinlong Wang