English
Related papers

Related papers: Leveraging VLM-Based Pipelines to Annotate 3D Obje…

200 papers

Humans recognize objects after observing only a few examples, a remarkable capability enabled by their inherent language understanding of the real-world environment. Developing verbalized and interpretable representation can significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Cheng-Fu Yang , Da Yin , Wenbo Hu , Heng Ji , Nanyun Peng , Bolei Zhou , Kai-Wei Chang

Score Distillation Sampling (SDS) enables high-quality text-to-3D generation by supervising 3D models through the denoising of multi-view 2D renderings, using a pretrained text-to-image diffusion model to align with the input prompt and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Weimin Bai , Yubo Li , Weijian Luo , Wenzheng Chen , He Sun

Vision-language models (VLMs) are increasingly used to evaluate multimodal content, including presentation slides, yet their slide-specific understanding remains underexplored {despite their growing role as critics in agentic, model-forward…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hyeonsu Kang , Emily Bao , Anjan Goswami

We present a transparent, reproducible measurement of research trends across 26,104 accepted papers from CVPR, ICLR, and NeurIPS spanning 2023-2025. Titles and abstracts are normalized, phrase-protected, and matched against a hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Fengming Lin

Vision-Language Models (VLMs) offer the ability to generate high-level, interpretable descriptions of complex activities from images and videos, making them valuable for situational awareness (SA) applications. In such settings, the focus…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Pavana Pradeep , Krishna Kant , Suya Yu

Vision-Language Models (VLMs) have gained community-spanning prominence due to their ability to integrate visual and textual inputs to perform complex tasks. Despite their success, the internal decision-making processes of these models…

Computation and Language · Computer Science 2025-05-16 Michal Golovanevsky , William Rudman , Vedant Palit , Ritambhara Singh , Carsten Eickhoff

Vision-Language Pre-Training (VLP) has shown promising capabilities to align image and text pairs, facilitating a broad variety of cross-modal learning tasks. However, we observe that VLP models often lack the visual grounding/localization…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Alex Jinpeng Wang , Pan Zhou , Mike Zheng Shou , Shuicheng Yan

Learning to ground natural language queries to target objects or regions in 3D point clouds is quite essential for 3D scene understanding. Nevertheless, existing 3D visual grounding approaches require a substantial number of bounding box…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiaoxu Xu , Yitian Yuan , Qiudan Zhang , Wenhui Wu , Zequn Jie , Lin Ma , Xu Wang

Accurately describing images with text is a foundation of explainable AI. Vision-Language Models (VLMs) like CLIP have recently addressed this by aligning images and texts in a shared embedding space, expressing semantic similarities…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Pingchuan Ma , Lennart Rietdorf , Dmytro Kotovenko , Vincent Tao Hu , Björn Ommer

Although existing multi-object tracking (MOT) algorithms have obtained competitive performance on various benchmarks, almost all of them train and validate models on the same domain. The domain generalization problem of MOT is hardly…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 En Yu , Songtao Liu , Zhuoling Li , Jinrong Yang , Zeming li , Shoudong Han , Wenbing Tao

Pre-trained Vision-Language Models (VLMs) are becoming increasingly popular across various visual tasks, and several open-sourced VLM variants have been released. However, selecting the best-performing pre-trained VLM for a specific…

Machine Learning · Computer Science 2025-05-08 Hao-Zhe Tan , Zhi Zhou , Yu-Feng Li , Lan-Zhe Guo

While current multimodal models can answer questions based on 2D images, they lack intrinsic 3D object perception, limiting their ability to comprehend spatial relationships and depth cues in 3D scenes. In this work, we propose N3D-VLM, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yuxin Wang , Lei Ke , Boqiang Zhang , Tianyuan Qu , Hanxun Yu , Zhenpeng Huang , Meng Yu , Dan Xu , Dong Yu

Recent advancements in multimodal techniques open exciting possibilities for models excelling in diverse tasks involving text, audio, and image processing. Models like GPT-4V, blending computer vision and language modeling, excel in complex…

Computation and Language · Computer Science 2023-10-20 Xiang Zhang , Senyu Li , Zijun Wu , Ning Shi

Multimodal vision-language (VL) learning has noticeably pushed the tendency toward generic intelligence owing to emerging large foundation models. However, tracking, as a fundamental vision problem, surprisingly enjoys less bonus from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mingzhe Guo , Zhipeng Zhang , Liping Jing , Haibin Ling , Heng Fan

Despite the rapid development of video Large Language Models (LLMs), a comprehensive evaluation is still absent. In this paper, we introduce a unified evaluation that encompasses multiple video tasks, including captioning, question and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Shuailin Li , Yuang Zhang , Yucheng Zhao , Qiuyue Wang , Fan Jia , Yingfei Liu , Tiancai Wang

Visual language tracking (VLT) has emerged as a cutting-edge research area, harnessing linguistic data to enhance algorithms with multi-modal inputs and broadening the scope of traditional single object tracking (SOT) to encompass video…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xuchen Li , Shiyu Hu , Xiaokun Feng , Dailing Zhang , Meiqi Wu , Jing Zhang , Kaiqi Huang

Understanding relationships between objects is central to visual intelligence, with applications in embodied AI, assistive systems, and scene understanding. Yet, most visual relationship detection (VRD) models rely on a fixed predicate set,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shanmukha Vellamcheti , Sanjoy Kundu , Sathyanarayanan N. Aakur

Vision-Language Pretraining (VLP) has demonstrated remarkable capabilities in learning visual representations from textual descriptions of images without annotations. Yet, effective VLP demands large-scale image-text pairs, a resource that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yinda Chen , Che Liu , Wei Huang , Sibo Cheng , Rossella Arcucci , Zhiwei Xiong

Individuals with intellectual disabilities often have difficulties in comprehending complex texts. While many text-to-image models prioritize aesthetics over accessibility, it is not clear how visual illustrations relate to text…

Computation and Language · Computer Science 2025-10-14 Belkiss Souayed , Sarah Ebling , Yingqiang Gao

Inspired by the outstanding zero-shot capability of vision language models (VLMs) in image classification tasks, open-vocabulary object detection has attracted increasing interest by distilling the broad VLM knowledge into detector…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Sheng Jin , Xueying Jiang , Jiaxing Huang , Lewei Lu , Shijian Lu