English
Related papers

Related papers: GraSP-VL: Length as a Semantic Granularity Interfa…

200 papers

Large Language Model-based Vision-Language Models (LLM-based VLMs) have demonstrated impressive results in various vision-language understanding tasks. However, how well these VLMs can see image detail beyond the semantic level remains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Chenhui Gou , Abdulwahab Felemban , Faizan Farooq Khan , Deyao Zhu , Jianfei Cai , Hamid Rezatofighi , Mohamed Elhoseiny

Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between. One cause of this failure arises before language reasoning begins: the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Renjie Gu , Kaichen Zhou , Yan Luo , Mengyu Wang

Vision-language models (VLMs) often fail under low illumination because their visual grounding is learned predominantly from RGB imagery, whereas thermal infrared preserves complementary scene structure when visible cues degrade. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Rusiru Thushara , Yasiru Ranasinghe , Jay Paranjape , Vishal M. Patel

Robotic grasping faces new challenges in human-robot-interaction scenarios. We consider the task that the robot grasps a target object designated by human's language directives. The robot not only needs to locate a target based on…

Robotics · Computer Science 2023-08-02 Yuhao Lu , Yixuan Fan , Beixing Deng , Fangfu Liu , Yali Li , Shengjin Wang

Vision Language Models (VLMs) offer the exciting possibility of processing text as rendered images, bypassing the need for tokenizing the text into long token sequences. Since VLM image encoders map fixed-size images to a fixed number of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Roy Xie , Dan Friedman , Donghan Yu , Bowen Pan , Christopher Fifty , Jang-Hyun Kim , Xianzhi Du , Zhe Gan , Vivek Rathod , Bhuwan Dhingra

Accurately describing images with text is a foundation of explainable AI. Vision-Language Models (VLMs) like CLIP have recently addressed this by aligning images and texts in a shared embedding space, expressing semantic similarities…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Pingchuan Ma , Lennart Rietdorf , Dmytro Kotovenko , Vincent Tao Hu , Björn Ommer

Open-vocabulary segmentation poses significant challenges, as it requires segmenting and recognizing objects across an open set of categories in unconstrained environments. Building on the success of powerful vision-language (ViL)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Xi Chen , Haosen Yang , Sheng Jin , Xiatian Zhu , Hongxun Yao

Video-language embeddings are a promising avenue for injecting semantics into visual representations, but existing methods capture only short-term associations between seconds-long video clips and their accompanying text. We propose HierVL,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Kumar Ashutosh , Rohit Girdhar , Lorenzo Torresani , Kristen Grauman

Building semantic 3D maps is valuable for searching for objects of interest in offices, warehouses, stores, and homes. We present a mapping system that incrementally builds a Language-Embedded Gaussian Splat (LEGS): a detailed 3D scene…

Vision-language models (VLMs) have shown powerful capabilities in visual question answering and reasoning tasks by combining visual representations with the abstract skill set large language models (LLMs) learn during pretraining. Vision,…

Artificial Intelligence · Computer Science 2023-09-01 Riley Tavassoli , Mani Amani , Reza Akhavian

The visual classification performance of vision-language models such as CLIP has been shown to benefit from additional semantic knowledge from large language models (LLMs) such as GPT-3. In particular, averaging over LLM-generated class…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Karsten Roth , Jae Myung Kim , A. Sophia Koepke , Oriol Vinyals , Cordelia Schmid , Zeynep Akata

Recently, visual-language learning (VLL) has shown great potential in enhancing visual-based person re-identification (ReID). Existing VLL-based ReID methods typically focus on image-text feature alignment at the whole-body level, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yin Lin , Yehansen Chen , Baocai Yin , Jinshui Hu , Bing Yin , Cong Liu , Zengfu Wang

Radar sensors provide reliable perception across adverse weather, lighting, and long-range conditions, yet existing machine learning approaches remain fragmented and task-specific, with each downstream task employing distinct architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Pushkal Mishra , Kshitiz Bansal , Dinesh Bharadia

Neural machine translation has achieved remarkable empirical performance over standard benchmark datasets, yet recent evidence suggests that the models can still fail easily dealing with substandard inputs such as misspelled words, To…

Computation and Language · Computer Science 2020-10-21 Haohan Wang , Peiyan Zhang , Eric P. Xing

We present a transparent, reproducible measurement of research trends across 26,104 accepted papers from CVPR, ICLR, and NeurIPS spanning 2023-2025. Titles and abstracts are normalized, phrase-protected, and matched against a hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Fengming Lin

The emergence of Vision Language Models (VLMs) has brought unprecedented advances in understanding multimodal information. The combination of textual and visual semantics in VLMs is highly complex and diverse, making the safety alignment of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yongting Zhang , Lu Chen , Guodong Zheng , Yifeng Gao , Rui Zheng , Jinlan Fu , Zhenfei Yin , Senjie Jin , Yu Qiao , Xuanjing Huang , Feng Zhao , Tao Gui , Jing Shao

Pre-trained vision-language models (VLMs) learn to align vision and language representations on large-scale datasets, where each image-text pair usually contains a bag of semantic concepts. However, existing open-vocabulary object detectors…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Size Wu , Wenwei Zhang , Sheng Jin , Wentao Liu , Chen Change Loy

Ambiguity poses persistent challenges in natural language understanding for large language models (LLMs). To better understand how lexical ambiguity can be resolved through the visual domain, we develop an interpretable Visual Word Sense…

Computation and Language · Computer Science 2026-02-09 Shamik Bhattacharya , Daniel Perkins , Yaren Dogan , Vineeth Konjeti , Sudarshan Srinivasan , Edmon Begoli

The deployment of vision-language models (VLMs) in dermatology is hindered by the trilemma of high computational costs, extreme data scarcity, and the black-box nature of deep learning. To address these challenges, we present SkinCLIP-VL, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhixiang Lu , Shijie Xu , Kaicheng Yan , Xuyue Cai , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Jionglong Su

This paper presents a systematic evaluation of state-of-the-art multimodal large language models (MLLMs) on intuitive physics tasks using the GRASP and IntPhys 2 datasets. We assess the open-source models InternVL 2.5, Qwen 2.5 VL,…

Computation and Language · Computer Science 2025-07-23 Mohamad Ballout , Serwan Jassim , Elia Bruni