English
Related papers

Related papers: Enhancing Concept Localization in CLIP-based Conce…

200 papers

Recent research has shown that contrastive vision-language models such as CLIP often lack fine-grained understanding of visual content. While a growing body of work has sought to address this limitation, we identify a distinct failure mode…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Oscar Chew , Hsiao-Ying Huang , Kunal Jain , Tai-I Chen , Khoa D Doan , Kuan-Hao Huang

We propose CLIP-Fields, an implicit scene model that can be used for a variety of tasks, such as segmentation, instance identification, semantic search over space, and view localization. CLIP-Fields learns a mapping from spatial locations…

Robotics · Computer Science 2024-11-20 Nur Muhammad Mahi Shafiullah , Chris Paxton , Lerrel Pinto , Soumith Chintala , Arthur Szlam

Large vision-language contrastive models (VLCMs), such as CLIP, have become foundational, demonstrating remarkable success across a variety of downstream tasks. Despite their advantages, these models, akin to other foundational systems,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Haocheng Dai , Sarang Joshi

Concept Bottleneck Models (CBMs) map the inputs onto a set of interpretable concepts (``the bottleneck'') and use the concepts to make predictions. A concept bottleneck enhances interpretability since it can be investigated to understand…

Machine Learning · Computer Science 2023-02-03 Mert Yuksekgonul , Maggie Wang , James Zou

Concept Bottleneck Models (CBMs) aim to improve interpretability in Deep Learning by structuring predictions through human-understandable concepts, but they provide no way to verify whether learned concepts align with the human's intended…

Machine Learning · Computer Science 2026-05-22 Stefano Colamonaco , David Debot , Pietro Barbiero , Giuseppe Marra

Concept bottleneck models (CBMs) are interpretable models that first predict a set of semantically meaningful features, i.e., concepts, from observations that are subsequently used to condition a downstream task. However, the model's…

Machine Learning · Computer Science 2023-12-04 Renos Zabounidis , Ini Oguntola , Konghao Zhao , Joseph Campbell , Simon Stepputtis , Katia Sycara

Concept Bottleneck Models (CBMs) map the black-box visual representations extracted by deep neural networks onto a set of interpretable concepts and use the concepts to make predictions, enhancing the transparency of the decision-making…

Machine Learning · Computer Science 2024-04-18 Chenming Shang , Shiji Zhou , Hengyuan Zhang , Xinzhe Ni , Yujiu Yang , Yuwang Wang

Contrastive vision-language models, such as CLIP, have demonstrated excellent zero-shot capability across semantic recognition tasks, mainly attributed to the training on a large-scale I&1T (one Image with one Text) dataset. This kind of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhichao Yang , Leida Li , Pengfei Chen , Jinjian Wu , Giuseppe Valenzise

Large vision-language models (VLMs), such as CLIP, learn rich joint image-text representations, facilitating advances in numerous downstream tasks, including zero-shot classification and text-to-image generation. Nevertheless, existing VLMs…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Roni Paiss , Ariel Ephrat , Omer Tov , Shiran Zada , Inbar Mosseri , Michal Irani , Tali Dekel

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

We introduce the Concept Bottleneck Large Language Model (CB-LLM), a pioneering approach to creating inherently interpretable Large Language Models (LLMs). Unlike traditional black-box LLMs that rely on post-hoc interpretation methods with…

Computation and Language · Computer Science 2024-07-08 Chung-En Sun , Tuomas Oikarinen , Tsui-Wei Weng

Concept Bottleneck Models (CBMs) aim to deliver interpretable and interventionable predictions by bridging features and labels with human-understandable concepts. While recent CBMs show promising potential, they suffer from information…

Machine Learning · Computer Science 2024-02-12 Ao Sun , Yuanyuan Yuan , Pingchuan Ma , Shuai Wang

Hallucinations in vision-language models (VLMs) hinder reliability and real-world applicability, usually stemming from distribution shifts between pretraining data and test samples. Existing solutions, such as retraining or fine-tuning on…

Multimedia · Computer Science 2025-06-10 Fei Zhao , Chengcui Zhang , Runlin Zhang , Tianyang Wang , Xi Li

Existing machine learning models demonstrate excellent performance in image object recognition after training on a large-scale dataset under full supervision. However, these models only learn to map an image to a predefined class index,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Kai Han , Xiaohu Huang , Yandong Li , Sagar Vaze , Jie Li , Xuhui Jia

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Recently, Contrastive Language-Image Pre-training (CLIP) has shown great potential in providing interaction prior for HOI…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Shan Ning , Longtian Qiu , Yongfei Liu , Xuming He

We introduce a method that takes advantage of high-quality pretrained multimodal representations to explore fine-grained semantic networks in the human brain. Previous studies have documented evidence of functional localization in the…

Artificial Intelligence · Computer Science 2023-06-07 Cory Efird , Alex Murphy , Joel Zylberberg , Alona Fyshe

Contrastive Language-Image Pre-training (CLIP) has made a remarkable breakthrough in open-vocabulary zero-shot image recognition. Many recent studies leverage the pre-trained CLIP models for image-level classification and manipulation. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Chong Zhou , Chen Change Loy , Bo Dai

Although large vision-language models (LVLMs) have demonstrated remarkable capabilities, they are prone to hallucinations in multi-image tasks. We attribute this issue to limitations in existing attention mechanisms and insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xiaochen Yang , Hao Fang , Jiawei Kong , Yaoxin Mao , Bin Chen , Shu-Tao Xia

Object hallucination critically undermines the reliability of Multimodal Large Language Models, often stemming from a fundamental failure in cognitive introspection, where models blindly trust linguistic priors over specific visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shuliang Liu , Songbo Yang , Dong Fang , Sihang Jia , Yuqi Tang , Lingfeng Su , Ruoshui Peng , Yibo Yan , Xin Zou , Xuming Hu

Vision-Language Models (VLMs), such as CLIP, have significantly advanced zero-shot image recognition. However, their performance remains limited by suboptimal prompt engineering and poor adaptability to target classes. While recent methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hui Liu , Kecheng Chen , Jialiang Wang , Xianming Liu , Wenya Wang , Haoliang Li