English
Related papers

Related papers: Effect of Superpixel Aggregation on Explanations i…

200 papers

We present RECLIP (Resource-efficient CLIP), a simple method that minimizes computational resource footprint for CLIP (Contrastive Language Image Pretraining). Inspired by the notion of coarse-to-fine in computer vision, we leverage small…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Runze Li , Dahun Kim , Bir Bhanu , Weicheng Kuo

Image-text contrastive learning models such as CLIP have demonstrated strong task transfer ability. The high generality and usability of these visual models is achieved via a web-scale data collection process to ensure broad concept…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Haotian Liu , Kilho Son , Jianwei Yang , Ce Liu , Jianfeng Gao , Yong Jae Lee , Chunyuan Li

Recently, Logic Explained Networks (LENs) have been proposed as explainable-by-design neural models providing logic explanations for their predictions. However, these models have only been applied to vision and tabular data, and they mostly…

Computation and Language · Computer Science 2023-09-28 Rishabh Jain , Gabriele Ciravegna , Pietro Barbiero , Francesco Giannini , Davide Buffelli , Pietro Lio

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Fawaz Sammani , Nikos Deligiannis

Understanding why a model makes certain predictions is crucial when adapting it for real world decision making. LIME is a popular model-agnostic feature attribution method for the tasks of classification and regression. However, the task of…

Information Retrieval · Computer Science 2022-12-27 Tanya Chowdhury , Razieh Rahimi , James Allan

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Naresh Kumar Lahajal , Harini S

Local explanation methods such as LIME have become popular in MIR as tools for generating post-hoc, model-agnostic explanations of a model's classification decisions. The basic idea is to identify a small set of human-understandable…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Verena Praher , Katharina Prinz , Arthur Flexer , Gerhard Widmer

Event camera has recently received much attention for low-light image enhancement (LIE) thanks to their distinct advantages, such as high dynamic range. However, current research is prohibitively restricted by the lack of large-scale,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Guoqiang Liang , Kanghao Chen , Hangyu Li , Yunfan Lu , Lin Wang

Self-supervised vision-language models trained with contrastive objectives form the basis of current state-of-the-art methods in AI vision tasks. The success of these models is a direct consequence of the huge web-scale datasets used to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Victor Akinwande , Mohammad Sadegh Norouzzadeh , Devin Willmott , Anna Bair , Madan Ravi Ganesh , J. Zico Kolter

Estimating redshift is a central task in astrophysics, but its measurement is costly and time-consuming. In addition, current image-based methods are often validated on homogeneous datasets. The development and comparison of networks able…

Instrumentation and Methods for Astrophysics · Physics 2026-03-17 Alessandro Meroni , Nicolò Oreste Pinciroli Vago , Piero Fraternali

There is a growing concern that the recent progress made in AI, especially regarding the predictive competence of deep learning models, will be undermined by a failure to properly explain their operation and outputs. In response to this…

Machine Learning · Computer Science 2020-09-15 Eoin M. Kenny , Mark T. Keane

Given the pressing need for assuring algorithmic transparency, Explainable AI (XAI) has emerged as one of the key areas of AI research. In this paper, we develop a novel Bayesian extension to the LIME framework, one of the most widely used…

Artificial Intelligence · Computer Science 2021-06-01 Xingyu Zhao , Wei Huang , Xiaowei Huang , Valentin Robu , David Flynn

We introduce Discovering Conceptual Network Explanations (DCNE), a new approach for generating human-comprehensible visual explanations to enhance the interpretability of deep neural image classifiers. Our method automatically finds visual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Neehar Kondapaneni , Markus Marks , Oisin Mac Aodha , Pietro Perona

In image classification, a significant problem arises from bias in the datasets. When it contains only specific types of images, the classifier begins to rely on shortcuts - simplistic and erroneous rules for decision-making. This leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Minsuk Chang , Seokhyeon Park , Hyeon Jeon , Aeri Cho , Soohyun Lee , Jinwook Seo

Vision-language co-embedding networks, such as CLIP, provide a latent embedding space with semantic information that is useful for downstream tasks. We hypothesize that the embedding space can be disentangled to separate the information on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhi Li , Hau Phan , Matthew Emigh , Austin J. Brockmeier

We examine how the saccade mechanism from biological vision can be used to make deep neural networks more efficient for classification and object detection problems. Our proposed approach is based on the ideas of attention-driven visual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Saurabh Farkya , Zachary Daniels , Aswin Nadamuni Raghavan , David Zhang , Michael Piacentino

Constructing accurate knowledge graphs from long texts and low-resource languages is challenging, as large language models (LLMs) experience degraded performance with longer input chunks. This problem is amplified in low-resource settings…

Computation and Language · Computer Science 2025-03-25 Divyansh Singh , Manuel Nunez Martinez , Bonnie J. Dorr , Sonja Schmer Galunder

Superpixel is generated by automatically clustering pixels in an image into hundreds of compact partitions, which is widely used to perceive the object contours for its excellent contour adherence. Although some works use the Convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Lei Zhu , Qi She , Bin Zhang , Yanye Lu , Zhilin Lu , Duo Li , Jie Hu

We present a fast and accurate method for dense depth reconstruction from sparsely sampled light fields obtained using a synchronized camera array. In our method, the source images are over-segmented into non-overlapping compact superpixels…

Image and Video Processing · Electrical Eng. & Systems 2018-12-18 Aleksandra Chuchvara , Attila Barsi , Atanas Gotchev

Superpixels have become very popular in many computer vision applications. Nevertheless, they remain underexploited since the superpixel decomposition may produce irregular and non stable segmentation results due to the dependency to the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Rémi Giraud , Vinh-Thong Ta , Aurélie Bugeau , Pierrick Coupé , Nicolas Papadakis