English
Related papers

Related papers: Extending Information Bottleneck Attribution to Vi…

200 papers

Adapting large-scale Vision-Language Models (VLMs) like CLIP to downstream tasks often suffers from a "one-size-fits-all" architectural approach, where visual and textual tokens are processed uniformly by wide, generic adapters. We argue…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Md Jahidul Islam

To address the real-time analysis requirements of video streaming applications, we propose an innovative inter-relation-aware video complexity analyzer (IVCA) to enhance the existing video complexity analyzer (VCA). The IVCA overcomes the…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Junqi Liao , Yao Li , Zhuoyuan Li , Li Li , Dong Liu

Recent advances in multimodal large language models (LLMs) have shown extreme effectiveness in visual question answering (VQA). However, the design nature of these end-to-end models prevents them from being interpretable to humans,…

Computation and Language · Computer Science 2024-04-16 Xingyu Fu , Ben Zhou , Sihao Chen , Mark Yatskar , Dan Roth

We consider an information theoretic approach to address the problem of identifying fake digital images. We propose an innovative method to formulate the issue of localizing manipulated regions in an image as a deep representation learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Aurobrata Ghosh , Zheng Zhong , Steve Cruz , Subbu Veeravasarapu , Terrance E Boult , Maneesh Singh

While large-scale pretrained language models have obtained impressive results when fine-tuned on a wide variety of tasks, they still often suffer from overfitting in low-resource scenarios. Since such models are general-purpose feature…

Computation and Language · Computer Science 2021-06-11 Rabeeh Karimi Mahabadi , Yonatan Belinkov , James Henderson

Variational dimensionality reduction methods are widely used for their accuracy, generative capabilities, and robustness. We introduce a unifying framework that generalizes both such as traditional and state-of-the-art methods. The…

Machine Learning · Computer Science 2025-09-04 Eslam Abdelaleem , Ilya Nemenman , K. Michael Martini

Video Question Answering (VQA) in long videos poses the key challenge of extracting relevant information and modeling long-range dependencies from many redundant frames. The self-attention mechanism provides a general solution for sequence…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Md Mohaiminul Islam , Tushar Nagarajan , Huiyu Wang , Gedas Bertasius , Lorenzo Torresani

We present a simple case study, demonstrating that Variational Information Bottleneck (VIB) can improve a network's classification calibration as well as its ability to detect out-of-distribution data. Without explicitly being designed to…

Machine Learning · Computer Science 2018-07-04 Alexander A. Alemi , Ian Fischer , Joshua V. Dillon

Mitigating entity bias is a critical challenge in Relation Extraction (RE), where models often rely excessively on entities, resulting in poor generalization. This paper presents a novel approach to address this issue by adapting a…

Computation and Language · Computer Science 2025-06-16 Samuel Mensah , Elena Kochkina , Jabez Magomere , Joy Prakash Sain , Simerjot Kaur , Charese Smiley

We present a variational approximation to the information bottleneck of Tishby et al. (1999). This variational approach allows us to parameterize the information bottleneck model using a neural network and leverage the reparameterization…

Machine Learning · Computer Science 2019-10-25 Alexander A. Alemi , Ian Fischer , Joshua V. Dillon , Kevin Murphy

Information Bottleneck (IB) is a widely used framework that enables the extraction of information related to a target random variable from a source random variable. In the objective function, IB controls the trade-off between data…

Machine Learning · Computer Science 2025-08-13 Sota Kudo , Naoaki Ono , Shigehiko Kanaya , Ming Huang

Vision-Language Models (VLMs) have demonstrated remarkable progress in multimodal tasks, but remain susceptible to hallucinations, where generated text deviates from the underlying visual content. Existing hallucination detection methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Feiran Zhang , Yixin Wu , Zhenghua Wang , Xiaohua Wang , Changze Lv , Xuanjing Huang , Xiaoqing Zheng

Constructing accurate model-agnostic explanations for opaque machine learning models remains a challenging task. Classification models for high-dimensional data, like images, are often inherently complex. To reduce this complexity,…

Machine Learning · Computer Science 2020-10-26 Georgios Vlassopoulos , Tim van Erven , Henry Brighton , Vlado Menkovski

The fruits of science are relationships made comprehensible, often by way of approximation. While deep learning is an extremely powerful way to find relationships in data, its use in science has been hindered by the difficulty of…

Machine Learning · Computer Science 2022-04-18 Kieran A. Murphy , Dani S. Bassett

Explaining deep learning models operating on time series data is crucial in various applications of interest which require interpretable and transparent insights from time series signals. In this work, we investigate this problem from an…

The proliferation of generative AI has led to hyper-realistic synthetic videos, escalating misuse risks and outstripping binary real/fake detectors. We introduce SAGA (Source Attribution of Generative AI videos), the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Rohit Kundu , Vishal Mohanty , Hao Xiong , Shan Jia , Athula Balachandran , Amit K. Roy-Chowdhury

Deep Recurrent Neural Networks (RNN) is increasingly used in decision-making with temporal sequences. However, understanding how RNN models produce final predictions remains a major challenge. Existing work on interpreting RNN models for…

Machine Learning · Computer Science 2020-08-25 Chuan Wang , Xumeng Wang , Kwan-Liu Ma

We introduce TimeViper, a hybrid vision-language model designed to tackle challenges of long video understanding. Processing long videos demands both an efficient model architecture and an effective mechanism for handling extended temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Boshen Xu , Zihan Xiao , Jiaze Li , Jianzhong Ju , Zhenbo Luo , Jian Luan , Qin Jin

Many decision-making tasks, where both accuracy and efficiency matter, still require human supervision. For example, tasks like traffic officers reviewing hour-long dashcam footage or researchers screening conference videos can benefit from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Shenghui Chen , Po-han Li , Sandeep Chinchali , Ufuk Topcu

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim