English
Related papers

Related papers: Discretized Integrated Gradients for Explaining La…

200 papers

Incremental gradient (IG) methods, such as stochastic gradient descent and its variants are commonly used for large scale optimization in machine learning. Despite the sustained effort to make IG methods more data-efficient, it remains an…

Machine Learning · Computer Science 2020-11-18 Baharan Mirzasoleiman , Jeff Bilmes , Jure Leskovec

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

Optimization and Control · Mathematics 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

In 2020 Domingos introduced an interpolation formula valid for "every model trained by gradient descent". He concluded that such models behave approximately as kernel machines. In this work, we extend the Domingos formula to stochastic…

Machine Learning · Computer Science 2026-03-17 Jin Guo , Roy Y. He , Jean-Michel Morel

Ensuring faithful interpretability in large language models is imperative for trustworthy and reliable AI. A key obstacle is self-repair, a phenomenon where networks compensate for reduced signal in one component by amplifying others,…

Computation and Language · Computer Science 2025-10-02 Joakim Edin , Róbert Csordás , Tuukka Ruotsalo , Zhengxuan Wu , Maria Maistro , Casper L. Christensen , Jing Huang , Lars Maaløe

Retrieval-augmented generation (RAG) equips large language models (LLMs) with reliable knowledge memory. To strengthen cross-text associations, recent research integrates graphs and hypergraphs into RAG to capture pairwise and multi-entity…

Information Retrieval · Computer Science 2026-02-10 Xingliang Hou , Yuyan Liu , Qi Sun , haoxiu wang , Hao Hu , Shaoyi Du , Zhiqiang Tian

Feature attributions are post-training analysis methods that assess how various input features of a machine learning model contribute to an output prediction. Their interpretation is straightforward when features act independently, but it…

Machine Learning · Computer Science 2026-01-29 Kurt Butler , Guanchao Feng , Petar Djuric

Many popular feature-attribution methods for interpreting deep neural networks rely on computing the gradients of a model's output with respect to its inputs. While these methods can indicate which input features may be important for the…

Machine Learning · Computer Science 2023-07-11 Kevin Du , Lucas Torroba Hennigen , Niklas Stoehr , Alexander Warstadt , Ryan Cotterell

This paper introduces the first gradient-based framework for prompt optimization in text-to-image diffusion models. We formulate prompt engineering as a discrete optimization problem over the language space. Two major challenges arise in…

Machine Learning · Computer Science 2024-07-03 Ruochen Wang , Ting Liu , Cho-Jui Hsieh , Boqing Gong

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

Machine Learning · Computer Science 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell

Understanding how deep convolutional neural networks classify data has been subject to extensive research. This paper proposes a technique to visualize and interpret intermediate layers of unsupervised deep convolutional networks by…

Sound · Computer Science 2022-04-29 Gašper Beguš , Alan Zhou

Data imputation addresses the challenge of imputing missing values in database instances, ensuring consistency with the overall semantics of the dataset. Although several heuristics which rely on statistical methods, and ad-hoc rules have…

Artificial Intelligence · Computer Science 2024-10-22 Jiang Hua , Michael Bewong , Selasi Kwashie , MD Geaur Rahman , Junwei Hu , Xi Guo , Zaiwen Fen

As Retrieval-Augmented Generation (RAG) systems evolve toward more sophisticated architectures, ensuring their trustworthiness through explainable and robust evaluation becomes critical. Existing scalar metrics suffer from limited…

Artificial Intelligence · Computer Science 2025-12-30 Shiyan Liu , Jian Ma , Rui Qu

This paper presents Deep Integrated Explanations (DIX) - a universal method for explaining vision models. DIX generates explanation maps by integrating information from the intermediate representations of the model, coupled with their…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Oren Barkan , Yehonatan Elisha , Jonathan Weill , Yuval Asher , Amit Eshel , Noam Koenigstein

Many real-world datasets, such as citation networks, social networks, and molecular structures, are naturally represented as heterogeneous graphs, where nodes belong to different types and have additional features. For example, in a…

Machine Learning · Computer Science 2026-02-05 Pallabee Das , Stefan Heindorf

In implicit models, one often interpolates between sampled points in latent space. As we show in this paper, care needs to be taken to match-up the distributional assumptions on code vectors with the geometry of the interpolating paths.…

Machine Learning · Computer Science 2018-02-05 Yannic Kilcher , Aurelien Lucchi , Thomas Hofmann

Multi-Instance Generation has advanced significantly in spatial placement and attribute binding. However, existing approaches still face challenges in fine-grained semantic understanding, particularly when dealing with complex textual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Shiyan Du , Conghan Yue , Xinyu Cheng , Dongyu Zhang

Perceptually Aligned Gradients (PAG) refer to an intriguing property observed in robust image classification models, wherein their input gradients align with human perception and pose semantic meanings. While this phenomenon has gained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Roy Ganz , Michael Elad

Visual grounding (VG) typically focuses on locating regions of interest within an image using natural language, and most existing VG methods are limited to single-image interpretations. This limits their applicability in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Wenxuan Wang , Zijia Zhao , Yisi Zhang , Yepeng Tang , Erdong Hu , Xinlong Wang , Jing Liu

Distributed language representation has become the most widely used technique for language representation in various natural language processing tasks. Most of the natural language processing models that are based on deep learning…

Computation and Language · Computer Science 2020-05-11 Martina Toshevska , Frosina Stojanovska , Jovan Kalajdjieski

Explaining deep learning models in a way that humans can easily understand is essential for responsible artificial intelligence applications. Attribution methods constitute an important area of explainable deep learning. The attribution…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Michal Byra , Henrik Skibbe