English
Related papers

Related papers: Less is More: Efficient Black-box Attribution via …

200 papers

Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems in security-relevant…

Implicit feedback (e.g., clicks, dwell times, etc.) is an abundant source of data in human-interactive systems. While implicit feedback has many advantages (e.g., it is inexpensive to collect, user centric, and timely), its inherent biases…

Information Retrieval · Computer Science 2016-08-17 Thorsten Joachims , Adith Swaminathan , Tobias Schnabel

A recent focus of large language model (LLM) development, as exemplified by generative search engines, is to incorporate external references to generate and support its claims. However, evaluating the attribution, i.e., verifying whether…

Computation and Language · Computer Science 2023-10-10 Xiang Yue , Boshi Wang , Ziru Chen , Kai Zhang , Yu Su , Huan Sun

The Gene-pool Optimal Mixing EA (GOMEA) family of EAs offers a specific means to exploit problem-specific knowledge through linkage learning, i.e., inter-variable dependency detection, expressed using subsets of variables, that should…

Neural and Evolutionary Computing · Computer Science 2025-07-01 Renzo J. Scholman , Tanja Alderliesten , Peter A. N. Bosman

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

Supervised machine learning often operates on the data-driven paradigm, wherein internal model parameters are autonomously optimized to converge predicted outputs with the ground truth, devoid of explicitly programming rules or a priori…

Machine Learning · Computer Science 2024-12-12 Daniel Geissler , Bo Zhou , Mengxi Liu , Paul Lukowicz

Two-stage stochastic optimization is a framework for modeling uncertainty, where we have a probability distribution over possible realizations of the data, called scenarios, and decisions are taken in two stages: we make first-stage…

Data Structures and Algorithms · Computer Science 2023-10-25 Andre Linhares , Chaitanya Swamy

In online advertising, users may be exposed to a range of different advertising campaigns, such as natural search or referral or organic search, before leading to a final transaction. Estimating the contribution of advertising campaigns on…

Information Retrieval · Computer Science 2020-04-02 Dongdong Yang , Kevin Dyer , Senzhang Wang

Black-box alpha (BB-$\alpha$) is a new approximate inference method based on the minimization of $\alpha$-divergences. BB-$\alpha$ scales to large datasets because it can be implemented using stochastic gradient descent. BB-$\alpha$ can be…

Today, the training of large language models (LLMs) can involve personally identifiable information and copyrighted material, incurring dataset misuse. To mitigate the problem of dataset misuse, this paper explores \textit{dataset…

Cryptography and Security · Computer Science 2025-12-09 Ruikai Zhou , Kang Yang , Xun Chen , Wendy Hui Wang , Guanhong Tao , Jun Xu

Large Language Models (LLMs) exhibit systematic biases across demographic groups. Auditing is proposed as an accountability tool for black-box LLM applications, but suffers from resource-intensive query access. We conceptualise auditing as…

Machine Learning · Computer Science 2026-01-07 David Hartmann , Lena Pohlmann , Lelia Hanslik , Noah Gießing , Bettina Berendt , Pieter Delobelle

Feature attribution aims to explain the reasoning behind a black-box model's prediction by identifying the impact of each feature on the prediction. Recent work has extended feature attribution to interactions between multiple features.…

Machine Learning · Computer Science 2023-05-17 Yifan Jiang , Shane Steinert-Threlkeld

Modern preference alignment techniques, such as Best-of-N (BoN) sampling, rely on reward models trained with pairwise comparison data. While effective at learning relative preferences, this paradigm fails to capture a signal of response…

Methodology · Statistics 2025-10-14 Hyung Gyu Rho , Sian Lee

Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational…

Machine Learning · Computer Science 2018-06-27 Anirban Mukhopadhyay

Recent work, spanning from autonomous vehicle coordination to in-space assembly, has shown the importance of learning collaborative behavior for enabling robots to achieve shared goals. A common approach for learning this cooperative…

Multiagent Systems · Computer Science 2025-02-25 Kartik Nagpal , Dayi Dong , Jean-Baptiste Bouvier , Negar Mehr

Attribution methods shed light on the explainability of data-driven approaches such as deep learning models by uncovering the most influential features in a to-be-explained decision. While determining feature attributions via gradients…

Machine Learning · Computer Science 2024-05-15 Yi Cai , Gerhard Wunder

Large language model (LLM) training is often bottlenecked by memory constraints and stochastic gradient noise in extremely high-dimensional parameter spaces. Motivated by empirical evidence that many LLM gradient matrices are effectively…

Machine Learning · Computer Science 2026-03-24 Zehao Li , Tao Ren , Zishi Zhang , Xi Chen , Yijie Peng

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

Machine Learning · Computer Science 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

Training large-scale recommendation models under a single global objective implicitly assumes homogeneity across user populations. However, real-world data are composites of heterogeneous cohorts with distinct conditional distributions. As…

Fine-tuned Large Language Models (LLMs) are vulnerable to backdoor attacks through data poisoning, yet the internal mechanisms governing these attacks remain a black box. Previous research on interpretability for LLM safety tends to focus…

Cryptography and Security · Computer Science 2025-10-01 Miao Yu , Zhenhong Zhou , Moayad Aloqaily , Kun Wang , Biwei Huang , Stephen Wang , Yueming Jin , Qingsong Wen