English
Related papers

Related papers: Black-boxing and cause-effect power

200 papers

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Black-box optimization in science and engineering often comes with side information: experts, simulators, pretrained predictors, or heuristics can suggest which candidates look promising. This information can accelerate search, but it can…

Machine Learning · Computer Science 2026-05-08 Nicolas Samuel Blumer , Julien Martinelli , Samuel Kaski

Black-box safety evaluation of AI systems assumes model behavior on test distributions reliably predicts deployment performance. We formalize and challenge this assumption through latent context-conditioned policies -- models whose outputs…

Artificial Intelligence · Computer Science 2026-02-20 Vishal Srivastava

Is reduction always a good scientific strategy? Does it always lead to a gain in information? The very existence of the special sciences above and beyond physics seems to hint no. Previous research has shown that dimension reduction…

Information Theory · Computer Science 2021-04-28 Thomas Varley , Erik Hoel

With the increasing adoption of predictive models trained using machine learning across a wide range of high-stakes applications, e.g., health care, security, criminal justice, finance, and education, there is a growing need for effective…

Machine Learning · Computer Science 2020-08-04 Aria Khademi , Vasant Honavar

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng

We present a domain-general account of causation that applies to settings in which macro-level causal relations between two systems are of interest, but the relevant causal features are poorly understood and have to be aggregated from vast…

Machine Learning · Statistics 2015-12-29 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

The representations of the world around in physics built with help of causality are analyzed and seems incomplete. The observer's causal representations form a closed logical system, i.e. the compact group related to cause-effect chains.…

General Physics · Physics 2010-11-02 A. V. Novikov-Borodin

Built upon the concept of causal faithfulness, the so-called causal discovery algorithms propose the breakdown of mutual information (MI) and conditional mutual information (CMI) into sets of variables to reveal causal influences. These…

Statistical Mechanics · Physics 2022-08-09 Tiago Martinelli , Diogo O. Soares-Pinto , Francisco A. Rodrigues

The physiological tradition of biological research analyzes biological systems using reduced descriptions much as an engineer uses a 'black box' description of an amplifier. Simple models have been used by physiologists for a very long…

Other Quantitative Biology · Quantitative Biology 2012-07-06 Bob Eisenberg

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

Decision trees, owing to their interpretability, are attractive as control policies for (dynamical) systems. Unfortunately, constructing, or synthesising, such policies is a challenging task. Previous approaches do so by imitating a…

Artificial Intelligence · Computer Science 2025-04-23 Emir Demirović , Christian Schilling , Anna Lukina

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

Machine Learning · Statistics 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

Black-box alpha (BB-$\alpha$) is a new approximate inference method based on the minimization of $\alpha$-divergences. BB-$\alpha$ scales to large datasets because it can be implemented using stochastic gradient descent. BB-$\alpha$ can be…

Black-box optimization refers to the optimization problem whose objective function and/or constraint sets are either unknown, inaccessible, or non-existent. In many applications, especially with the involvement of humans, the only way to…

Black-box optimization formulations for biological sequence design have drawn recent attention due to their promising potential impact on the pharmaceutical industry. In this work, we propose to unify two seemingly distinct worlds:…

Machine Learning · Computer Science 2022-02-10 Dinghuai Zhang , Jie Fu , Yoshua Bengio , Aaron Courville

We study black-box reductions from mechanism design to algorithm design for welfare maximization in settings of incomplete information. Given oracle access to an algorithm for an underlying optimization problem, the goal is to simulate an…

Computer Science and Game Theory · Computer Science 2019-06-27 Evangelia Gergatsouli , Brendan Lucier , Christos Tzamos

Complex systems can be described at myriad different scales, and their causal workings often have multiscale structure (e.g., a computer can be described at the microscale of its hardware circuitry, the mesoscale of its machine code, and…

Information Theory · Computer Science 2025-04-22 Erik Hoel

It is often claimed that the fundamental laws of physics are deterministic and time-symmetric and that therefore our experience of the passage of time is an illusion. This paper will critically discuss these claims and show that they are…

Quantum Physics · Physics 2023-04-20 Barbara Drossel

The evolution of the human mind through natural selection mandates that our conscious experiences are causally potent in order to leave a tangible impact upon the surrounding physical world. Any attempt to construct a functional theory of…

Neurons and Cognition · Quantitative Biology 2024-05-10 Danko D. Georgiev