English
Related papers

Related papers: Causal Rate Distortion Function and Relations to F…

200 papers

This article presents a reformulation of the Theory of Functional Connections: a general methodology for functional interpolation that can embed a set of user-specified linear constraints. The reformulation presented in this paper exploits…

Numerical Analysis · Mathematics 2020-08-07 Carl Leake , Hunter Johnston , Daniele Mortari

It is well-known that if one assumes quantum theory to hold locally, then processes with indefinite causal order and cyclic causal structures become feasible. Here, we study qualitative limitations on causal structures and correlations…

Quantum Physics · Physics 2024-01-09 Eleftherios-Ermis Tselentis , Ämin Baumeler

A data science task can be deemed as making sense of the data or testing a hypothesis about it. The conclusions inferred from data can greatly guide us to make informative decisions. Big data has enabled us to carry out countless prediction…

Machine Learning · Computer Science 2022-01-12 Wenhao Zhang , Ramin Ramezani , Arash Naeim

We provide a rigorous definition of the visual cause of a behavior that is broadly applicable to the visually driven behavior in humans, animals, neurons, robots and other perceiving systems. Our framework generalizes standard accounts of…

Machine Learning · Statistics 2015-06-08 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

The aim of this article is to establish basic results in a conditional measure theory. The results are applied to prove that arbitrary kernels and conditional distributions are represented by measures in a conditional set theory. In…

Probability · Mathematics 2018-03-21 Asgar Jamneshan , Michael Kupper , Martin Streckfuß

We consider the problem of function estimation in the case where an underlying causal model can be inferred. This has implications for popular scenarios such as covariate shift, concept drift, transfer learning and semi-supervised learning.…

Machine Learning · Computer Science 2012-07-03 Bernhard Schoelkopf , Dominik Janzing , Jonas Peters , Eleni Sgouritsa , Kun Zhang , Joris Mooij

This paper presents a new foundational approach to information theory based on the concept of the information efficiency of a recursive function, which is defined as the difference between the information in the input and the output. The…

Information Theory · Computer Science 2023-08-29 Pieter Adriaans

This paper examines two related problems that are central to developing an autonomous decision-making agent, such as a robot. Both problems require generating structured representafions from a database of unstructured declarative knowledge…

Artificial Intelligence · Computer Science 2013-04-10 Spencer Star

The theory of computational complexity focuses on functions and, hence, studies programs whose interactive behavior is reduced to a simple question/answer pattern. We propose a broader theory whose ultimate goal is expressing and analyzing…

Computational Complexity · Computer Science 2012-09-05 Ugo Dal Lago , Tobias Heindel , Damiano Mazza , Daniele Varacca

We prove achievability of the recently characterized quadratic Gaussian rate-distortion function (RDF) subject to the constraint that the distortion is uncorrelated to the source. This result is based on shaped dithered lattice quantization…

Information Theory · Computer Science 2008-07-24 Milan S. Derpich , Jan Ostergaard , Daniel E. Quevedo

Computational analysis of time-course data with an underlying causal structure is needed in a variety of domains, including neural spike trains, stock price movements, and gene expression levels. However, it can be challenging to determine…

Artificial Intelligence · Computer Science 2012-05-14 Samantha Kleinberg , Bud Mishra

This short article contains the construction of a construction that generalizes the concept of the derivative of a function of one variable, using the theory of filters. The paper presents a new concept, demonstrates that it really…

Functional Analysis · Mathematics 2025-06-24 Dmytro Seliutin

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in…

Machine Learning · Computer Science 2024-02-15 Jeroen Berrevoets , Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar

A new derivative, called deformable derivative, is introduced here which is equivalent to ordinary derivative in the sense that one implies other. The deformable derivative is defined using limit approach like that of ordinary one but with…

Classical Analysis and ODEs · Mathematics 2017-05-03 Fahed Zulfeqarr , Amit Ujlayan , Priyanka Ahuja

Explainability plays an increasingly important role in machine learning. Furthermore, humans view the world through a causal lens and thus prefer causal explanations over associational ones. Therefore, in this paper, we develop a causal…

Artificial Intelligence · Computer Science 2023-07-04 Xiaoxiao Wang , Fanyu Meng , Xin Liu , Zhaodan Kong , Xin Chen

We consider a remote source coding problem subject to a {distortion function}. Contrary to the use of the classical separable distortion criterion, herein we consider the more general, $f$-separable distortion measure and study its…

Information Theory · Computer Science 2023-05-19 Photios A. Stavrou , Yanina Shkel , Marios Kountouris

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

We extend the definition of the marginal causal effect to the continuous treatment setting and develop a novel characterization of causal bias in the framework of structural causal models. We prove that our derived bias expression is zero…

Methodology · Statistics 2022-02-01 Gianluca Detommaso , Michael Brückner , Philip Schulz , Victor Chernozhukov

Causal reasoning is the main learning and explanation tool used by humans. AI systems should possess causal reasoning capabilities to be deployed in the real world with trust and reliability. Introducing the ideas of causality to machine…

Machine Learning · Computer Science 2021-06-11 Abbavaram Gowtham Reddy

Our evolution as a species made a huge step forward when we understood the relationships between causes and effects. These associations may be trivial for some events, but they are not in complex scenarios. To rigorously prove that some…

Mathematical Software · Computer Science 2021-07-13 Martí Pedemonte , Jordi Vitrià , Álvaro Parafita