English
Related papers

Related papers: Compositional Active Inference II: Polynomial Dyna…

200 papers

Replay in the brain has been viewed as rehearsal, or, more recently, as sampling from a transition model. Here, we propose a new hypothesis: that replay is able to implement a form of compositional computation where entities are assembled…

Neurons and Cognition · Quantitative Biology 2022-12-21 Zeb Kurth-Nelson , Timothy Behrens , Greg Wayne , Kevin Miller , Lennart Luettgau , Ray Dolan , Yunzhe Liu , Philipp Schwartenbeck

The ability to compose parts to form a more complex whole, and to analyze a whole as a combination of elements, is desirable across disciplines. This workshop bring together researchers applying compositional approaches to physics, NLP,…

Computation and Language · Computer Science 2018-11-08 Martha Lewis , Bob Coecke , Jules Hedges , Dimitri Kartsaklis , Dan Marsden

In tasks like semantic parsing, instruction following, and question answering, standard deep networks fail to generalize compositionally from small datasets. Many existing approaches overcome this limitation with model architectures that…

Computation and Language · Computer Science 2023-07-06 Ekin Akyürek , Jacob Andreas

Intelligent agents can cope with sensory-rich environments by learning task-agnostic state abstractions. In this paper, we propose an algorithm to approximate causal states, which are the coarsest partition of the joint history of actions…

A probabilistic model describes a system in its observational state. In many situations, however, we are interested in the system's response under interventions. The class of structural causal models provides a language that allows us to…

Methodology · Statistics 2020-01-20 Jonas Peters , Stefan Bauer , Niklas Pfister

In this paper we define a class of polynomial functors suited for constructing coalgebras representing processes in which uncertainty plays an important role. In these polynomial functors we include upper and lower probability measures,…

Logic in Computer Science · Computer Science 2024-04-02 Andrés Gallardo , Ignacio Viglizzo

In recent years, there has been an increased need for the use of active systems - systems required to act automatically based on events, or changes in the environment. Such systems span many areas, from active databases to applications that…

Artificial Intelligence · Computer Science 2012-07-09 Segev Wasserkrug , Avigdor Gal , Opher Etzion

Classical deep learning typically operates on individual cases. Despite its success, real-world usage often requires repeated inference to estimate statistical quantities for complex decision-making tasks involving uncertainty or…

Machine Learning · Computer Science 2026-05-13 Daniel Xu , Yuxin Xie , Minghao Guo , Haixu Wu , Wojciech Matusik

Active inference offers a first principle account of sentient behaviour, from which special and important cases can be derived, e.g., reinforcement learning, active learning, Bayes optimal inference, Bayes optimal design, etc. Active…

Neurons and Cognition · Quantitative Biology 2020-06-09 Karl Friston , Lancelot Da Costa , Danijar Hafner , Casper Hesp , Thomas Parr

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional approximations to…

Econometrics · Economics 2022-12-23 Karun Adusumilli , Dita Eckardt

Using a hierarchical construction, we develop methods for a wide and flexible class of models by taking a fully parametric approach to generalized linear mixed models with complex covariance dependence. The Laplace approximation is used to…

Methodology · Statistics 2024-07-31 Jay M. Ver Hoef , Eryn Blagg , Michael Dumelle , Philip M. Dixon , Dale L. Zimmerman , Paul Conn

Neural Posterior Estimation methods for simulation-based inference can be ill-suited for dealing with posterior distributions obtained by conditioning on multiple observations, as they tend to require a large number of simulator calls to…

Machine Learning · Computer Science 2023-07-11 Tomas Geffner , George Papamakarios , Andriy Mnih

Physically-inspired latent force models offer an interpretable alternative to purely data driven tools for inference in dynamical systems. They carry the structure of differential equations and the flexibility of Gaussian processes,…

Machine Learning · Computer Science 2022-01-25 Jacob D. Moss , Felix L. Opolka , Bianca Dumitrascu , Pietro Lió

Proving compositionality of behavioral equivalence on state-based systems with respect to algebraic operations is a classical and widely studied problem. We study a categorical formulation of this problem, where operations on state-based…

Logic in Computer Science · Computer Science 2024-05-24 Mayuko Kori , Kazuki Watanabe , Jurriaan Rot , Shin-ya Katsumata

We develop operators for construction of proposals in probabilistic programs, which we refer to as inference combinators. Inference combinators define a grammar over importance samplers that compose primitive operations such as application…

Machine Learning · Statistics 2021-06-18 Sam Stites , Heiko Zimmermann , Hao Wu , Eli Sennesh , Jan-Willem van de Meent

We extend the open games framework for compositional game theory to encompass also mixed strategies, making essential use of the discrete probability distribution monad. We show that the resulting games form a symmetric monoidal category,…

Logic in Computer Science · Computer Science 2020-09-16 Neil Ghani , Clemens Kupke , Alasdair Lambert , Fredrik Nordvall Forsberg

Laplace approximations are popular techniques for endowing deep networks with epistemic uncertainty estimates as they can be applied without altering the predictions of the trained network, and they scale to large models and datasets. While…

Machine Learning · Computer Science 2024-11-01 Tristan Cinquin , Marvin Pförtner , Vincent Fortuin , Philipp Hennig , Robert Bamler

Martin-L\"of's Intuitionistic Theory of Types is becoming popular for formal reasoning about computer programs. To handle recursion schemes other than primitive recursion, a theory of well-founded relations is presented. Using primitive…

Logic in Computer Science · Computer Science 2008-02-03 Lawrence C. Paulson

Many models require integrals of high-dimensional functions: for instance, to obtain marginal likelihoods. Such integrals may be intractable, or too expensive to compute numerically. Instead, we can use the Laplace approximation (LA). The…

Methodology · Statistics 2024-11-05 Shaun McDonald , David Campbell

We present a method for active inference with partial observations in stochastic systems through incentive design, also known as the leader-follower game. Consider a leader agent who aims to infer a follower agent's type given a finite set…

Systems and Control · Electrical Eng. & Systems 2025-02-12 Xinyi Wei , Chongyang Shi , Shuo Han , Ahmed H. Hemida , Charles A. Kamhoua , Jie Fu