English
Related papers

Related papers: A Bayesian Interpretation of the Internal Model Pr…

200 papers

A fascinating hypothesis is that human and animal intelligence could be explained by a few principles (rather than an encyclopedic list of heuristics). If that hypothesis was correct, we could more easily both understand our own…

Machine Learning · Computer Science 2022-08-02 Anirudh Goyal , Yoshua Bengio

The capability of imagining internally with a mental model of the world is vitally important for human cognition. If a machine intelligent agent can learn a world model to create a "dream" environment, it can then internally ask what-if…

Machine Learning · Computer Science 2020-12-29 Minne Li , Mengyue Yang , Furui Liu , Xu Chen , Zhitang Chen , Jun Wang

Formulating a statistical inverse problem as one of inference in a Bayesian model has great appeal, notably for what this brings in terms of coherence, the interpretability of regularisation penalties, the integration of all uncertainties,…

Statistics Theory · Mathematics 2012-12-19 Natalia A. Bochkina , Peter J. Green

Datasets are rarely a realistic approximation of the target population. Say, prevalence is misrepresented, image quality is above clinical standards, etc. This mismatch is known as sampling bias. Sampling biases are a major hindrance for…

Traditional models of climate change use complex systems of coupled equations to simulate physical processes across the Earth system. These simulations are highly computationally expensive, limiting our predictions of climate change and…

Probably the most important problem in machine learning is the preliminary biasing of a learner's hypothesis space so that it is small enough to ensure good generalisation from reasonable training sets, yet large enough that it contains a…

Machine Learning · Computer Science 2019-12-20 Jonathan Baxter

Complex systems are often modeled as Boolean networks in attempts to capture their logical structure and reveal its dynamical consequences. Approximating the dynamics of continuous variables by discrete values and Boolean logic gates may,…

Molecular Networks · Quantitative Biology 2013-05-29 Johannes Norrell , Joshua E. S. Socolar

Bayesian learning is a powerful learning framework which combines the external information of the data (background information) with the internal information (training data) in a logically consistent way in inference and prediction. By…

Machine Learning · Statistics 2026-02-11 Erdong Guo , David Draper

The internal model principle is a fundamental result stating a necessary and sufficient condition for a stabilizing controller to be robustly regulating. Its classical formulation is given in terms of coprime factorizations and the largest…

Optimization and Control · Mathematics 2020-05-25 Petteri Laakkonen

Encoding and decoding models are widely used in systems, cognitive, and computational neuroscience to make sense of brain-activity data. However, the interpretation of their results requires care. Decoding models can help reveal whether…

Neurons and Cognition · Quantitative Biology 2019-04-29 Nikolaus Kriegeskorte , Pamela K. Douglas

Causal and counterfactual reasoning are emerging directions in data science that allow us to reason about hypothetical scenarios. This is particularly useful in fields like environmental and ecological sciences, where interventional data…

Artificial Intelligence · Computer Science 2024-12-06 Rafael Cabañas , Ana D. Maldonado , María Morales , Pedro A. Aguilera , Antonio Salmerón

In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian…

Statistics Theory · Mathematics 2020-04-22 Giorgio M. Vitetta , Pasquale Di Viesti , Emilio Sirignano , Francesco Montorsi

We develop a network of Bayesian agents that collectively model the mental states of teammates from the observed communication. Using a generative computational approach to cognition, we make two contributions. First, we show that our agent…

Human-Computer Interaction · Computer Science 2023-03-29 Samuel Westby , Christoph Riedl

This paper describes methods for comparative evaluation of the interpretability of models of high dimensional time series data inferred by unsupervised machine learning algorithms. The time series data used in this investigation were logs…

Artificial Intelligence · Computer Science 2020-05-05 Nicholas Hoernle , Kobi Gal , Barbara Grosz , Leilah Lyons , Ada Ren , Andee Rubin

The recent success of Bayesian methods in neuroscience and artificial intelligence gives rise to the hypothesis that the brain is a Bayesian machine. Since logic and learning are both practices of the human brain, it leads to another…

Artificial Intelligence · Computer Science 2021-01-28 Hiroyuki Kido , Keishi Okamoto

There is currently a renewed interest in the Bayesian predictive approach to statistics. This paper offers a review on foundational concepts and focuses on predictive modeling, which by directly reasoning on prediction, bypasses inferential…

Statistics Theory · Mathematics 2024-11-22 Sandra Fortini , Sonia Petrone

Bayesian modeling provides a principled approach to quantifying uncertainty in model parameters and model structure and has seen a surge of applications in recent years. Within the context of a Bayesian workflow, we are concerned with model…

Methodology · Statistics 2025-01-24 Maximilian Scholz , Paul-Christian Bürkner

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

Recent work analyzing in-context learning (ICL) has identified a broad set of strategies that describe model behavior in different experimental conditions. We aim to unify these findings by asking why a model learns these disparate…

Machine Learning · Computer Science 2025-06-27 Daniel Wurgaft , Ekdeep Singh Lubana , Core Francisco Park , Hidenori Tanaka , Gautam Reddy , Noah D. Goodman

While the study of a single network is well-established, technological advances now allow for the collection of multiple networks with relative ease. Increasingly, anywhere from several to thousands of networks can be created from brain…

Applications · Statistics 2021-01-14 Nathaniel Josephs , Lizhen Lin , Steven Rosenberg , Eric D. Kolaczyk