English
Related papers

Related papers: Approximate Bayesian inference as a gauge theory

200 papers

A pervasive challenge in neuroscience is testing whether neuronal connectivity changes over time due to specific causes, such as stimuli, events, or clinical interventions. Recent hardware innovations and falling data storage costs enable…

Neurons and Cognition · Quantitative Biology 2024-01-05 Johan Medrano , Karl J. Friston , Peter Zeidman

Positing complex adaptive systems made of agents with relations between them that can be composed, it follows that they can be described by gauge theories similar to elementary particle theory and general relativity. By definition, a…

High Energy Physics - Lattice · Physics 2008-02-03 G. Mack

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

Understanding and interacting with everyday physical scenes requires rich knowledge about the structure of the world, represented either implicitly in a value or policy function, or explicitly in a transition model. Here we introduce a new…

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Over the last years, in a series papers by Arrechi and others, a model for the cognitive processes involved in decision making has been proposed and investigated. The key element of this model is the expression of apprehension and…

Neurons and Cognition · Quantitative Biology 2015-11-20 Yukio-Pegio Gunji , Kohei Sonoda , Vasileios Basios

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Machine learning provides algorithms that can learn from data and make inferences or predictions on data. Bayesian networks are a class of graphical models that allow to represent a collection of random variables and their condititional…

Artificial Intelligence · Computer Science 2019-01-08 Robert Leppert , Karl-Heinz Zimmermann

Approximate inference in probability models is a fundamental task in machine learning. Approximate inference provides powerful tools to Bayesian reasoning, decision making, and Bayesian deep learning. The main goal is to estimate the…

Machine Learning · Computer Science 2020-03-10 Jun Han

Bayesian Neural Networks (BNNs) have become one of the promising approaches for uncertainty estimation due to the solid theorical foundations. However, the performance of BNNs is affected by the ability of catching uncertainty. Instead of…

Machine Learning · Computer Science 2024-04-15 Shiyu Shen , Bin Pan , Tianyang Shi , Tao Li , Zhenwei Shi

Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations.…

Computation · Statistics 2017-12-13 Philip Maybank , Ingo Bojak , Richard G. Everitt

The natural habitat of most Bayesian methods is data represented by exchangeable sequences of observations, for which de Finetti's theorem provides the theoretical foundation. Dirichlet process clustering, Gaussian process regression, and…

Statistics Theory · Mathematics 2015-02-16 Peter Orbanz , Daniel M. Roy

Organisms are nonequilibrium, stationary systems self-organized via spontaneous symmetry breaking and undergoing metabolic cycles with broken detailed balance in the environment. The thermodynamic free-energy principle describes an…

Neurons and Cognition · Quantitative Biology 2022-11-24 Chang Sub Kim

We offer a general theoretical framework for brain and behavior that is evolutionarily and computationally plausible. The brain in our abstract model is a network of nodes and edges. Although it has some similarities to standard neural…

Artificial Intelligence · Computer Science 2022-04-12 Joseph Y. Halpern , Arnon Lotem

Artificial intelligence has made great strides in the last decade but still falls short of the human brain, the best-known example of intelligence. Not much is known of the neural processes that allow the brain to make the leap to achieve…

Artificial Intelligence · Computer Science 2021-08-13 Ananta Nair

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

Questions about information encoded by the brain demand statistical frameworks for inferring relationships between neural firing and features of the world. The landmark discovery of grid cells demonstrates that neurons can represent spatial…

A comprehensive artificial intelligence system needs to not only perceive the environment with different `senses' (e.g., seeing and hearing) but also infer the world's conditional (or even causal) relations and corresponding uncertainty.…

Machine Learning · Statistics 2021-01-07 Hao Wang , Dit-Yan Yeung

The success of methods based on artificial neural networks in creating intelligent machines seems like it might pose a challenge to explanations of human cognition in terms of Bayesian inference. We argue that this is not the case, and that…

Machine Learning · Computer Science 2023-11-20 Thomas L. Griffiths , Jian-Qiao Zhu , Erin Grant , R. Thomas McCoy

The multifaceted nature of subjective experience poses a challenge to the study of consciousness. Traditional neuroscientific approaches often concentrate on isolated facets, such as perceptual awareness or the global state of consciousness…