English
Related papers

Related papers: Deep Active Inference as Variational Policy Gradie…

200 papers

We develop a novel data-driven approach to the inverse problem of classical statistical mechanics: given experimental data on the collective motion of a classical many-body system, how does one characterise the free energy landscape of that…

Statistical Mechanics · Physics 2022-03-01 Peter Yatsyshin , Serafim Kalliadasis , Andrew B. Duncan

Deep reinforcement learning, applied to vision-based problems like Atari games, maps pixels directly to actions; internally, the deep neural network bears the responsibility of both extracting useful information and making decisions based…

Machine Learning · Computer Science 2019-03-05 Giuseppe Cuccu , Julian Togelius , Philippe Cudre-Mauroux

Deep Reinforcement Learning (Deep RL) has had incredible achievements on high dimensional problems, yet its learning process remains unstable even on the simplest tasks. Deep RL uses neural networks as function approximators. These neural…

Machine Learning · Computer Science 2022-10-18 Riccardo Della Vecchia , Alena Shilova , Philippe Preux , Riad Akrour

Simplicity is a critical inductive bias for designing data-driven controllers, especially when robustness is important. Despite the impressive results of deep reinforcement learning in complex control tasks, it is prone to capturing…

Machine Learning · Computer Science 2025-05-09 Bang You , Chenxu Wang , Huaping Liu

Preference-based reinforcement learning has gained prominence as a strategy for training agents in environments where the reward signal is difficult to specify or misaligned with human intent. However, its effectiveness is often limited by…

Machine Learning · Computer Science 2025-08-27 Jonathan Erskine , Taku Yamagata , Raúl Santos-Rodríguez

Traditional model-based reinforcement learning approaches learn a model of the environment dynamics without explicitly considering how it will be used by the agent. In the presence of misspecified model classes, this can lead to poor…

Machine Learning · Computer Science 2020-10-20 Pierluca D'Oro , Alberto Maria Metelli , Andrea Tirinzoni , Matteo Papini , Marcello Restelli

Active systems across scales, ranging from molecular machines to human crowds, are usually modeled as assemblies of self-propelled particles driven by internally generated forces. However, these models often assume memoryless dynamics and…

Statistical Mechanics · Physics 2025-12-10 Marc Besse , Raphaël Voituriez

Active Inference (AIF) is an emerging framework in the brain sciences which suggests that biological agents act to minimise a variational bound on model evidence. Control-as-Inference (CAI) is a framework within reinforcement learning which…

Artificial Intelligence · Computer Science 2020-06-30 Beren Millidge , Alexander Tschantz , Anil K Seth , Christopher L Buckley

Bayesian inference plays an important role in advancing machine learning, but faces computational challenges when applied to complex models such as deep neural networks. Variational inference circumvents these challenges by formulating…

Machine Learning · Statistics 2018-08-03 Mohammad Emtiyaz Khan , Didrik Nielsen

Robots in uncertain real-world environments must perform both goal-directed and exploratory actions. However, most deep learning-based control methods neglect exploration and struggle under uncertainty. To address this, we adopt deep active…

Robotics · Computer Science 2025-12-02 Kentaro Fujii , Shingo Murata

Deep feedforward neural networks (DFNNs) are a powerful tool for functional approximation. We describe flexible versions of generalized linear and generalized linear mixed models incorporating basis functions formed by a DFNN. The…

Computation · Statistics 2018-05-28 Minh-Ngoc Tran , Nghia Nguyen , David Nott , Robert Kohn

Many decision-making problems feature multiple objectives. In such problems, it is not always possible to know the preferences of a decision-maker for different objectives. However, it is often possible to observe the behavior of…

Artificial Intelligence · Computer Science 2023-04-28 Junlin Lu , Patrick Mannion , Karl Mason

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

Machine Learning · Computer Science 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

Empowerment, an information-theoretic measure of an agent's potential influence on its environment, has emerged as a powerful intrinsic motivation and exploration framework for reinforcement learning (RL). Besides for unsupervised RL and…

Artificial Intelligence · Computer Science 2025-10-08 Moritz Schneider , Robert Krug , Narunas Vaskevicius , Luigi Palmieri , Michael Volpp , Joschka Boedecker

We propose a new active learning strategy designed for deep neural networks. The goal is to minimize the number of data annotation queried from an oracle during training. Previous active learning strategies scalable for deep networks were…

Machine Learning · Computer Science 2018-02-28 Melanie Ducoffe , Frederic Precioso

We describe a framework of hybrid cognition by formulating a hybrid cognitive agent that performs hierarchical active inference across a human and a machine part. We suggest that, in addition to enhancing human cognitive functions with an…

Artificial Intelligence · Computer Science 2018-10-08 André Ofner , Sebastian Stober

Reinforcement learning is a growing field in AI with a lot of potential. Intelligent behavior is learned automatically through trial and error in interaction with the environment. However, this learning process is often costly. Using…

Quantum Physics · Physics 2023-12-08 Nico Meyer , Daniel D. Scherer , Axel Plinge , Christopher Mutschler , Michael J. Hartmann

Recent advances in theoretical biology suggest that basal cognition and sentient behaviour are emergent properties of in vitro cell cultures and neuronal networks, respectively. Such neuronal networks spontaneously learn structured…

Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately.…

Methodology · Statistics 2023-08-11 Snigdha Panigrahi , Natasha Stewart , Chandra Sekhar Sripada , Elizaveta Levina

Active inference introduces a theory describing action-perception loops via the minimisation of variational (and expected) free energy or, under simplifying assumptions, (weighted) prediction error. Recently, active inference has been…

Neurons and Cognition · Quantitative Biology 2022-03-10 Manuel Baltieri , Christopher L. Buckley , Jelle Bruineberg