English
Related papers

Related papers: Bellman Meets Hawkes: Model-Based Reinforcement Le…

200 papers

We study the robustness of deep reinforcement learning algorithms against distribution shifts within contextual multi-stage stochastic combinatorial optimization problems from the operations research domain. In this context, risk-sensitive…

Machine Learning · Computer Science 2024-02-16 Tobias Enders , James Harrison , Maximilian Schiffer

Many events occur in the world. Some event types are stochastically excited or inhibited---in the sense of having their probabilities elevated or decreased---by patterns in the sequence of previous events. Discovering such patterns can help…

Machine Learning · Computer Science 2017-11-22 Hongyuan Mei , Jason Eisner

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Adaptation and Self-Organizing Systems · Physics 2022-04-15 Wolfram Barfuss , Richard P. Mann

In the past decade, model-free reinforcement learning (RL) has provided solutions to challenging domains such as robotics. Model-based RL shows the prospect of being more sample-efficient than model-free methods in terms of…

Machine Learning · Computer Science 2021-04-14 John McLeod , Hrvoje Stojic , Vincent Adam , Dongho Kim , Jordi Grau-Moya , Peter Vrancx , Felix Leibfried

Many recent algorithms for reinforcement learning are model-free and founded on the Bellman equation. Here we present a method founded on the costate equation and models of the state dynamics. We use the costate -- the gradient of cost with…

Machine Learning · Computer Science 2018-10-04 Bita Behrouzi , Xuefei Liu , Douglas Tweed

A temporal point process (TPP) is a stochastic process where its realization is a sequence of discrete events in time. Recent work in TPPs model the process using a neural network in a supervised learning framework, where a training set is…

Machine Learning · Computer Science 2023-01-31 Wonho Bae , Mohamed Osama Ahmed , Frederick Tung , Gabriel L. Oliveira

Active inference is a probabilistic framework for modelling the behaviour of biological and artificial agents, which derives from the principle of minimising free energy. In recent years, this framework has successfully been applied to a…

Artificial Intelligence · Computer Science 2022-07-13 Lancelot Da Costa , Noor Sajid , Thomas Parr , Karl Friston , Ryan Smith

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

Machine Learning · Computer Science 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

This study addresses the challenges of dynamics and complexity in intelligent human-computer interaction and proposes a reinforcement learning-based optimization framework to improve long-term returns and overall experience. Human-computer…

Human-Computer Interaction · Computer Science 2025-11-03 Rui Liu , Yifan Zhuang , Runsheng Zhang

Bimodal, stochastic environments present a challenge to typical Reinforcement Learning problems. This problem is one that is surprisingly common in real world applications, being particularly applicable to pricing problems. In this paper we…

Machine Learning · Computer Science 2023-07-04 E. Hurwitz , N. Peace , G. Cevora

Humans can infer accurate mechanical outcomes from only a few observations, a capability known as mechanics intuition. The mechanisms behind such data-efficient learning remain unclear. Here, we propose a reinforcement learning framework in…

Computational Physics · Physics 2026-01-30 Jingruo Peng , Shuze Zhu

While reinforcement learning has shown experimental success in a number of applications, it is known to be sensitive to noise and perturbations in the parameters of the system, leading to high variance in the total reward amongst different…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Erfaun Noorani , Christos Mavridis , John Baras

Predicting the outcomes of cyber-physical systems with multiple human interactions is a challenging problem. This article reviews a game theoretical approach to address this issue, where reinforcement learning is employed to predict the…

Multiagent Systems · Computer Science 2019-10-14 Mert Albaba , Yildiray Yildiz

We consider two data-driven approaches to hedging, Reinforcement Learning and Deep Trajectory-based Stochastic Optimal Control, under a stepwise mean-variance objective. We compare their performance for a European call option in the…

Computational Finance · Quantitative Finance 2023-11-22 Ali Fathi , Bernhard Hientzsch

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

Analysing learning in Multi-Agent Reinforcement Learning (MARL) environments is challenging, in particular with respect to \textit{individual} decision-making. Practitioners frequently struggle to compare training runs due to the inherent…

Multiagent Systems · Computer Science 2026-05-29 James Rudd-Jones , María Pérez-Ortiz , Mirco Musolesi

Deep reinforcement learning has proven remarkably useful in training agents from unstructured data. However, the opacity of the produced agents makes it difficult to ensure that they adhere to various requirements posed by human engineers.…

Machine Learning · Computer Science 2022-02-10 Raz Yerushalmi , Guy Amir , Achiya Elyasaf , David Harel , Guy Katz , Assaf Marron

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger

Reading is a process that unfolds across space and time, alternating between fixations where a reader focuses on a specific point in space, and saccades where a reader rapidly shifts their focus to a new point. An ansatz of…

Machine Learning · Computer Science 2025-06-26 Francesco Ignazio Re , Andreas Opedal , Glib Manaiev , Mario Giulianelli , Ryan Cotterell

Temporal point process serves as an essential tool for modeling time-to-event data in continuous time space. Despite having massive amounts of event sequence data from various domains like social media, healthcare etc., real world…

Machine Learning · Computer Science 2022-10-04 Manisha Dubey , P. K. Srijith , Maunendra Sankar Desarkar