English
Related papers

Related papers: Stochastic processes with competing reinforcements

200 papers

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

We review results on linearly edge-reinforced random walks. On finite graphs, the process has the same distribution as a mixture of reversible Markov chains. This has applications in Bayesian statistics and it has been used in studying the…

Probability · Mathematics 2007-05-23 Franz Merkl , Silke W. W. Rolles

We introduce a sampling perspective to tackle the challenging task of training robust Reinforcement Learning (RL) agents. Leveraging the powerful Stochastic Gradient Langevin Dynamics, we present a novel, scalable two-player RL algorithm,…

Machine Learning · Computer Science 2020-11-09 Parameswaran Kamalaruban , Yu-Ting Huang , Ya-Ping Hsieh , Paul Rolland , Cheng Shi , Volkan Cevher

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

This thesis examines edge-reinforced random walks with some modifications to the standard definition. An overview of known results relating to the standard model is given and the proof of recurrence for the standard linearly edge-reinforced…

Probability · Mathematics 2023-09-07 Fabian Michel

We consider a system of stochastic differential equations driven by a standard n-dimensional Brownian motion where the drift coefficient satisfies a Novikov-type condition while the diffusion coefficient is the identity matrix. We define a…

Probability · Mathematics 2013-07-15 Alberto Lanconelli

The potential benefits of model-free reinforcement learning to real robotics systems are limited by its uninformed exploration that leads to slow convergence, lack of data-efficiency, and unnecessary interactions with the environment. To…

Robotics · Computer Science 2020-11-04 Yuchen Wu , Melissa Mozifian , Florian Shkurti

Identifying the trade-offs between model-based and model-free methods is a central question in reinforcement learning. Value-based methods offer substantial computational advantages and are sometimes just as statistically efficient as…

Machine Learning · Computer Science 2024-03-13 David Cheikhi , Daniel Russo

We postulates, and then show experimentally, that liquidity deficit is the driving force of the markets. In the first part of the paper a kinematic of liquidity deficit is developed. The calculus-like approach, which is based on…

Computational Finance · Quantitative Finance 2016-12-07 Vladislav Gennadievich Malyshkin , Ray Bakhramov

We introduce a new framework for the analysis of the dynamics of networks, based on randomly reinforced urn (RRU) processes, in which the weight of the edges is determined by a reinforcement mechanism. We rigorously explain the empirical…

Physics and Society · Physics 2012-03-08 Guido Caldarelli , Alessandro Chessa , Irene Crimaldi , Fabio Pammolli

We propose a novel inverse method that utilizes a set of data to construct a simple equation that governs the stochastic process for which the data have been measured, hence enabling us to reconstruct the stochastic process. As an example,…

Statistical Mechanics · Physics 2007-05-23 J. Peinke , M. Reza Rahimi Tabar , Muhammad Sahimi , F. Ghasemi

New continuous and stochastic extensions of the minority game, devised as a fundamental model for a market of competitive agents, are introduced and studied in the context of statistical physics. The new formulation reproduces the key…

Statistical Mechanics · Physics 2009-10-31 Andrea Cavagna , Juan P. Garrahan , Irene Giardina , David Sherrington

One of the main tasks in the study of financial and economic processes is forecasting and analysis of the dynamics of these processes. Within this task lie important research questions including how to determine the qualitative properties…

Chaotic Dynamics · Physics 2021-02-03 Tatyana A. Alexeeva , William A. Barnett , Nikolay V. Kuznetsov , Timur N. Mokaev

The theory of ``Markov-up'' processes is being developed. This is a new class of stochastic processes with ``partial'' markovian features; it could also be called ``one-sided Markov''. Such a behavior may be found in the real world and in…

Probability · Mathematics 2024-07-01 D. O. Kalikaeva

Reinforcement Learning and the Evolutionary Strategy are two major approaches in addressing complicated control problems. Both are strong contenders and have their own devotee communities. Both groups have been very active in developing new…

Machine Learning · Computer Science 2018-03-08 Shangtong Zhang , Osmar R. Zaiane

Applying reinforcement learning to robotic systems poses a number of challenging problems. A key requirement is the ability to handle continuous state and action spaces while remaining within a limited time and resource budget.…

Machine Learning · Computer Science 2020-06-29 Benjamin van Niekerk , Andreas Damianou , Benjamin Rosman

Stochastic reaction networks are mathematical models with a wide range of applications in biochemistry, ecology, and epidemiology, and are often complex to analyze. Except for some special cases, it is generally difficult to predict how the…

Probability · Mathematics 2026-04-02 Daniele Cappelletti , Giulio Cuniberti , Paola Siri

Exact numerical methods and stochastic simulation methods are developed to study the force stretching single RNA issue on the secondary structure level in equilibrium. By computing the force-extension curves on the constant force and the…

Biomolecules · Quantitative Biology 2016-09-08 Fei Liu , Bi-hui Zhu , Zhong-can Ou-Yang

Through many recent successes in simulation, model-free reinforcement learning has emerged as a promising approach to solving continuous control robotic tasks. The research community is now able to reproduce, analyze and build quickly on…

Machine Learning · Computer Science 2018-09-21 A. Rupam Mahmood , Dmytro Korenkevych , Gautham Vasan , William Ma , James Bergstra

Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment. To…

Machine Learning · Computer Science 2024-06-04 Shyam Sundhar Ramesh , Pier Giuseppe Sessa , Yifan Hu , Andreas Krause , Ilija Bogunovic