中文
相关论文

相关论文: Physics-Guided Actor-Critic Reinforcement Learning…

200 篇论文

In this work, we propose Behavior-Guided Actor-Critic (BAC), an off-policy actor-critic deep RL algorithm. BAC mathematically formulates the behavior of the policy through autoencoders by providing an accurate estimation of how frequently…

机器学习 · 计算机科学 2021-04-12 Ammar Fayad , Majd Ibrahim

Accurate characterization of subsurface heterogeneity is challenging but essential for applications such as reservoir pressure management, geothermal energy extraction and CO$_2$, H$_2$, and wastewater injection operations. This challenge…

机器学习 · 计算机科学 2026-04-16 Harun Ur Rashid , Mingxin Li , Aleksandra Pachalieva , Georg Stadler , Daniel O'Malley

In a reinforcement learning (RL) setting, the agent's optimal strategy heavily depends on her risk preferences and the underlying model dynamics of the training environment. These two aspects influence the agent's ability to make…

机器学习 · 计算机科学 2025-09-23 Anthony Coache , Sebastian Jaimungal

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include models such as…

机器学习 · 计算机科学 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

We study robust reinforcement learning (RL) with the goal of determining a well-performing policy that is robust against model mismatch between the training simulator and the testing environment. Previous policy-based robust RL algorithms…

机器学习 · 计算机科学 2023-12-12 Ruida Zhou , Tao Liu , Min Cheng , Dileep Kalathil , P. R. Kumar , Chao Tian

Learning and reasoning about physical phenomena is still a challenge in robotics development, and computational sciences play a capital role in the search for accurate methods able to provide explanations for past events and rigorous…

计算机视觉与模式识别 · 计算机科学 2022-09-12 Beatriz Moya , Alberto Badias , David Gonzalez , Francisco Chinesta , Elias Cueto

The use of machine learning in fluid dynamics is becoming more common to expedite the computation when solving forward and inverse problems of partial differential equations. Yet, a notable challenge with existing convolutional neural…

流体动力学 · 物理学 2024-05-10 Siming Shan , Pengkai Wang , Song Chen , Jiaxu Liu , Chao Xu , Shengze Cai

The hierarchical interaction between the actor and critic in actor-critic based reinforcement learning algorithms naturally lends itself to a game-theoretic interpretation. We adopt this viewpoint and model the actor and critic interaction…

机器学习 · 计算机科学 2021-09-28 Liyuan Zheng , Tanner Fiez , Zane Alumbaugh , Benjamin Chasnov , Lillian J. Ratliff

We explore deep reinforcement learning methods for multi-agent domains. We begin by analyzing the difficulty of traditional algorithms in the multi-agent case: Q-learning is challenged by an inherent non-stationarity of the environment,…

机器学习 · 计算机科学 2020-03-17 Ryan Lowe , Yi Wu , Aviv Tamar , Jean Harb , Pieter Abbeel , Igor Mordatch

Physics-informed deep learning has drawn tremendous interest in recent years to solve computational physics problems, whose basic concept is to embed physical laws to constrain/inform neural networks, with the need of less data for training…

流体动力学 · 物理学 2020-11-24 Chengping Rao , Hao Sun , Yang Liu

A widely-studied deep reinforcement learning (RL) technique known as Prioritized Experience Replay (PER) allows agents to learn from transitions sampled with non-uniform probability proportional to their temporal-difference (TD) error.…

机器学习 · 计算机科学 2022-09-02 Baturay Saglam , Furkan B. Mutlu , Dogan C. Cicek , Suleyman S. Kozat

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

机器学习 · 计算机科学 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

The forcing of particles in turbulent environments influences dynamical properties pertinent to many fundamental applications involving particle-flow interactions. Current study explores the determination of forcing for one-way coupled…

流体动力学 · 物理学 2026-02-17 Daniel Domínguez-Vázquez , Qi Wang , Gustaaf B. Jacobs

A physics-informed neural network (PINN), which has been recently proposed by Raissi et al [J. Comp. Phys. 378, pp. 686-707 (2019)], is applied to the partial differential equation (PDE) of liquid film flows. The PDE considered is the time…

Despite definite success in deep reinforcement learning problems, actor-critic algorithms are still confronted with sample inefficiency in complex environments, particularly in tasks where efficient exploration is a bottleneck. These…

机器学习 · 计算机科学 2021-02-09 Yannis Flet-Berliac , Johan Ferret , Olivier Pietquin , Philippe Preux , Matthieu Geist

Data-driven methods for physics-based character control using reinforcement learning have been successfully applied to generate high-quality motions. However, existing approaches typically rely on Gaussian distributions to represent the…

机器学习 · 计算机科学 2021-10-06 Pei Xu , Ioannis Karamouzas

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

机器学习 · 计算机科学 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

The dataset distributions in offline reinforcement learning (RL) often exhibit complex and multi-modal distributions, necessitating expressive policies to capture such distributions beyond widely-used Gaussian policies. To handle such…

机器学习 · 计算机科学 2026-02-23 Jongseong Chae , Jongeui Park , Yongjae Shin , Gyeongmin Kim , Seungyul Han , Youngchul Sung

Navigating in a fluid flow while being carried by it, using only information accessible from on-board sensors, is a problem commonly faced by small planktonic organisms. It is also directly relevant to autonomous robots deployed in the…

机器学习 · 计算机科学 2025-10-28 Selim Mecanna , Aurore Loisy , Christophe Eloy

Real-life control tasks involve matters of various substances---rigid or soft bodies, liquid, gas---each with distinct physical behaviors. This poses challenges to traditional rigid-body physics engines. Particle-based simulators have been…

机器学习 · 计算机科学 2019-04-19 Yunzhu Li , Jiajun Wu , Russ Tedrake , Joshua B. Tenenbaum , Antonio Torralba