English
Related papers

Related papers: Deep Reinforcement Learning with Surrogate Agent-E…

200 papers

We propose a metalearning approach for learning gradient-based reinforcement learning (RL) algorithms. The idea is to evolve a differentiable loss function, such that an agent, which optimizes its policy to minimize this loss, will achieve…

Machine Learning · Computer Science 2018-05-01 Rein Houthooft , Richard Y. Chen , Phillip Isola , Bradly C. Stadie , Filip Wolski , Jonathan Ho , Pieter Abbeel

Stochastic gradient descent (SGD), which updates the model parameters by adding a local gradient times a learning rate at each step, is widely used in model training of machine learning algorithms such as neural networks. It is observed…

Machine Learning · Computer Science 2017-06-01 Chang Xu , Tao Qin , Gang Wang , Tie-Yan Liu

This paper introduces a principled approach for the design of a scalable general reinforcement learning agent. This approach is based on a direct approximation of AIXI, a Bayesian optimality notion for general reinforcement learning agents.…

Machine Learning · Computer Science 2010-10-04 Joel Veness , Kee Siong Ng , Marcus Hutter , David Silver

Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta reinforcement learning…

Machine Learning · Computer Science 2021-02-17 Qi Wang , Herke van Hoof

Deep reinforcement learning (RL) agents may successfully generalize to new settings if trained on an appropriately diverse set of environment and task configurations. Unsupervised Environment Design (UED) is a promising self-supervised RL…

Machine Learning · Computer Science 2022-01-17 Minqi Jiang , Michael Dennis , Jack Parker-Holder , Jakob Foerster , Edward Grefenstette , Tim Rocktäschel

Atomic-scale materials synthesis via layer deposition techniques present a unique opportunity to control material structures and yield systems that display unique functional properties that cannot be stabilized using traditional bulk…

Computational Physics · Physics 2020-06-30 Siyan Liu , Nikolay Borodinov , Lukas Vlcek , Dan Lu , Nouamane Laanait , Rama K. Vasudevan

As an emerging network model, spiking neural networks (SNNs) have aroused significant research attentions in recent years. However, the energy-efficient binary spikes do not augur well with gradient descent-based training approaches.…

Machine Learning · Computer Science 2023-04-27 Siqi Wang , Tee Hiang Cheng , Meng-Hiot Lim

We present a training pipeline for the autonomous driving task given the current camera image and vehicle speed as the input to produce the throttle, brake, and steering control output. The simulator Airsim's convenient weather and lighting…

Machine Learning · Computer Science 2019-07-17 Tianqi Wang , Dong Eui Chang

We develop a new framework for multi-agent collision avoidance problem. The framework combined traditional pathfinding algorithm and reinforcement learning. In our approach, the agents learn whether to be navigated or to take simple actions…

Multiagent Systems · Computer Science 2020-12-17 Hongda Qiu

In the domain of combat simulations in support of wargaming, the development of intelligent agents has predominantly been characterized by rule-based, scripted methodologies with deep reinforcement learning (RL) approaches only recently…

Machine Learning · Computer Science 2025-12-02 Scotty Black , Christian Darken

The increasing deployment of AI is shaping the future landscape of the internet, which is set to become an integrated ecosystem of AI agents. Orchestrating the interaction among AI agents necessitates decentralized, self-sustaining…

Computer Science and Game Theory · Computer Science 2024-10-08 Dima Ivanov , Paul Dütting , Inbal Talgam-Cohen , Tonghan Wang , David C. Parkes

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We…

Multiagent Systems · Computer Science 2018-08-02 Aditya Grover , Maruan Al-Shedivat , Jayesh K. Gupta , Yura Burda , Harrison Edwards

To overcome the sim-to-real gap in reinforcement learning (RL), learned policies must maintain robustness against environmental uncertainties. While robust RL has been widely studied in single-agent regimes, in multi-agent environments, the…

Machine Learning · Computer Science 2024-05-10 Laixi Shi , Eric Mazumdar , Yuejie Chi , Adam Wierman

In reinforcement learning, reward shaping is an efficient way to guide the learning process of an agent, as the reward can indicate the optimal policy of the task. The potential-based reward shaping framework was proposed to guarantee…

Robotics · Computer Science 2024-02-08 Yifei Chen , Lambert Schomaker , Francisco Cruz

Evolutionary Algorithms (EAs) and Deep Reinforcement Learning (DRL) have recently been integrated to take the advantage of the both methods for better exploration and exploitation.The evolutionary part in these hybrid methods maintains a…

Neural and Evolutionary Computing · Computer Science 2022-09-19 Yan Ma , Tianxing Liu , Bingsheng Wei , Yi Liu , Kang Xu , Wei Li

Heave compensation is an essential part in various offshore operations. It is used in various applications, which include on-loading or off-loading systems, offshore drilling, landing helicopter on oscillating structures, and deploying and…

Systems and Control · Electrical Eng. & Systems 2021-07-26 Shrenik Zinage , Abhilash Somayajula

We introduce Sophisticated Learning (SL), a planning-to-learn algorithm that embeds active parameter learning inside the Sophisticated Inference (SI) tree-search framework of Active Inference. Unlike SI -- which optimizes beliefs about…

Artificial Intelligence · Computer Science 2025-08-18 Rowan Hodson , Bruce Bassett , Charel van Hoof , Benjamin Rosman , Mark Solms , Jonathan P. Shock , Ryan Smith

Policy gradient methods have been successfully applied to many complex reinforcement learning problems. However, policy gradient methods suffer from high variance, slow convergence, and inefficient exploration. In this work, we introduce a…

Machine Learning · Computer Science 2017-04-11 Yang Liu , Prajit Ramachandran , Qiang Liu , Jian Peng

We address the solution of large-scale Bayesian optimal experimental design (OED) problems governed by partial differential equations (PDEs) with infinite-dimensional parameter fields. The OED problem seeks to find sensor locations that…

Numerical Analysis · Mathematics 2022-09-07 Keyi Wu , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Deep reinforcement learning has achieved many recent successes, but our understanding of its strengths and limitations is hampered by the lack of rich environments in which we can fully characterize optimal behavior, and correspondingly…

Artificial Intelligence · Computer Science 2018-07-02 Maithra Raghu , Alex Irpan , Jacob Andreas , Robert Kleinberg , Quoc V. Le , Jon Kleinberg