English
Related papers

Related papers: A Quadratic Actor Network for Model-Free Reinforce…

200 papers

We consider the dynamic multichannel access problem, which can be formulated as a partially observable Markov decision process (POMDP). We first propose a model-free actor-critic deep reinforcement learning based framework to explore the…

Information Theory · Computer Science 2018-10-10 Chen Zhong , Ziyang Lu , M. Cenk Gursoy , Senem Velipasalar

Nonlinear biophysical properties of individual neurons are known to play a major role in the nervous system. Earlier electrophysiological studies have made use of piecewise linear characterization of voltage clamped neurons, which consists…

Neurons and Cognition · Quantitative Biology 2010-07-07 Christophe Magnani , L. E. Moore

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

Machine Learning · Computer Science 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

We propose quadratic residual networks (QRes) as a new type of parameter-efficient neural network architecture, by adding a quadratic residual term to the weighted sum of inputs before applying activation functions. With sufficiently high…

Machine Learning · Computer Science 2021-01-29 Jie Bu , Anuj Karpatne

In this paper, we present a method to control a quadrotor with a neural network trained using reinforcement learning techniques. With reinforcement learning, a common network can be trained to directly map state to actuator command making…

Robotics · Computer Science 2017-07-18 Jemin Hwangbo , Inkyu Sa , Roland Siegwart , Marco Hutter

Individuals, or organizations, cooperate with or compete against one another in a wide range of practical situations. Such strategic interactions are often modeled as games played on networks, where an individual's payoff depends not only…

Computer Science and Game Theory · Computer Science 2020-09-22 Yan Leng , Xiaowen Dong , Junfeng Wu , Alex Pentland

Actor-critic (AC) algorithms, empowered by neural networks, have had significant empirical success in recent years. However, most of the existing theoretical support for AC algorithms focuses on the case of linear function approximations,…

Machine Learning · Computer Science 2024-04-02 Yufeng Zhang , Siyu Chen , Zhuoran Yang , Michael I. Jordan , Zhaoran Wang

This paper extends the reinforcement learning ideas into the multi-agents system, which is far more complicated than the previously studied single-agent system. We studied two different multi-agents systems. One is the fully-connected…

Artificial Intelligence · Computer Science 2015-05-18 Zhipeng Wang , Mingbo Cai

We propose a reinforcement learning (RL)-based algorithm to jointly train (1) a trajectory planner and (2) a tracking controller in a layered control architecture. Our algorithm arises naturally from a rewrite of the underlying optimal…

Systems and Control · Electrical Eng. & Systems 2024-12-18 Fengjun Yang , Nikolai Matni

In this paper, we propose a new scheme for modelling the diverse behavior of neurons. We introduce the conditional activation, in which a neurons activation function is dynamically modified by a control signal. We apply this method to…

Neural and Evolutionary Computing · Computer Science 2018-03-15 Albert Lee , Bonnie Lam , Wenyuan Li , Hochul Lee , Wei-Hao Chen , Meng-Fan Chang , Kang. -L. Wang

Model-free deep reinforcement learning (RL) has been successfully applied to challenging continuous control domains. However, poor sample efficiency prevents these methods from being widely used in real-world domains. This paper introduces…

Machine Learning · Computer Science 2022-10-27 Sicen Li , Qinyun Tang , Yiming Pang , Xinmeng Ma , Gang Wang

Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even…

Machine Learning · Computer Science 2020-02-27 Gabriel I. Fernandez , Colin Togashi , Dennis W. Hong , Lin F. Yang

This paper augments the reward received by a reinforcement learning agent with potential functions in order to help the agent learn (possibly stochastic) optimal policies. We show that a potential-based reward shaping scheme is able to…

Machine Learning · Computer Science 2019-07-23 Baicen Xiao , Bhaskar Ramasubramanian , Andrew Clark , Hannaneh Hajishirzi , Linda Bushnell , Radha Poovendran

In many sequential decision making tasks, it is challenging to design reward functions that help an RL agent efficiently learn behavior that is considered good by the agent designer. A number of different formulations of the reward-design…

Artificial Intelligence · Computer Science 2018-06-25 Zeyu Zheng , Junhyuk Oh , Satinder Singh

Deep reinforcement learning yields great results for a large array of problems, but models are generally retrained anew for each new problem to be solved. Prior learning and knowledge are difficult to incorporate when training new models,…

Artificial Intelligence · Computer Science 2017-09-21 Aditya Gudimella , Ross Story , Matineh Shaker , Ruofan Kong , Matthew Brown , Victor Shnayder , Marcos Campos

In this paper, we propose actor-director-critic, a new framework for deep reinforcement learning. Compared with the actor-critic framework, the director role is added, and action classification and action evaluation are applied…

Machine Learning · Computer Science 2023-01-11 Zongwei Liu , Yonghong Song , Yuanlin Zhang

Most previous studies on multi-agent reinforcement learning focus on deriving decentralized and cooperative policies to maximize a common reward and rarely consider the transferability of trained policies to new tasks. This prevents such…

Machine Learning · Computer Science 2019-11-28 Heechang Ryu , Hayong Shin , Jinkyoo Park

Multi-agent robotic systems are increasingly operating in real-world environments in close proximity to humans, yet are largely controlled by policy models with inscrutable deep neural network representations. We introduce a method for…

Machine Learning · Computer Science 2023-02-24 Renos Zabounidis , Joseph Campbell , Simon Stepputtis , Dana Hughes , Katia Sycara

To learn approximately optimal acting policies for decision problems, modern Actor Critic algorithms rely on deep Neural Networks (DNNs) to parameterize the acting policy and greedification operators to iteratively improve it. The reliance…

We study the dynamics of optimization and the generalization properties of one-hidden layer neural networks with quadratic activation function in the over-parametrized regime where the layer width $m$ is larger than the input dimension $d$.…

Machine Learning · Computer Science 2021-03-22 Stefano Sarao Mannelli , Eric Vanden-Eijnden , Lenka Zdeborová