English
Related papers

Related papers: Damped Anderson Mixing for Deep Reinforcement Lear…

200 papers

Multiple automakers have in development or in production automated driving systems (ADS) that offer freeway-pilot functions. This type of ADS is typically limited to restricted-access freeways only, that is, the transition from manual to…

Machine Learning · Computer Science 2019-02-05 Pin Wang , Ching-Yao Chan

Deep reinforcement learning (DRL) agents are trained through trial-and-error interactions with the environment. This leads to a long training time for dense neural networks to achieve good performance. Hence, prohibitive computation and…

Machine Learning · Computer Science 2022-05-09 Ghada Sokar , Elena Mocanu , Decebal Constantin Mocanu , Mykola Pechenizkiy , Peter Stone

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

Machine Learning · Computer Science 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

Multiple-input multiple-output (MIMO) wireless systems conventionally use high-resolution analog-to-digital converters (ADCs) at the receiver side to faithfully digitize received signals prior to digital signal processing. However, the…

Information Theory · Computer Science 2025-04-29 Marian Temprana Alonso , Dongsheng Luo , Farhad Shirani

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

Regularized nonlinear acceleration (RNA) estimates the minimum of a function by post-processing iterates from an algorithm such as the gradient method. It can be seen as a regularized version of Anderson acceleration, a classical…

Optimization and Control · Mathematics 2019-06-25 Damien Scieur , Edouard Oyallon , Alexandre d'Aspremont , Francis Bach

Deep reinforcement learning (DRL) policies have been shown to be deceived by perturbations (e.g., random noise or intensional adversarial attacks) on state observations that appear at test time but are unknown during training. To increase…

Machine Learning · Computer Science 2020-12-25 Xinghua Qu , Yew-Soon Ong , Abhishek Gupta , Zhu Sun

This paper proposes a synergy of amortised and particle-based methods for sampling from distributions defined by unnormalised density functions. We state a connection between sequential Monte Carlo (SMC) and neural sequential samplers…

Machine Learning · Computer Science 2025-10-14 Sanghyeok Choi , Sarthak Mittal , Víctor Elvira , Jinkyoo Park , Nikolay Malkin

Deep reinforcement learning (DRL) has a great potential for solving complex decision-making problems in autonomous driving, especially in mixed-traffic scenarios where autonomous vehicles and human-driven vehicles (HDVs) drive together.…

Robotics · Computer Science 2022-04-05 Qianqian Liu , Fengying Dang , Xiaofan Wang , Xiaoqiang Ren

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

We introduce a Deep Reinforcement Learning (DRL) model for the structure relaxation of crystal materials and compare different types of neural network architectures and reinforcement learning algorithms for this purpose. Experiments are…

Materials Science · Physics 2025-02-13 Elena Trukhan , Efim Mazhnik , Artem R. Oganov

In this paper, we introduce the Reinforced Mnemonic Reader for machine reading comprehension tasks, which enhances previous attentive readers in two aspects. First, a reattention mechanism is proposed to refine current attentions by…

Computation and Language · Computer Science 2018-06-07 Minghao Hu , Yuxing Peng , Zhen Huang , Xipeng Qiu , Furu Wei , Ming Zhou

Data processing and analytics are fundamental and pervasive. Algorithms play a vital role in data processing and analytics where many algorithm designs have incorporated heuristics and general rules from human knowledge and experience to…

Machine Learning · Computer Science 2022-02-07 Qingpeng Cai , Can Cui , Yiyuan Xiong , Wei Wang , Zhongle Xie , Meihui Zhang

We present a novel approach to automate and optimize anisotropic p-adaptation in high-order h/p solvers using Reinforcement Learning (RL). The dynamic RL adaptation uses the evolving solution to adjust the high-order polynomials. We develop…

BoostConv has been introduced in earlier works as an effective acceleration technique for nonlinear iterative processes and has been successfully employed in a variety of applications to enhance convergence rates or to compute unstable…

Numerical Analysis · Mathematics 2026-03-24 Vincenzo Citro , Davide Palitta

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms…

Machine Learning · Computer Science 2025-10-31 Sebastian Zieglmeier , Niklas Erdmann , Narada D. Warakagoda

The control of far-from-equilibrium physical systems, including active materials, has emerged as an important area for the application of reinforcement learning (RL) strategies to derive control policies for physical systems. In active…

Machine Learning · Computer Science 2021-12-23 Dominik Schildknecht , Anastasia N. Popova , Jack Stellwagen , Matt Thomson

In this paper, we propose a novel Anderson's acceleration method to solve nonlinear equations, which does \emph{not} require a restart strategy to achieve numerical stability. We propose the greedy and random versions of our algorithm.…

Optimization and Control · Mathematics 2024-03-26 Haishan Ye , Dachao Lin , Xiangyu Chang , Zhihua Zhang

Deep reinforcement learning methods have achieved state-of-the-art results in a variety of challenging, high-dimensional domains ranging from video games to locomotion. The key to success has been the use of deep neural networks used to…

Machine Learning · Computer Science 2020-11-17 Hiteshi Sharma , Rahul Jain

Anderson Acceleration (AA) is a method to accelerate the convergence of fixed point iterations for nonlinear, algebraic systems of equations. Due to the requirement of solving a least squares problem at each iteration and a reliance on…

Numerical Analysis · Mathematics 2023-05-08 Shelby Lockhart , David J. Gardner , Carol S. Woodward , Stephen Thomas , Luke N. Olson