中文
相关论文

相关论文: CACTO-BIC: Scalable Actor-Critic Learning via Bias…

200 篇论文

Trajectory optimization (TO) is one of the most powerful tools for generating feasible motions for humanoid robots. However, including uncertainties and stochasticity in the TO problem to generate robust motions can easily lead to…

\Ac{MPC} and \ac{RL} are two powerful control strategies with, arguably, complementary advantages. In this work, we show how actor-critic \ac{RL} techniques can be leveraged to improve the performance of \ac{MPC}. The \ac{RL} critic is used…

系统与控制 · 电气工程与系统科学 2024-06-07 Rudolf Reiter , Andrea Ghezzi , Katrin Baumgärtner , Jasper Hoffmann , Robert D. McAllister , Moritz Diehl

Due to their complex nonlinear dynamics and batch-to-batch variability, batch processes pose a challenge for process control. Due to the absence of accurate models and resulting plant-model mismatch, these problems become harder to address…

机器学习 · 计算机科学 2022-05-03 Tanuja Joshi , Hariprasad Kodamana , Harikumar Kandath , Niket Kaisare

Optimization-based samplers such as randomize-then-optimize (RTO) [2] provide an efficient and parallellizable approach to solving large-scale Bayesian inverse problems. These methods solve randomly perturbed optimization problems to draw…

统计计算 · 统计学 2019-10-29 Johnathan Bardsley , Tiangang Cui , Youssef Marzouk , Zheng Wang

Intelligent robots provide a new insight into efficiency improvement in industrial and service scenarios to replace human labor. However, these scenarios include dense and dynamic obstacles that make motion planning of robots challenging.…

机器人学 · 计算机科学 2021-02-08 Chengmin Zhou , Bingding Huang , Pasi Fränti

The problem of constrained reinforcement learning (CRL) holds significant importance as it provides a framework for addressing critical safety satisfaction concerns in the field of reinforcement learning (RL). However, with the introduction…

机器学习 · 计算机科学 2023-05-24 Chengbin Xuan , Feng Zhang , Faliang Yin , Hak-Keung Lam

Policy search can in principle acquire complex strategies for control of robots and other autonomous systems. When the policy is trained to process raw sensory inputs, such as images and depth maps, it can also acquire a strategy that…

机器学习 · 计算机科学 2017-02-28 Gregory Kahn , Tianhao Zhang , Sergey Levine , Pieter Abbeel

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

机器学习 · 计算机科学 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

Being able to solve a task in diverse ways makes agents more robust to task variations and less prone to local optima. In this context, constrained diversity optimization has become a useful reinforcement learning (RL) framework for…

机器学习 · 计算机科学 2026-05-13 Cornelius V. Braun , Sayantan Auddy , Marc Toussaint

In safety-critical domains, reinforcement learning (RL) agents must often satisfy strict, zero-cost safety constraints while accomplishing tasks. Existing model-free methods frequently either fail to achieve near-zero safety violations or…

机器学习 · 计算机科学 2026-05-11 Dominik Wagner , Ankit Kanwar , Luke Ong

Machine learning has shown tremendous potential for improving the capabilities of network traffic analysis applications, often outperforming simpler rule-based heuristics. However, ML-based solutions remain difficult to deploy in practice.…

网络与互联网体系结构 · 计算机科学 2025-05-02 Gerry Wan , Shinan Liu , Francesco Bronzino , Nick Feamster , Zakir Durumeric

Continuous control tasks in reinforcement learning are important because they provide an important framework for learning in high-dimensional state spaces with deceptive rewards, where the agent can easily become trapped into suboptimal…

机器学习 · 计算机科学 2020-07-10 Thang Doan , Bogdan Mazoure , Moloud Abdar , Audrey Durand , Joelle Pineau , R Devon Hjelm

We present temporally abstract actor-critic (TAAC), a simple but effective off-policy RL algorithm that incorporates closed-loop temporal abstraction into the actor-critic framework. TAAC adds a second-stage binary policy to choose between…

机器学习 · 计算机科学 2021-10-13 Haonan Yu , Wei Xu , Haichao Zhang

Large-scale training have propelled significant progress in various sub-fields of AI such as computer vision and natural language processing. However, building robot learning systems at a comparable scale remains challenging. To develop…

机器人学 · 计算机科学 2023-02-17 Zhao Mandi , Homanga Bharadhwaj , Vincent Moens , Shuran Song , Aravind Rajeswaran , Vikash Kumar

Reinforcement learning (RL) actor-critic algorithms enable autonomous learning but often require a large number of environment interactions, which limits their applicability in robotics. Leveraging expert data can reduce the number of…

机器学习 · 计算机科学 2026-03-02 Andreas Kernbach , Amr Elsheikh , Nicolas Grupp , René Nagel , Marco F. Huber

Neural implicit mapping has emerged as a powerful paradigm for robotic navigation and scene understanding. However, real-world robotic deployment requires continual adaptation to changing environments under strict memory and computation…

机器人学 · 计算机科学 2026-05-29 Xunlan Zhou , Hongrui Zhao , Negar Mehr

Continuous control Deep Reinforcement Learning (RL) approaches are known to suffer from estimation biases, leading to suboptimal policies. This paper introduces innovative methods in RL, focusing on addressing and exploiting estimation…

机器学习 · 计算机科学 2024-10-14 Niccolò Turcato , Alberto Sinigaglia , Alberto Dalla Libera , Ruggero Carli , Gian Antonio Susto

Trajectory optimization (TO) is one of the most powerful tools for generating feasible motions for humanoid robots. However, including uncertainties and stochasticity in the TO problem to generate robust motions can easily lead to an…

机器人学 · 计算机科学 2019-06-11 Majid Khadiv , Mohammad Hasan Yeganegi , S. Ali A. Moosavian , Jia-Jie Zhu , Ludovic Righetti

Reinforcement learning (RL) has achieved promising results on most robotic control tasks. Safety of learning-based controllers is an essential notion of ensuring the effectiveness of the controllers. Current methods adopt whole consistency…

机器人学 · 计算机科学 2023-07-31 Haotian Xu , Shengjie Wang , Zhaolei Wang , Yunzhe Zhang , Qing Zhuo , Yang Gao , Tao Zhang

Warm-Start reinforcement learning (RL), aided by a prior policy obtained from offline training, is emerging as a promising RL approach for practical applications. Recent empirical studies have demonstrated that the performance of Warm-Start…

机器学习 · 计算机科学 2023-06-21 Hang Wang , Sen Lin , Junshan Zhang