English
Related papers

Related papers: Robot Learning with Crash Constraints

200 papers

Shifting from traditional control strategies to Deep Reinforcement Learning (RL) for legged robots poses inherent challenges, especially when addressing real-world physical constraints during training. While high-fidelity simulations…

Robotics · Computer Science 2023-09-28 Joonho Lee , Lukas Schroth , Victor Klemm , Marko Bjelonic , Alexander Reske , Marco Hutter

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

Robot decision-making increasingly relies on data-driven human prediction models when operating around people. While these models are known to mispredict in out-of-distribution interactions, only a subset of prediction errors impact…

Robotics · Computer Science 2024-11-12 Kensuke Nakamura , Ran Tian , Andrea Bajcsy

In the area of physical simulations, nearly all neural-network-based methods directly predict future states from the input states. However, many traditional simulation engines instead model the constraints of the system and select the state…

Machine Learning · Computer Science 2022-01-31 Yulia Rubanova , Alvaro Sanchez-Gonzalez , Tobias Pfaff , Peter Battaglia

Learning from Demonstration allows robots to mimic human actions. However, these methods do not model constraints crucial to ensure safety of the learned skill. Moreover, even when explicitly modelling constraints, they rely on the…

Robotics · Computer Science 2025-01-09 Shivam Chaubey , Francesco Verdoja , Ville Kyrki

This paper develops a Closed-Loop Error Learning Control (CLELC) algorithm for feedback linearizable systems with experimental validation on a mobile robot. Traditional feedback and feedforward controllers are designed based on the nominal…

Robotics · Computer Science 2021-03-17 Erkan Kayacan

We study the navigation problem for a robot moving amidst static and dynamic obstacles and rely on a hierarchical approach to solve it. First, the reference trajectory is planned by the safe interval path planning algorithm that is capable…

Robotics · Computer Science 2019-06-18 Konstantin Yakovlev , Anton Andreychuk , Juliya Belinskaya , Dmitry Makarov

Action-constrained reinforcement learning (RL) is a widely-used approach in various real-world applications, such as scheduling in networked systems with resource constraints and control of a robot with kinematic constraints. While the…

Machine Learning · Computer Science 2021-08-03 Jyun-Li Lin , Wei Hung , Shang-Hsuan Yang , Ping-Chun Hsieh , Xi Liu

Multi-task Vehicle Routing Problems (VRPs) aim to minimize routing costs while satisfying diverse constraints. Existing solvers typically adopt a unified reinforcement learning (RL) framework to learn generalizable patterns across tasks.…

Artificial Intelligence · Computer Science 2026-03-03 Shuangchun Gui , Suyu Liu , Xuehe Wang , Zhiguang Cao

This study presents a novel methodology incorporating safety constraints into a robotic simulation during the training of deep reinforcement learning (DRL). The framework integrates specific parts of the safety requirements, such as…

When deploying machine learning solutions, they must satisfy multiple requirements beyond accuracy, such as fairness, robustness, or safety. These requirements are imposed during training either implicitly, using penalties, or explicitly,…

Machine Learning · Computer Science 2024-01-12 Ignacio Hounie , Alejandro Ribeiro , Luiz F. O. Chamon

Machine learning (ML) algorithms are remarkably good at approximating complex non-linear relationships. Most ML training processes, however, are designed to deliver ML tools with good average performance, but do not offer any guarantees…

Machine Learning · Computer Science 2022-12-22 Rahul Nellikkath , Spyros Chatzivasileiadis

Continual learning (CL) aims to develop techniques by which a single model adapts to an increasing number of tasks encountered sequentially, thereby potentially leveraging learnings across tasks in a resource-efficient manner. A major…

Machine Learning · Computer Science 2022-04-18 Rishabh Tiwari , Krishnateja Killamsetty , Rishabh Iyer , Pradeep Shenoy

This paper considers online convex optimization with long term constraints, where constraints can be violated in intermediate rounds, but need to be satisfied in the long run. The cumulative constraint violation is used as the metric to…

Machine Learning · Computer Science 2021-06-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Tianyou Chai , Karl H. Johansson

Action-constrained reinforcement learning (ACRL) is a generic framework for learning control policies with zero action constraint violation, which is required by various safety-critical and resource-constrained applications. The existing…

Machine Learning · Computer Science 2025-03-18 Wei Hung , Shao-Hua Sun , Ping-Chun Hsieh

Despite rapid progress in Vision-Language-Action (VLA) models for robotic control, instruction drift remains a persistent failure mode in long-horizon tasks. This paper reconceptualizes this phenomenon, positing that instruction drift is…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Mingsheng Shang

Constrained Reinforcement Learning (CRL) tackles sequential decision-making problems where agents are required to achieve goals by maximizing the expected return while meeting domain-specific constraints, which are often formulated as…

Machine Learning · Computer Science 2024-11-13 Alessandro Montenegro , Marco Mussi , Matteo Papini , Alberto Maria Metelli

Most reinforcement learning(RL)-based methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed. This challenge stems from the need to balance racing speed…

Robotics · Computer Science 2025-12-12 Feng Yu , Yu Hu , Yang Su , Yang Deng , Linzuo Zhang , Danping Zou

Safety is a fundamental challenge in reinforcement learning (RL), particularly in real-world applications such as autonomous driving, robotics, and healthcare. To address this, Constrained Markov Decision Processes (CMDPs) are commonly used…

Machine Learning · Computer Science 2026-02-18 Chang Liu , Yunfan Li , Lin F. Yang

Rare but critical events in complex systems, such as protein folding, chemical reactions, disease progression, and extreme weather or climate phenomena, are governed by complex, high-dimensional, stochastic dynamics. Identifying an optimal…

Chemical Physics · Physics 2026-03-04 Polina V. Banushkina , Sergei V. Krivov