English
Related papers

Related papers: Robust Behavior Cloning Via Global Lipschitz Regul…

200 papers

Despite the recent success of reinforcement learning in various domains, these approaches remain, for the most part, deterringly sensitive to hyper-parameters and are often riddled with essential engineering feats allowing their success. We…

Machine Learning · Computer Science 2023-10-26 Lionel Blondé , Pablo Strasser , Alexandros Kalousis

In spite of great advancements of machine reading comprehension (RC), existing RC models are still vulnerable and not robust to different types of adversarial examples. Neural models over-confidently predict wrong answers to semantic…

Computation and Language · Computer Science 2019-11-19 Mantong Zhou , Minlie Huang , Xiaoyan Zhu

Contact-rich manipulation plays an important role in human daily activities, but uncertain parameters pose significant challenges for robots to achieve comparable performance through planning and control. To address this issue, domain…

Robotics · Computer Science 2024-10-16 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Recent work has shown that representation learning plays a critical role in sample-efficient reinforcement learning (RL) from pixels. Unfortunately, in real-world scenarios, representation learning is usually fragile to task-irrelevant…

Machine Learning · Computer Science 2023-02-27 Qiyuan Liu , Qi Zhou , Rui Yang , Jie Wang

In this work, we present a lightweight pipeline for robust behavioral cloning of a human driver using end-to-end imitation learning. The proposed pipeline was employed to train and deploy three distinct driving behavior models onto a…

Robotics · Computer Science 2021-10-19 Tanmay Vilas Samak , Chinmay Vilas Samak , Sivanathan Kandhasamy

Behavioral cloning reduces policy learning to supervised learning by training a discriminative model to predict expert actions given observations. Such discriminative models are non-causal: the training procedure is unaware of the causal…

Machine Learning · Computer Science 2019-11-05 Pim de Haan , Dinesh Jayaraman , Sergey Levine

Model Predictive Control (MPC) has been demonstrated to be effective in continuous control tasks. When a world model and a value function are available, planning a sequence of actions ahead of time leads to a better policy. Existing methods…

Machine Learning · Computer Science 2025-04-07 Yuhang Wang , Hanwei Guo , Sizhe Wang , Long Qian , Xuguang Lan

A key challenge towards reliable robotic control is devising computational models that can both learn policies and guarantee robustness when deployed in the field. Inspired by the free energy principle in computational neuroscience, to…

Robotics · Computer Science 2026-03-10 Hozefa Jesawada , Giovanni Russo , Abdalla Swikir , Fares Abu-Dakka

Robust reinforcement learning (RL) aims to find a policy that optimizes the worst-case performance in the face of uncertainties. In this paper, we focus on action robust RL with the probabilistic policy execution uncertainty, in which,…

Machine Learning · Computer Science 2023-07-21 Guanlin Liu , Zhihan Zhou , Han Liu , Lifeng Lai

Certified robustness is a critical property for deploying neural networks (NN) in safety-critical applications. A principle approach to achieving such guarantees is to constrain the global Lipschitz constant of the network. However,…

Machine Learning · Computer Science 2025-07-01 Zain ul Abdeen , Vassilis Kekatos , Ming Jin

The inherent complexity of living cells as production units creates major challenges for maintaining stable and optimal bioprocess conditions, especially in open Photobioreactors (PBRs) exposed to fluctuating environments. To address this,…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Juan D. Gil , Ehecatl Antonio Del Rio Chanona , José L. Guzmán , Manuel Berenguel

Offline reinforcement learning has received extensive attention from scholars because it avoids the interaction between the agent and the environment by learning a policy through a static dataset. However, general reinforcement learning…

Machine Learning · Computer Science 2026-02-12 Yi Shen , Hanyan Huang

Behavioral cloning is a simple yet effective technique for learning sequential decision-making from demonstrations. Recently, it has gained prominence as the core of foundation models for the physical world, where achieving generalization…

Robotics · Computer Science 2025-10-29 Ev Zisselman , Mirco Mutti , Shelly Francis-Meretzki , Elisei Shafer , Aviv Tamar

The robustness of neural networks against input perturbations with bounded magnitude represents a serious concern in the deployment of deep learning models in safety-critical systems. Recently, the scientific community has focused on…

Machine Learning · Computer Science 2023-11-29 Bernd Prach , Fabio Brau , Giorgio Buttazzo , Christoph H. Lampert

We present a learning algorithm for training a single policy that imitates multiple gaits of a walking robot. To achieve this, we use and extend MPC-Net, which is an Imitation Learning approach guided by Model Predictive Control (MPC). The…

Robotics · Computer Science 2021-12-01 Alexander Reske , Jan Carius , Yuntao Ma , Farbod Farshidian , Marco Hutter

The tremendous success of behavior cloning (BC) in robotic manipulation has been largely confined to tasks where demonstrations can be effectively collected through human teleoperation. However, demonstrations for contact-rich manipulation…

Robotics · Computer Science 2025-04-29 Huaijiang Zhu , Tong Zhao , Xinpei Ni , Jiuguang Wang , Kuan Fang , Ludovic Righetti , Tao Pang

In many settings, it is desirable to learn decision-making and control policies through learning or bootstrapping from expert demonstrations. The most common approaches under this Imitation Learning (IL) framework are Behavioural Cloning…

Machine Learning · Computer Science 2019-11-07 Seyed Kamyar Seyed Ghasemipour , Richard Zemel , Shixiang Gu

Behavior cloning has shown promise for robot manipulation, but real-world demonstrations are costly to acquire at scale. While simulated data offers a scalable alternative, particularly with advances in automated demonstration generation,…

Robotics · Computer Science 2026-01-19 Shuo Cheng , Liqian Ma , Zhenyang Chen , Ajay Mandlekar , Caelan Garrett , Danfei Xu

Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment…

Robotics · Computer Science 2024-11-26 Marcel Torne , Anthony Simeonov , Zechu Li , April Chan , Tao Chen , Abhishek Gupta , Pulkit Agrawal