English
Related papers

Related papers: On Surprising Effects of Risk-Aware Domain Randomi…

200 papers

Existing research on Domain Robustness (DR) suffers from disparate setups, limited task variety, and scarce research on recent capabilities such as in-context learning. Furthermore, the common practice of measuring DR might not be fully…

Computation and Language · Computer Science 2024-04-23 Nitay Calderon , Naveh Porat , Eyal Ben-David , Alexander Chapanin , Zorik Gekhman , Nadav Oved , Vitaly Shalumov , Roi Reichart

Deep reinforcement learning with domain randomization learns a control policy in various simulations with randomized physical and sensor model parameters to become transferable to the real world in a zero-shot setting. However, a huge…

Robotics · Computer Science 2023-04-11 Yuki Kadokawa , Lingwei Zhu , Yoshihisa Tsurumine , Takamitsu Matsubara

Data-Driven Predictive Control (DDPC) has been recently proposed as an effective alternative to traditional Model Predictive Control (MPC), in that the same constrained optimization problem can be addressed without the need to explicitly…

Systems and Control · Electrical Eng. & Systems 2025-05-14 Valentina Breschi , Marco Fabris , Simone Formentin , Alessandro Chiuso

The Reinforcement Learning (RL) paradigm has been an essential tool for automating robotic tasks. Despite the advances in RL, it is still not widely adopted in the industry due to the need for an expensive large amount of robot interaction…

In dynamic programming (DP) and reinforcement learning (RL), an agent learns to act optimally in terms of expected long-term return by sequentially interacting with its environment modeled by a Markov decision process (MDP). More generally…

Machine Learning · Computer Science 2022-01-03 Mastane Achab , Gergely Neu

Given data from diverse sets of distinct distributions, domain generalization aims to learn models that generalize to unseen distributions. A common approach is designing a data-driven surrogate penalty to capture generalization and…

Machine Learning · Computer Science 2023-08-31 Ozan Sener , Vladlen Koltun

Deep reinforcement learning has the potential to train robots to perform complex tasks in the real world without requiring accurate models of the robot or its environment. A practical approach is to train agents in simulation, and then…

Machine Learning · Computer Science 2022-10-26 Tianhong Dai , Kai Arulkumaran , Tamara Gerbert , Samyakh Tukra , Feryal Behbahani , Anil Anthony Bharath

Transferring reinforcement learning policies trained in physics simulation to the real hardware remains a challenge, known as the "sim-to-real" gap. Domain randomization is a simple yet effective technique to address dynamics discrepancies…

Robotics · Computer Science 2021-04-05 Ioannis Exarchos , Yifeng Jiang , Wenhao Yu , C. Karen Liu

We propose a data-driven control method for systems with aleatoric uncertainty, for example, robot fleets with variations between agents. Our method leverages shared trajectory data to increase the robustness of the designed controller and…

Robotics · Computer Science 2024-03-25 Alexander von Rohr , Dmitrii Likhachev , Sebastian Trimpe

This work proposes a novel risk-perception-aware (RPA) control design using non-rational perception of risks associated with uncertain dynamic spatial costs. We use Cumulative Prospect Theory (CPT) to model the risk perception of a decision…

Systems and Control · Electrical Eng. & Systems 2021-09-13 Aamodh Suresh , Sonia Martinez

Cross-Domain Recommendation (CDR) is a promising paradigm inspired by transfer learning to solve the cold-start problem in recommender systems. Existing state-of-the-art CDR methods train an explicit mapping function to transfer the…

Information Retrieval · Computer Science 2024-08-07 Guohang Zeng , Qian Zhang , Guangquan Zhang , Jie Lu

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

Machine Learning · Computer Science 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen

Model-based reinforcement learning promises to learn an optimal policy from fewer interactions with the environment compared to model-free reinforcement learning by learning an intermediate model of the environment in order to predict…

Machine Learning · Computer Science 2022-06-08 Abhinav Bhatia , Philip S. Thomas , Shlomo Zilberstein

Sampling-based Model Predictive Control (MPC) is a flexible control framework that can reason about non-smooth dynamics and cost functions. Recently, significant work has focused on the use of machine learning to improve the performance of…

Robotics · Computer Science 2022-12-07 Jacob Sacks , Byron Boots

In randomized dose-finding trials, although drug exposure data form a part of key information for dose selection, the evaluation of the dose-response (DR) relationship often mainly uses DR data. We examine the benefit of…

Methodology · Statistics 2025-08-07 Jixian Wang , Zhiwei Zhang , Ram Tiwari

We explore the probabilistic foundations of shared control in complex dynamic environments. In order to do this, we formulate shared control as a random process and describe the joint distribution that governs its behavior. For…

Robotics · Computer Science 2015-08-10 Pete Trautman

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard RL. At the…

Optimization and Control · Mathematics 2023-03-27 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

Autonomous drone racing has gained attention for its potential to push the boundaries of drone navigation technologies. While much of the existing research focuses on racing in obstacle-free environments, few studies have addressed the…

Robotics · Computer Science 2024-11-08 Yueqian Liu

Ensuring safe navigation in human-populated environments is crucial for autonomous mobile robots. Although recent advances in machine learning offer promising methods to predict human trajectories in crowded areas, it remains unclear how…

Robotics · Computer Science 2024-03-11 Kanghyun Ryu , Negar Mehr