English
Related papers

Related papers: On Surprising Effects of Risk-Aware Domain Randomi…

200 papers

We present structured domain randomization (SDR), a variant of domain randomization (DR) that takes into account the structure and context of the scene. In contrast to DR, which places objects and distractors randomly according to a uniform…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Aayush Prakash , Shaad Boochoon , Mark Brophy , David Acuna , Eric Cameracci , Gavriel State , Omer Shapira , Stan Birchfield

Recently, reinforcement learning (RL) algorithms have demonstrated remarkable success in learning complicated behaviors from minimally processed input. However, most of this success is limited to simulation. While there are promising…

Machine Learning · Computer Science 2019-03-29 Quan Vuong , Sharad Vikram , Hao Su , Sicun Gao , Henrik I. Christensen

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

Machine Learning · Computer Science 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

Standard deep reinforcement learning (DRL) aims to maximize expected reward, considering collected experiences equally in formulating a policy. This differs from human decision-making, where gains and losses are valued differently and…

Machine Learning · Computer Science 2023-11-17 Jared Markowitz , Ryan W. Gardner , Ashley Llorens , Raman Arora , I-Jeng Wang

Autonomous off-road driving is challenging as risky actions taken by the robot may lead to catastrophic damage. As such, developing controllers in simulation is often desirable as it provides a safer and more economical alternative.…

Robotics · Computer Science 2023-10-16 Sean J. Wang , Honghao Zhu , Aaron M. Johnson

Domain randomization is a simple, effective, and flexible scheme for obtaining robust feedback policies aimed at reducing the sim-to-real gap due to model mismatch. While domain randomization methods have yielded impressive demonstrations…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Alex Nguyen-Le , Nikolai Matni

This paper investigates the regret associated with the Distributionally Robust Control (DRC) strategies used to address multistage optimization problems where the involved probability distributions are not known exactly, but rather are…

Optimization and Control · Mathematics 2022-12-02 Venkatraman Renganathan , Dongjun Wu

Reinforcement learning (RL) has demonstrated great success in the past several years. However, most of the scenarios focus on simulated environments. One of the main challenges of transferring the policy learned in a simulated environment…

Robotics · Computer Science 2021-02-24 Ya-Yen Tsai , Hui Xu , Zihan Ding , Chong Zhang , Edward Johns , Bidan Huang

Domain randomization (DR), which entails training a policy with randomized dynamics, has proven to be a simple yet effective algorithm for reducing the gap between simulation and the real world. However, DR often requires careful tuning of…

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

As autonomous vehicles move from a simplified research setting to practical use, there exists a large gap between the dynamic behavior of a human driving and an autonomous system. Risk-aware behavior needs to naturally develop in order to…

Robotics · Computer Science 2026-05-14 Jason Gibson , Bogdan Vlahov , Patrick Spieler , Evangelos A. Theodorou

This paper presents a deep reinforcement learning (DRL) framework for dynamic portfolio optimization under market uncertainty and risk. The proposed model integrates a Sharpe ratio-based reward function with direct risk control mechanisms,…

Portfolio Management · Quantitative Finance 2025-11-17 Emmanuel Lwele , Sabuni Emmanuel , Sitali Gabriel Sitali

Recent domain generalization (DG) approaches typically use the hypothesis learned on source domains for inference on the unseen target domain. However, such a hypothesis can be arbitrarily far from the optimal one for the target domain,…

Machine Learning · Computer Science 2023-05-25 Yi-Fan Zhang , Jindong Wang , Jian Liang , Zhang Zhang , Baosheng Yu , Liang Wang , Dacheng Tao , Xing Xie

The assumption of complete domain knowledge is not warranted for robot planning and decision-making in the real world. It could be due to design flaws or arise from domain ramifications or qualifications. In such cases, existing planning…

Artificial Intelligence · Computer Science 2020-11-19 Akshay Sharma , Piyush Rajesh Medikeri , Yu Zhang

Robust planning in interactive scenarios requires predicting the uncertain future to make risk-aware decisions. Unfortunately, due to long-tail safety-critical events, the risk is often under-estimated by finite-sampling approximations of…

Machine Learning · Computer Science 2023-01-13 Haruki Nishimura , Jean Mercat , Blake Wulfe , Rowan McAllister , Adrien Gaidon

We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and…

Machine Learning · Computer Science 2023-09-12 Marin Vlastelica , Sebastian Blaes , Cristina Pineri , Georg Martius

Sufficient dimension reduction (SDR) is a popular class of regression methods which aim to find a small number of linear combinations of covariates that capture all the information of the responses i.e., a central subspace. The majority of…

Methodology · Statistics 2024-10-15 Linh H. Nghiem , F. K. C. Hui

Direct policy search serves as one of the workhorses in modern reinforcement learning (RL), and its applications in continuous control tasks have recently attracted increasing attention. In this work, we investigate the convergence theory…

Optimization and Control · Mathematics 2022-01-03 Kaiqing Zhang , Xiangyuan Zhang , Bin Hu , Tamer Başar

Reinforcement learning encounters many challenges when applied directly in the real world. Sim-to-real transfer is widely used to transfer the knowledge learned from simulation to the real world. Domain randomization -- one of the most…

Machine Learning · Computer Science 2022-03-15 Xiaoyu Chen , Jiachen Hu , Chi Jin , Lihong Li , Liwei Wang

Solving chance-constrained optimal control problems for systems subject to non-stationary uncertainties is a significant challenge.Conventional robust model predictive control (MPC) often yields excessive conservatism by relying on static…

Systems and Control · Electrical Eng. & Systems 2025-07-16 Mingcong Li