中文
相关论文

相关论文: Domains as Objectives: Domain-Uncertainty-Aware Po…

200 篇论文

Domain Generalization (DG) aims to enhance model robustness in unseen or distributionally shifted target domains through training exclusively on source domains. Although existing DG techniques, such as data manipulation, learning…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Hai Huang , Yan Xia , Sashuai Zhou , Hanting Wang , Shulei Wang , Zhou Zhao

While Reinforcement Learning can achieve impressive results for complex tasks, the learned policies are generally prone to fail in downstream tasks with even minor model mismatch or unexpected perturbations. Recent works have demonstrated…

机器学习 · 计算机科学 2023-05-23 Kang Xu , Yan Ma , Bingsheng Wei , Wei Li

We consider the problem of distributionally robust multimodal machine learning. Existing approaches often rely on merging modalities on the feature level (early fusion) or heuristic uncertainty modeling, which downplays modality-aware…

机器学习 · 计算机科学 2025-11-11 Peilin Yang , Yu Ma

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

机器人学 · 计算机科学 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

Deep learning models fail on cross-domain challenges if the model is oversensitive to domain-specific attributes, e.g., lightning, background, camera angle, etc. To alleviate this problem, data augmentation coupled with consistency…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Mengmeng Jing , Xiantong Zhen , Jingjing Li , Cees Snoek

Traditional reinforcement learning (RL) aims to maximize the expected total reward, while the risk of uncertain outcomes needs to be controlled to ensure reliable performance in a risk-averse setting. In this paper, we consider the problem…

机器学习 · 计算机科学 2023-01-18 Xian Yu , Siqian Shen

Reinforcement-learning (RL) agents often struggle when deployed from simulation to the real-world. A dominant strategy for reducing the sim-to-real gap is domain randomization (DR) which trains the policy across many simulators produced by…

机器学习 · 计算机科学 2026-02-05 Arnaud Fickinger , Abderrahim Bendahi , Stuart Russell

We consider reinforcement learning (RL) methods for finding optimal policies in linear quadratic (LQ) mean field control (MFC) problems over an infinite horizon in continuous time, with common noise and entropy regularization. We study…

最优化与控制 · 数学 2024-08-06 Noufel Frikha , Huyên Pham , Xuanye Song

We study risk-sensitive RL where the goal is learn a history-dependent policy that optimizes some risk measure of cumulative rewards. We consider a family of risks called the optimized certainty equivalents (OCE), which captures important…

机器学习 · 计算机科学 2025-03-03 Kaiwen Wang , Dawen Liang , Nathan Kallus , Wen Sun

Reinforcement learning (RL) has revolutionized decision-making across a wide range of domains over the past few decades. Yet, deploying RL policies in real-world scenarios presents the crucial challenge of ensuring safety. Traditional safe…

系统与控制 · 电气工程与系统科学 2024-03-26 Lunet Yifru , Ali Baheri

Humans achieve efficient learning by relying on prior knowledge about the structure of naturally occurring tasks. There is considerable interest in designing reinforcement learning (RL) algorithms with similar properties. This includes…

机器学习 · 计算机科学 2019-10-23 Jan Humplik , Alexandre Galashov , Leonard Hasenclever , Pedro A. Ortega , Yee Whye Teh , Nicolas Heess

Trustworthy machine learning aims at combating distributional uncertainties in training data distributions compared to population distributions. Typical treatment frameworks include the Bayesian approach, (min-max) distributionally robust…

机器学习 · 计算机科学 2025-05-05 Shixiong Wang , Haowei Wang , Xinke Li , Jean Honorio

Distributionally Robust Optimization (DRO) is a worst-case approach to decision making when there is model uncertainty. It is also well known that for certain uncertainty sets, DRO is approximated by a regularized nominal problem. We show…

最优化与控制 · 数学 2026-05-08 Jun-ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

How to explore corner cases as efficiently and thoroughly as possible has long been one of the top concerns in the context of deep reinforcement learning (DeepRL) autonomous driving. Training with simulated data is less costly and dangerous…

机器人学 · 计算机科学 2021-07-27 Haoyi Niu , Jianming Hu , Zheyu Cui , Yi Zhang

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

机器学习 · 统计学 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

In order to model risk aversion in reinforcement learning, an emerging line of research adapts familiar algorithms to optimize coherent risk functionals, a class that includes conditional value-at-risk (CVaR). Because optimizing the…

机器学习 · 计算机科学 2021-03-09 Audrey Huang , Liu Leqi , Zachary C. Lipton , Kamyar Azizzadenesheli

Deep learning models frequently encounter feature uncertainty in diverse learning scenarios, significantly impacting their performance and reliability. This challenge is particularly complex in multi-modal scenarios, where models must…

机器学习 · 计算机科学 2025-06-05 Jiahao Qin , Bei Peng , Feng Liu , Guangliang Cheng , Lu Zong

We introduce a new algorithm for multi-objective reinforcement learning (MORL) with linear preferences, with the goal of enabling few-shot adaptation to new tasks. In MORL, the aim is to learn policies over multiple competing objectives…

机器学习 · 计算机科学 2019-11-07 Runzhe Yang , Xingyuan Sun , Karthik Narasimhan

Robust reinforcement learning (RRL) aims at seeking a robust policy to optimize the worst case performance over an uncertainty set of Markov decision processes (MDPs). This set contains some perturbed MDPs from a nominal MDP (N-MDP) that…

机器学习 · 计算机科学 2023-11-21 Ukjo Hwang , Songnam Hong

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization objective. In contrast…

机器学习 · 计算机科学 2021-04-15 Moritz A. Zanger , Karam Daaboul , J. Marius Zöllner