English
Related papers

Related papers: Risk-averse Batch Active Inverse Reward Design

200 papers

Real-world applications require a robot operating in the physical world with awareness of potential risks besides accomplishing the task. A large part of risky behaviors arises from interacting with objects in ignorance of affordance. To…

Robotics · Computer Science 2022-06-28 Meng Song , Yuhan Liu , Zhengqin Li , Manmohan Chandraker

Metamaterials with functional responses can exhibit varying properties under different conditions (e.g., wave-based responses or deformation-induced property variation). This work addresses the rapid inverse design of such metamaterials to…

Optics · Physics 2026-04-21 Wei "Wayne" Chen , Rachel Sun , Doksoo Lee , Carlos M. Portela , Wei Chen

Bayesian inference over the reward presents an ideal solution to the ill-posed nature of the inverse reinforcement learning problem. Unfortunately current methods generally do not scale well beyond the small tabular setting due to the need…

Machine Learning · Computer Science 2021-03-15 Alex J. Chan , Mihaela van der Schaar

Data generation and labeling are usually an expensive part of learning for robotics. While active learning methods are commonly used to tackle the former problem, preference-based learning is a concept that attempts to solve the latter by…

Machine Learning · Computer Science 2018-10-11 Erdem Bıyık , Dorsa Sadigh

Learning a reward function from demonstrations suffers from low sample-efficiency. Even with abundant data, current inverse reinforcement learning methods that focus on learning from a single environment can fail to handle slight changes in…

Machine Learning · Computer Science 2024-05-15 Thomas Kleine Buening , Victor Villin , Christos Dimitrakakis

Reward functions are central in reinforcement learning (RL), guiding agents towards optimal decision-making. The complexity of RL tasks requires meticulously designed reward functions that effectively drive learning while avoiding…

Machine Learning · Computer Science 2025-03-31 Rati Devidze

The goal of inverse reinforcement learning (IRL) is to infer a reward function that explains the behavior of an agent performing a task. The assumption that most approaches make is that the demonstrated behavior is near-optimal. In many…

Machine Learning · Computer Science 2020-11-20 Luis Haug , Ivan Ovinnikov , Eugene Bykovets

World models simulate dynamic environments, enabling agents to interact with diverse input modalities. Although recent advances have improved the visual quality and temporal consistency of video world models, their ability of accurately…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yang Ye , Tianyu He , Shuo Yang , Jiang Bian

A long-standing goal of reinforcement learning is to acquire agents that can learn on training tasks and generalize well on unseen tasks that may share a similar dynamic but with different reward functions. The ability to generalize across…

Machine Learning · Computer Science 2026-01-26 Chengyang Ying , Xinning Zhou , Zhongkai Hao , Hang Su , Songming Liu , Dong Yan , Jun Zhu

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

Robotics · Computer Science 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

Reward design in reinforcement learning and optimal control is challenging. Preference-based alignment addresses this by enabling agents to learn rewards from ranked trajectory pairs provided by humans. However, existing methods often…

Machine Learning · Computer Science 2025-05-29 Zhixian Xie , Haode Zhang , Yizhe Feng , Wanxin Jin

This paper argues that Active Inference (AIF) provides a crucial foundation for developing autonomous AI agents capable of learning from experience without continuous human reward engineering. As AI systems begin to exhaust high-quality…

Artificial Intelligence · Computer Science 2025-08-08 Bo Wen

Exploration in sparse reward environments remains one of the key challenges of model-free reinforcement learning. Instead of solely relying on extrinsic rewards provided by the environment, many state-of-the-art methods use intrinsic…

Machine Learning · Computer Science 2020-03-03 Roberta Raileanu , Tim Rocktäschel

AI-driven design problems, such as DNA/protein sequence design, are commonly tackled from two angles: generative modeling, which efficiently captures the feasible design space (e.g., natural images or biological sequences), and model-based…

Classical game-theoretic approaches for multi-agent systems in both the forward policy design problem and the inverse reward learning problem often make strong rationality assumptions: agents perfectly maximize expected utilities under…

Machine Learning · Computer Science 2021-03-23 Ran Tian , Liting Sun , Masayoshi Tomizuka

This paper introduces a learning-based visual planner for agile drone flight in cluttered environments. The proposed planner generates collision-free waypoints in milliseconds, enabling drones to perform agile maneuvers in complex…

Robotics · Computer Science 2025-11-21 Minwoo Kim , Geunsik Bae , Jinwoo Lee , Woojae Shin , Changseung Kim , Myong-Yol Choi , Heejung Shin , Hyondong Oh

Reward shaping allows reinforcement learning (RL) agents to accelerate learning by receiving additional reward signals. However, these signals can be difficult to design manually, especially for complex RL tasks. We propose a simple and…

Artificial Intelligence · Computer Science 2018-06-11 Niels Justesen , Sebastian Risi

This paper proposes an adaptive random experiment design (ARED) algorithm that can be applied to optimize the multiple factors and levels experiments. The algorithm takes real-time model error as the adaptive condition, and outputs a model…

Signal Processing · Electrical Eng. & Systems 2020-09-01 Zhou Qiao , Duan Xiaochang , Tang Wei

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

Machine Learning · Computer Science 2026-01-16 Nadav Merlis

Inverse reinforcement learning (IRL) has progressed significantly toward accurately learning the underlying rewards in both discrete and continuous domains from behavior data. The next advance is to learn {\em intrinsic} preferences in ways…

Machine Learning · Computer Science 2026-05-28 Yikang Gui , Prashant Doshi