English
Related papers

Related papers: DO-IQS: Dynamics-Aware Offline Inverse Q-Learning …

200 papers

We introduce the Stochastic Correlated Obstacle Scene (SCOS) problem, a navigation setting with spatially correlated obstacles of uncertain blockage status, realistically constrained sensors that provide noisy readings and costly…

Machine Learning · Statistics 2025-10-22 Li Zhou , Elvan Ceyhan

Given a set of trajectories demonstrating the execution of a task safely in a constrained MDP with observable rewards but with unknown constraints and non-observable costs, we aim to find a policy that maximizes the likelihood of…

Machine Learning · Computer Science 2026-03-02 George Papadopoulos , George A. Vouros

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance without considering risk or safety. In contrast, safe reinforcement learning aims to mitigate or avoid unsafe states. This…

Machine Learning · Computer Science 2024-09-13 Zahra Shahrooei , Ali Baheri

Inverse optimal control (IOC) allows the retrieval of optimal cost function weights, or behavioral parameters, from human motion. The literature on IOC uses methods that are either based on a slow bilevel process or a fast but…

Robotics · Computer Science 2025-10-10 Filip Bečanović , Kosta Jovanović , Vincent Bonnet

The boundary control problem is a non-convex optimization and control problem in many scientific domains, including fluid mechanics, structural engineering, and heat transfer optimization. The aim is to find the optimal values for the…

Machine Learning · Computer Science 2023-10-25 Zenin Easa Panthakkalakath , Juraj Kardoš , Olaf Schenk

Offline reinforcement learning aims to train agents from pre-collected datasets. However, this comes with the added challenge of estimating the value of behaviors not covered in the dataset. Model-based methods offer a potential solution by…

Machine Learning · Computer Science 2024-12-03 Anya Sims , Cong Lu , Jakob Foerster , Yee Whye Teh

Offline Reinforcement Learning (RL) faces a fundamental challenge of extrapolation errors caused by out-of-distribution (OOD) actions. Implicit Q-Learning (IQL) employs expectile regression to achieve in-sample learning. Nevertheless, IQL…

Machine Learning · Computer Science 2026-02-03 Xinchen Han , Hossam Afifi , Michel Marot

In spite of the large literature on reinforcement learning (RL) algorithms for partially observable Markov decision processes (POMDPs), a complete theoretical understanding is still lacking. In a partially observable setting, the history of…

Machine Learning · Computer Science 2023-06-12 Erfan Seyedsalehi , Nima Akbarzadeh , Amit Sinha , Aditya Mahajan

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Off-policy evaluation (OPE) in both contextual bandits and reinforcement learning allows one to evaluate novel decision policies without needing to conduct exploration, which is often costly or otherwise infeasible. The problem's importance…

Machine Learning · Computer Science 2019-06-11 Nathan Kallus , Masatoshi Uehara

Integration of reinforcement learning with unmanned aerial vehicles (UAVs) to achieve autonomous flight has been an active research area in recent years. An important part focuses on obstacle detection and avoidance for UAVs navigating…

Artificial Intelligence · Computer Science 2021-03-12 Jeremy Roghair , Kyungtae Ko , Amir Ehsan Niaraki Asli , Ali Jannesari

We study the problem of optimal state-feedback tracking control for unknown discrete-time deterministic systems with input constraints. To handle input constraints, state-of-art methods utilize a certain nonquadratic stage cost function,…

Systems and Control · Electrical Eng. & Systems 2020-12-09 Alexandros Tanzanakis , John Lygeros

Intelligent reflecting surface (IRS) has the potential to significantly enhance the network performance by reconfiguring the wireless propagation environments. It is however difficult to obtain the accurate downlink channel state…

Information Theory · Computer Science 2020-05-18 Wenzhi Fang , Min Fu , Yuanming Shi , Yong Zhou

Unmanned Aerial Vehicles (UAVs) have been emerging as an effective solution for IoT data collection networks thanks to their outstanding flexibility, mobility, and low operation costs. However, due to the limited energy and uncertainty from…

Networking and Internet Architecture · Computer Science 2021-06-22 Nam H. Chu , Dinh Thai Hoang , Diep N. Nguyen , Nguyen Van Huynh , Eryk Dutkiewicz

We consider reinforcement learning (RL) methods in offline domains without additional online data collection, such as mobile health applications. Most of existing policy optimization algorithms in the computer science literature are…

Machine Learning · Statistics 2022-07-28 Chengchun Shi , Shikai Luo , Yuan Le , Hongtu Zhu , Rui Song

We approach the fundamental problem of obstacle avoidance for robotic systems via the lens of online learning. In contrast to prior work that either assumes worst-case realizations of uncertainty in the environment or a stationary…

Robotics · Computer Science 2023-11-07 David Snyder , Meghan Booker , Nathaniel Simon , Wenhan Xia , Daniel Suo , Elad Hazan , Anirudha Majumdar

In Inverse Optimization (IO), an expert agent solves an optimization problem parametric in an exogenous signal. From a learning perspective, the goal is to learn the expert's cost function given a dataset of signals and corresponding…

Optimization and Control · Mathematics 2024-01-25 Pedro Zattoni Scroccaro , Bilge Atasoy , Peyman Mohajerin Esfahani

In offline reinforcement learning (RL), addressing the out-of-distribution (OOD) action issue has been a focus, but we argue that there exists an OOD state issue that also impairs performance yet has been underexplored. Such an issue…

Machine Learning · Computer Science 2024-11-04 Yixiu Mao , Qi Wang , Chen Chen , Yun Qu , Xiangyang Ji

Safe reinforcement learning has traditionally relied on predefined constraint functions to ensure safety in complex real-world tasks, such as autonomous driving. However, defining these functions accurately for varied tasks is a persistent…

Machine Learning · Computer Science 2025-01-31 Se-Wook Yoo , Seung-Woo Seo

Anomaly detection in decision-making sequences is a challenging problem due to the complexity of normality representation learning and the sequential nature of the task. Most existing methods based on Reinforcement Learning (RL) are…

Machine Learning · Computer Science 2024-02-08 Chen Wang , Sarah Erfani , Tansu Alpcan , Christopher Leckie