English
Related papers

Related papers: PIGDreamer: Privileged Information Guided World Mo…

200 papers

This paper presents a reinforcement learning-based quadrotor navigation method that leverages efficient differentiable simulation, novel loss functions, and privileged information to navigate around large obstacles. Prior learning-based…

Robotics · Computer Science 2026-03-06 Jonathan Lee , Abhishek Rathod , Kshitij Goel , John Stecklein , Wennie Tabib

Bidirectional privacy-preservation federated learning is crucial as both local gradients and the global model may leak privacy. However, only a few works attempt to achieve it, and they often face challenges such as excessive communication…

Machine Learning · Computer Science 2024-12-17 Xue Yang , Depan Peng , Yan Feng , Xiaohu Tang , Weijun Fang , Jun Shao

Communication bandwidth is an important consideration in multi-robot exploration, where information exchange among robots is critical. While existing methods typically aim to reduce communication throughput, they either require significant…

Robotics · Computer Science 2024-07-30 Yixiao Ma , Jingsong Liang , Yuhong Cao , Derek Ming Siang Tan , Guillaume Sartoretti

Decision-making under uncertainty is a crucial ability for autonomous systems. In its most general form, this problem can be formulated as a Partially Observable Markov Decision Process (POMDP). The solution policy of a POMDP can be…

Robotics · Computer Science 2019-04-09 Sung-Kyun Kim , Rohan Thakker , Ali-akbar Agha-mohammadi

This paper concerns the central issues of model robustness and sample efficiency in offline reinforcement learning (RL), which aims to learn to perform decision making from history data without active exploration. Due to uncertainties and…

Machine Learning · Computer Science 2024-01-01 Laixi Shi , Yuejie Chi

Reinforcement learning (RL) is attracting increasing interests in autonomous driving due to its potential to solve complex classification and control problems. However, existing RL algorithms are rarely applied to real vehicles for two…

Machine Learning · Computer Science 2020-03-04 Lu Wen , Jingliang Duan , Shengbo Eben Li , Shaobing Xu , Huei Peng

Two common approaches to sequential decision-making are AI planning (AIP) and reinforcement learning (RL). Each has strengths and weaknesses. AIP is interpretable, easy to integrate with symbolic knowledge, and often efficient, but requires…

Artificial Intelligence · Computer Science 2022-09-30 Junkyu Lee , Michael Katz , Don Joven Agravante , Miao Liu , Geraud Nangue Tasse , Tim Klinger , Shirin Sohrabi

Autonomous driving involves multiple, often conflicting objectives such as safety, efficiency, and comfort. In reinforcement learning (RL), these objectives are typically combined through weighted summation, which collapses their relative…

Robotics · Computer Science 2026-03-24 Ahmed Abouelazm , Jonas Michel , Daniel Bogdoll , Philip Schörner , J. Marius Zöllner

Preserving the privacy of preferences (or rewards) of a sequential decision-making agent when decisions are observable is crucial in many physical and cybersecurity domains. For instance, in wildlife monitoring, agents must allocate…

Artificial Intelligence · Computer Science 2024-07-16 Shashank Reddy Chirra , Pradeep Varakantham , Praveen Paruchuri

Partially observable Markov decision processes (POMDPs) form a prominent model for uncertainty in sequential decision making. We are interested in constructing algorithms with theoretical guarantees to determine whether the agent has a…

Artificial Intelligence · Computer Science 2024-12-17 Marius Belly , Nathanaël Fijalkow , Hugo Gimbert , Florian Horn , Guillermo A. Pérez , Pierre Vandenhove

Offline reinforcement learning (RL) aims to learn an optimal policy from pre-collected data. However, it faces challenges of distributional shift, where the learned policy may encounter unseen scenarios not covered in the offline data.…

Machine Learning · Computer Science 2025-05-27 Jin Zhu , Xin Zhou , Jiaang Yao , Gholamali Aminian , Omar Rivasplata , Simon Little , Lexin Li , Chengchun Shi

In real-world scenarios, the observation data for reinforcement learning with continuous control is commonly noisy and part of it may be dynamically missing over time, which violates the assumption of many current methods developed for…

Machine Learning · Computer Science 2019-02-18 Yuhui Wang , Hao He , Xiaoyang Tan

Rather than augmenting rewards with penalties for undesired behavior, Constrained Partially Observable Markov Decision Processes (CPOMDPs) plan safely by imposing inviolable hard constraint value budgets. Previous work performing online…

Artificial Intelligence · Computer Science 2022-12-26 Arec Jamgochian , Anthony Corso , Mykel J. Kochenderfer

A robot's instantaneous sensory observations do not always reveal task-relevant state information. Under such partial observability, optimal behavior typically involves explicitly acting to gain the missing information. Today's standard…

In partial multi-label learning (PML), the true labels are unobserved, which makes label disambiguation important but difficult. A key challenge is that ambiguous candidate labels can propagate errors into downstream tasks such as feature…

Machine Learning · Computer Science 2026-02-05 Hanlin Pan , Yuhao Tang , Wanfu Gao

Reinforcement Learning (RL), among other learning-based methods, represents powerful tools to solve complex robotic tasks (e.g., actuation, manipulation, navigation, etc.), with the need for real-world data to train these systems as one of…

Robotics · Computer Science 2020-07-28 Kenzo Lobos-Tsunekawa , Tatsuya Harada

Creating reinforcement learning (RL) agents that are capable of accepting and leveraging task-specific knowledge from humans has been long identified as a possible strategy for developing scalable approaches for solving long-horizon…

Artificial Intelligence · Computer Science 2022-06-22 Lin Guan , Sarath Sreedharan , Subbarao Kambhampati

Partially Observable Markov Decision Processes (POMDPs) can model complex sequential decision-making problems under stochastic and uncertain environments. A main reason hindering their broad adoption in real-world applications is the lack…

In this paper we study online Reinforcement Learning (RL) in partially observable dynamical systems. We focus on the Predictive State Representations (PSRs) model, which is an expressive model that captures other well-known models such as…

Machine Learning · Computer Science 2022-08-16 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

We study the Safe Reinforcement Learning (SRL) problem using the Constrained Markov Decision Process (CMDP) formulation in which an agent aims to maximize the expected total reward subject to a safety constraint on the expected total value…

Machine Learning · Computer Science 2020-10-27 Dongsheng Ding , Xiaohan Wei , Zhuoran Yang , Zhaoran Wang , Mihailo R. Jovanović