English
Related papers

Related papers: Enhancing RL Generalizability in Robotics through …

200 papers

Deep Reinforcement Learning (RL) is mainly studied in a setting where the training and the testing environments are similar. But in many practical applications, these environments may differ. For instance, in control systems, the robot(s)…

Machine Learning · Computer Science 2022-10-25 Jean-Baptiste Gaya , Laure Soulier , Ludovic Denoyer

Understanding object affordances is essential for enabling robots to perform purposeful and fine-grained interactions in diverse and unstructured environments. However, existing approaches either rely on retrieval, which is fragile due to…

Robotics · Computer Science 2026-04-01 Qiyuan Zhuang , He-Yang Xu , Yijun Wang , Xin-Yang Zhao , Yang-Yang Li , Xiu-Shen Wei

In the Bayesian reinforcement learning (RL) setting, a prior distribution over the unknown problem parameters -- the rewards and transitions -- is assumed, and a policy that optimizes the (posterior) expected return is sought. A common…

Machine Learning · Computer Science 2021-09-27 Aviv Tamar , Daniel Soudry , Ev Zisselman

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

We study the problem of robotic stacking with objects of complex geometry. We propose a challenging and diverse set of such objects that was carefully designed to require strategies beyond a simple "pick-and-place" solution. Our method is a…

This research delves deeply into Meta Reinforcement Learning (Meta RL) through a exploration focusing on defining generalization limits and ensuring convergence. By employing a approach this article introduces an innovative theoretical…

Machine Learning · Computer Science 2024-05-24 Cangqing Wang , Mingxiu Sui , Dan Sun , Zecheng Zhang , Yan Zhou

Data Shapley provides a principled framework for attributing data's contribution within machine learning contexts. However, existing approaches require re-training models on different data subsets, which is computationally intensive,…

Machine Learning · Computer Science 2025-06-10 Jiachen T. Wang , Prateek Mittal , Dawn Song , Ruoxi Jia

Robot planning in partially observable domains is difficult, because a robot needs to estimate the current state and plan actions at the same time. When the domain includes many objects, reasoning about the objects and their relationships…

Robotics · Computer Science 2022-02-22 Saeid Amiri , Kishan Chandan , Shiqi Zhang

Deep Reinforcement Learning (Deep RL) has been receiving increasingly more attention thanks to its encouraging performance on a variety of control tasks. Yet, conventional regularization techniques in training neural networks (e.g., $L_2$…

Machine Learning · Computer Science 2021-11-30 Zhuang Liu , Xuanlin Li , Bingyi Kang , Trevor Darrell

We investigate the effect of including domain knowledge about a robotic system's causal relations when generating explanations. To this end, we compare two methods from explainable artificial intelligence, the popular KernelSHAP and the…

Robotics · Computer Science 2021-11-05 Sindre Benjamin Remman , Inga Strümke , Anastasios M. Lekkas

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Generalization across different environments with the same tasks is critical for successful applications of visual reinforcement learning (RL) in real scenarios. However, visual distractions -- which are common in real scenes -- from…

Machine Learning · Computer Science 2022-07-01 Rui Yang , Jie Wang , Zijie Geng , Mingxuan Ye , Shuiwang Ji , Bin Li , Feng Wu

While reinforcement learning algorithms can learn effective policies for complex tasks, these policies are often brittle to even minor task variations, especially when variations are not explicitly provided during training. One natural…

Machine Learning · Computer Science 2020-12-09 Saurabh Kumar , Aviral Kumar , Sergey Levine , Chelsea Finn

Transparency of Machine Learning models used for decision support in various industries becomes essential for ensuring their ethical use. To that end, feature attribution methods such as SHAP (SHapley Additive exPlanations) are widely used…

Machine Learning · Computer Science 2022-12-08 Anna Bogdanova , Akira Imakura , Tetsuya Sakurai , Tomoya Fujii , Teppei Sakamoto , Hiroyuki Abe

In Explainable AI (XAI), Shapley values are a popular model-agnostic framework for explaining predictions made by complex machine learning models. The computation of Shapley values requires estimating non-trivial contribution functions…

Machine Learning · Computer Science 2026-01-27 Lars Henry Berge Olsen , Martin Jullum

Reinforcement Learning (RL) has achieved state-of-the-art results in domains such as robotics and games. We build on this previous work by applying RL algorithms to a selection of canonical online stochastic optimization problems with a…

When operating in service of people, robots need to optimize rewards aligned with end-user preferences. Since robots will rely on raw perceptual inputs like RGB images, their rewards will inevitably use visual representations. Recently…

Robotics · Computer Science 2024-01-17 Ran Tian , Chenfeng Xu , Masayoshi Tomizuka , Jitendra Malik , Andrea Bajcsy

Reinforcement learning agents can achieve super-human performance in complex decision-making tasks, but their behaviour is often difficult to understand and explain. This lack of explanation limits deployment, especially in safety-critical…

Machine Learning · Computer Science 2025-08-01 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

Deep Reinforcement Learning (RL) is a promising approach for adaptive robot control, but its current application to robotics is currently hindered by high sample requirements. To alleviate this issue, we propose to exploit the symmetries…

Robotics · Computer Science 2020-08-27 Yijiong Lin , Jiancong Huang , Matthieu Zimmer , Yisheng Guan , Juan Rojas , Paul Weng

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster