English
Related papers

Related papers: GrASP: Gradient-Based Affordance Selection for Pla…

200 papers

Deep model-based reinforcement learning methods offer a conceptually simple approach to the decision-making and control problem: use learning for the purpose of estimating an approximate dynamics model, and offload the rest of the work to…

Machine Learning · Computer Science 2023-07-13 Michael Janner

Sample inefficiency is a long-lasting problem in reinforcement learning (RL). The state-of-the-art estimates the optimal action values while it usually involves an extensive search over the state-action space and unstable optimization.…

Machine Learning · Computer Science 2019-11-27 Kaixiang Lin , Jiayu Zhou

Fractional gradient descent has been studied extensively, with a focus on its ability to extend traditional gradient descent methods by incorporating fractional-order derivatives. This approach allows for more flexibility in navigating…

Machine Learning · Computer Science 2024-11-25 Teodor Alexandru Szente , James Harrison , Mihai Zanfir , Cristian Sminchisescu

This paper considers the problem of learning a model in model-based reinforcement learning (MBRL). We examine how the planning module of an MBRL algorithm uses the model, and propose that the model learning module should incorporate the way…

Artificial Intelligence · Computer Science 2021-01-05 Romina Abachi , Mohammad Ghavamzadeh , Amir-massoud Farahmand

Classical learning assumes the learner is given a labeled data sample, from which it learns a model. The field of Active Learning deals with the situation where the learner begins not with a training sample, but instead with resources that…

Machine Learning · Computer Science 2012-07-19 Omid Madani , Daniel J. Lizotte , Russell Greiner

Understanding and manipulating deformable objects (e.g., ropes and fabrics) is an essential yet challenging task with broad applications. Difficulties come from complex states and dynamics, diverse configurations and high-dimensional action…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Ruihai Wu , Chuanruo Ning , Hao Dong

Decision tree models, including random forests and gradient-boosted decision trees, are widely used in machine learning due to their high predictive performance. However, their complex structures often make them difficult to interpret,…

Artificial Intelligence · Computer Science 2026-01-08 Akihiro Takemura , Masayuki Otani , Katsumi Inoue

We consider the problem of sequentially making decisions that are rewarded by "successes" and "failures" which can be predicted through an unknown relationship that depends on a partially controllable vector of attributes for each instance.…

Machine Learning · Statistics 2017-09-18 Yingfei Wang , Chu Wang , Warren Powell

Decision trees have been studied extensively in the context of fairness, aiming to maximize prediction performance while ensuring non-discrimination against different groups. Techniques in this space usually focus on imposing constraints at…

Machine Learning · Computer Science 2025-09-04 Kiara Stempel , Mattia Cerrato , Stefan Kramer

By planning through a learned dynamics model, model-based reinforcement learning (MBRL) offers the prospect of good performance with little environment interaction. However, it is common in practice for the learned model to be inaccurate,…

Machine Learning · Computer Science 2021-03-31 Behzad Haghgoo , Allan Zhou , Archit Sharma , Chelsea Finn

This paper considers the problem of learning safe policies in the context of reinforcement learning (RL). In particular, we consider the notion of probabilistic safety. This is, we aim to design policies that maintain the state of the…

Machine Learning · Computer Science 2023-04-20 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

In this paper we propose a novel gradient algorithm to learn a policy from an expert's observed behavior assuming that the expert behaves optimally with respect to some unknown reward function of a Markovian Decision Problem. The…

Machine Learning · Computer Science 2012-06-26 Gergely Neu , Csaba Szepesvari

Perceiving and manipulating 3D articulated objects in diverse environments is essential for home-assistant robots. Recent studies have shown that point-level affordance provides actionable priors for downstream manipulation tasks. However,…

Robotics · Computer Science 2025-09-17 Ruihai Wu , Kai Cheng , Yan Shen , Chuanruo Ning , Guanqi Zhan , Hao Dong

We study reinforcement learning (RL) with transition look-ahead, where the agent may observe which states would be visited upon playing any sequence of $\ell$ actions before deciding its course of action. While such predictive information…

Machine Learning · Statistics 2026-03-31 Corentin Pla , Hugo Richard , Marc Abeille , Nadav Merlis , Vianney Perchet

Learning to take actions based on observations is a core requirement for artificial agents to be able to be successful and robust at their task. Reinforcement Learning (RL) is a well-known technique for learning such policies. However,…

Machine Learning · Computer Science 2019-04-26 Ozan Çatal , Johannes Nauta , Tim Verbelen , Pieter Simoens , Bart Dhoedt

Grasping occluded objects in cluttered environments is an essential component in complex robotic manipulation tasks. In this paper, we introduce an AffordanCE-driven Next-Best-View planning policy (ACE-NBV) that tries to find a feasible…

We present a new approach to learning for planning, where knowledge acquired while solving a given set of planning problems is used to plan faster in related, but new problem instances. We show that a deep neural network can be used to…

Artificial Intelligence · Computer Science 2018-07-26 Edward Groshev , Maxwell Goldstein , Aviv Tamar , Siddharth Srivastava , Pieter Abbeel

Self-supervised grasp learning, i.e., learning to grasp by trial and error, has made great progress. However, it is still time-consuming to train such a model and also a challenge to apply it in practice. This work presents an accelerating…

Robotics · Computer Science 2022-05-16 Yanxu Hou , Jun Li

Humans subconsciously choose robust ways of selecting and using tools, for example, choosing a ladle over a flat spatula to serve meatballs. However, robustness under external disturbances remains underexplored in robotic tool-use planning.…

Robotics · Computer Science 2026-03-09 Yifei Dong , Yan Zhang , Sylvain Calinon , Florian T. Pokorny

Model-based methods for recommender systems have been studied extensively in recent years. In systems with large corpus, however, the calculation cost for the learnt model to predict all user-item preferences is tremendous, which makes full…

Machine Learning · Statistics 2018-12-24 Han Zhu , Xiang Li , Pengye Zhang , Guozheng Li , Jie He , Han Li , Kun Gai