English
Related papers

Related papers: Rank2Reward: Learning Shaped Reward Functions from…

200 papers

Many automated machine learning methods, such as those for hyperparameter and neural architecture optimization, are computationally expensive because they involve training many different model configurations. In this work, we present a new…

Machine Learning · Computer Science 2020-06-08 Martin Wistuba , Tejaswini Pedapati

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

Robotics · Computer Science 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

Physical interactions can often help reveal information that is not readily apparent. For example, we may tug at a table leg to evaluate whether it is built well, or turn a water bottle upside down to check that it is watertight. We propose…

Machine Learning · Computer Science 2022-12-20 Kun Huang , Edward S. Hu , Dinesh Jayaraman

We present an approach to robot learning from egocentric human videos by modeling human preferences in a reward function and optimizing robot behavior to maximize this reward. Prior work on reward learning from human videos attempts to…

Robotics · Computer Science 2026-02-13 Mrinal Verghese , Christopher G. Atkeson

Robots must know how to be gentle when they need to interact with fragile objects, or when the robot itself is prone to wear and tear. We propose an approach that enables deep reinforcement learning to train policies that are gentle, both…

Learning from Demonstration (LfD) offers a promising paradigm for robot skill acquisition. Recent approaches attempt to extract manipulation commands directly from video demonstrations, yet face two critical challenges: (1) general video…

Robotics · Computer Science 2026-02-24 Thanh Nguyen Canh , Thanh-Tuan Tran , Haolan Zhang , Ziyan Gao , Nak Young Chong , Xiem HoangVan

Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approach to learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Oier Mees , Markus Merklinger , Gabriel Kalweit , Wolfram Burgard

This paper examines the effect of real-time, personalized alignment of a robot's reward function to the human's values on trust and team performance. We present and compare three distinct robot interaction strategies: a non-learner strategy…

Robotics · Computer Science 2023-11-28 Shreyas Bhat , Joseph B. Lyons , Cong Shi , X. Jessie Yang

Potential-based reward shaping (PBRS) is a particular category of machine learning methods which aims to improve the learning speed of a reinforcement learning agent by extracting and utilizing extra knowledge while performing a task. There…

Artificial Intelligence · Computer Science 2023-03-15 Babak Badnava , Mona Esmaeili , Nasser Mozayani , Payman Zarkesh-Ha

We investigate the use of animal videos (observations) to improve Reinforcement Learning (RL) efficiency and performance in navigation tasks with sparse rewards. Motivated by theoretical considerations, we make use of weighted policy…

Systems and Control · Electrical Eng. & Systems 2022-11-14 Vittorio Giammarino , James Queeney , Lucas C. Carstensen , Michael E. Hasselmo , Ioannis Ch. Paschalidis

Reinforcement Learning (RL) has achieved remarkable success in various domains, yet it often relies on carefully designed programmatic reward functions to guide agent behavior. Designing such reward functions can be challenging and may not…

Machine Learning · Computer Science 2026-04-06 Qi Wang , Mian Wu , Yuyang Zhang , Mingqi Yuan , Wenyao Zhang , Haoxiang You , Yunbo Wang , Xin Jin , Xiaokang Yang , Wenjun Zeng

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara

Rewards play an essential role in reinforcement learning. In contrast to rule-based game environments with well-defined reward functions, complex real-world robotic applications, such as contact-rich manipulation, lack explicit and…

Machine Learning · Computer Science 2022-05-30 Yuning Wu , Jieliang Luo , Hui Li

Teaching robots dexterous manipulation skills often requires collecting hundreds of demonstrations using wearables or teleoperation, a process that is challenging to scale. Videos of human-object interactions are easier to collect and…

Robotics · Computer Science 2025-08-19 Tyler Ga Wei Lum , Olivia Y. Lee , C. Karen Liu , Jeannette Bohg

This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate rewards using a variation of Q-Learning algorithm. Unlike the conventional Q-Learning, the proposed algorithm compares current reward with…

Machine Learning · Computer Science 2010-09-15 Punit Pandey , Deepshikha Pandey , Shishir Kumar

Residual reinforcement learning (RL) has been proposed as a way to solve challenging robotic tasks by adapting control actions from a conventional feedback controller to maximize a reward signal. We extend the residual formulation to learn…

Machine Learning · Computer Science 2021-06-16 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

In reinforcement learning (RL), value-based algorithms learn to associate each observation with the states and rewards that are likely to be reached from it. We observe that many self-supervised image pre-training methods bear similarity to…

Machine Learning · Computer Science 2025-06-16 Dibya Ghosh , Sergey Levine

Learning-from-demonstrations is an emerging paradigm to obtain effective robot control policies for complex tasks via reinforcement learning without the need to explicitly design reward functions. However, it is susceptible to imperfections…

Robotics · Computer Science 2021-02-16 Aniruddh G. Puranic , Jyotirmoy V. Deshmukh , Stefanos Nikolaidis

Traditional imitation learning provides a set of methods and algorithms to learn a reward function or policy from expert demonstrations. Learning from demonstration has been shown to be advantageous for navigation tasks as it allows for…

Robotics · Computer Science 2021-08-03 Christian Ellis , Maggie Wigness , John G. Rogers , Craig Lennon , Lance Fiondella

Supervised learning, more specifically Convolutional Neural Networks (CNN), has surpassed human ability in some visual recognition tasks such as detection of traffic signs, faces and handwritten numbers. On the other hand, even…

Robotics · Computer Science 2018-09-18 Hai Nguyen , Hung Manh La , Matthew Deans