English
Related papers

Related papers: Active Contextual Entropy Search

200 papers

Flexible manufacturing processes demand robots to easily adapt to changes in the environment and interact with humans. In such dynamic scenarios, robotic tasks may be programmed through learning-from-demonstration approaches, where a…

Robotics · Computer Science 2019-08-21 Leonel Rozo

Contextual bandits can solve a huge range of real-world problems. However, current popular algorithms to solve them either rely on linear models, or unreliable uncertainty estimation in non-linear models, which are required to deal with the…

Machine Learning · Computer Science 2023-02-01 Adam Elwood , Marco Leonardi , Ashraf Mohamed , Alessandro Rozza

Sample efficiency is one of the key factors when applying policy search to real-world problems. In recent years, Bayesian Optimization (BO) has become prominent in the field of robotics due to its sample efficiency and little prior…

Robotics · Computer Science 2020-11-19 Lukas P. Fröhlich , Melanie N. Zeilinger , Edgar D. Klenske

Direct contextual policy search methods learn to improve policy parameters and simultaneously generalize these parameters to different context or task variables. However, learning from high-dimensional context variables, such as camera…

Machine Learning · Statistics 2016-11-11 Voot Tangkaratt , Herke van Hoof , Simone Parisi , Gerhard Neumann , Jan Peters , Masashi Sugiyama

For many applications of reinforcement learning it can be more convenient to specify both a reward function and constraints, rather than trying to design behavior through the reward function. For example, systems that physically interact…

Machine Learning · Computer Science 2017-05-31 Joshua Achiam , David Held , Aviv Tamar , Pieter Abbeel

Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their…

Computation and Language · Computer Science 2026-05-15 Zeyu Huang , Adhiguna Kuncoro , Qixuan Feng , Jiajun Shen , Lucio Dery , Arthur Szlam , Marc'Aurelio Ranzato

The aim of this paper is to study the reward based policy exploration problem in a supervised learning approach and enable robots to form complex movement trajectories in challenging reward settings and search spaces. For this, the…

Robotics · Computer Science 2020-11-10 M. Tuluhan Akbulut , Utku Bozdogan , Ahmet Tekden , Emre Ugur

Policy search reinforcement learning has been drawing much attention as a method of learning a robot control policy. In particular, policy search using such non-parametric policies as Gaussian process regression can learn optimal actions…

Robotics · Computer Science 2021-06-15 Hikaru Sasaki , Takamitsu Matsubara

Contextual policy search (CPS) is a class of multi-task reinforcement learning algorithms that is particularly useful for robotic applications. A recent state-of-the-art method is Contextual Covariance Matrix Adaptation Evolution Strategies…

Machine Learning · Computer Science 2019-04-16 Alexander Fabisch

This effort is focused on examining the behavior of reinforcement learning systems in personalization environments and detailing the differences in policy entropy associated with the type of learning algorithm utilized. We demonstrate that…

Machine Learning · Computer Science 2024-04-30 Anton Dereventsov , Andrew Starnes , Clayton G. Webster

Complex robot navigation and control problems can be framed as policy search problems. However, interactive learning in uncertain environments can be expensive, requiring the use of data-efficient methods. Bayesian optimization is an…

Machine Learning · Computer Science 2025-01-29 Javier Garcia-Barcos , Ruben Martinez-Cantin

Parameterized movement primitives have been extensively used for imitation learning of robotic tasks. However, the high-dimensionality of the parameter space hinders the improvement of such primitives in the reinforcement learning (RL)…

Robotics · Computer Science 2022-02-14 Samuele Tosatto , Georgia Chalvatzaki , Jan Peters

We study contextual search, a generalization of binary search in higher dimensions, which captures settings such as feature-based dynamic pricing. Standard formulations of this problem assume that agents act in accordance with a specific…

Machine Learning · Computer Science 2022-08-09 Akshay Krishnamurthy , Thodoris Lykouris , Chara Podimata , Robert Schapire

Solutions to address the periodic review inventory control problem with nonstationary random demand, lost sales, and stochastic vendor lead times typically involve making strong assumptions on the dynamics for either approximation or…

Machine Learning · Statistics 2023-10-26 Dean Foster , Randy Jia , Dhruv Madeka

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with…

Machine Learning · Statistics 2011-12-30 Neil Houlsby , Ferenc Huszár , Zoubin Ghahramani , Máté Lengyel

Active search formalizes a specialized active learning setting where the goal is to collect members of a rare, valuable class. The state-of-the-art algorithm approximates the optimal Bayesian policy in a budget-aware manner, and has been…

Machine Learning · Computer Science 2024-05-27 Quan Nguyen , Anindya Sarkar , Roman Garnett

Simplicity is a critical inductive bias for designing data-driven controllers, especially when robustness is important. Despite the impressive results of deep reinforcement learning in complex control tasks, it is prone to capturing…

Machine Learning · Computer Science 2025-05-09 Bang You , Chenxu Wang , Huaping Liu

Reinforcement learning requires interaction with an environment, which is expensive for robots. This constraint necessitates approaches that work with limited environmental interaction by maximizing the reuse of previous experiences. We…

Artificial Intelligence · Computer Science 2024-04-05 Benedict Quartey , Ankit Shah , George Konidaris

This paper studies systematic exploration for reinforcement learning with rich observations and function approximation. We introduce a new model called contextual decision processes, that unifies and generalizes most prior settings. Our…

Machine Learning · Computer Science 2016-12-02 Nan Jiang , Akshay Krishnamurthy , Alekh Agarwal , John Langford , Robert E. Schapire

Computational agents support humans in many areas of life and are therefore found in heterogeneous contexts. This means they operate in rapidly changing environments and can be confronted with huge state and action spaces. In order to…

Artificial Intelligence · Computer Science 2023-08-31 Nicole Merkle , Ralf Mikut