English
Related papers

Related papers: Towards Task-Prioritized Policy Composition

200 papers

Many robotic tasks are composed of a lot of temporally correlated sub-tasks in a highly complex environment. It is important to discover situational intentions and proper actions by deliberating on temporal abstractions to solve problems…

Machine Learning · Computer Science 2022-07-26 Se-Wook Yoo , Seung-Woo Seo

The ability to compose learned skills to solve new tasks is an important property of lifelong-learning agents. In this work, we formalise the logical composition of tasks as a Boolean algebra. This allows us to formulate new tasks in terms…

Machine Learning · Computer Science 2020-10-16 Geraud Nangue Tasse , Steven James , Benjamin Rosman

Synthesizing planning and control policies in robotics is a fundamental task, further complicated by factors such as complex logic specifications and high-dimensional robot dynamics. This paper presents a novel reinforcement learning…

Robotics · Computer Science 2023-10-03 Zikang Xiong , Daniel Lawson , Joe Eappen , Ahmed H. Qureshi , Suresh Jagannathan

In problem-solving, we humans can come up with multiple novel solutions to the same problem. However, reinforcement learning algorithms can only produce a set of monotonous policies that maximize the cumulative reward but lack diversity and…

Machine Learning · Computer Science 2022-11-01 Hao Sun , Zhenghao Peng , Bo Dai , Jian Guo , Dahua Lin , Bolei Zhou

We present a new framework for prioritized multi-task motion-force control of fully-actuated robots. This work is established on a careful review and comparison of the state of the art. Some control frameworks are not optimal, that is they…

Robotics · Computer Science 2014-10-16 Andrea Del Prete , Francesco Nori , Giorgio Metta , Lorenzo Natale

Collecting robotic manipulation data is expensive, making it impractical to acquire demonstrations for the combinatorially large space of tasks that arise in multi-object, multi-robot, and multi-environment settings. While recent generative…

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

Curriculum learning in reinforcement learning is a training methodology that seeks to speed up learning of a difficult target task, by first training on a series of simpler tasks and transferring the knowledge acquired to the target task.…

Machine Learning · Computer Science 2019-09-17 Sanmit Narvekar , Peter Stone

In this study, we address the challenge of learning generalizable policies for compositional tasks defined by logical specifications. These tasks consist of multiple temporally extended sub-tasks. Due to the sub-task inter-dependencies and…

Artificial Intelligence · Computer Science 2024-11-05 Duo Xu , Faramarz Fekri

In reinforcement learning, we typically refer to unsupervised pre-training when we aim to pre-train a policy without a priori access to the task specification, i.e. rewards, to be later employed for efficient learning of downstream tasks.…

Machine Learning · Computer Science 2025-10-21 Riccardo Zamboni , Mirco Mutti , Marcello Restelli

The fine-tuning of deep pre-trained models has revealed compositional properties, with multiple specialized modules that can be arbitrarily composed into a single, multi-task model. However, identifying the conditions that promote…

Artificial Intelligence · Computer Science 2025-03-04 Angelo Porrello , Lorenzo Bonicelli , Pietro Buzzega , Monica Millunzi , Simone Calderara , Rita Cucchiara

Many challenging reinforcement learning (RL) problems require designing a distribution of tasks that can be applied to train effective policies. This distribution of tasks can be specified by the curriculum. A curriculum is meant to improve…

Machine Learning · Computer Science 2023-01-03 Maria Nesterova , Alexey Skrynnik , Aleksandr Panov

Continual reinforcement learning poses a major challenge due to the tendency of agents to experience catastrophic forgetting when learning sequential tasks. In this paper, we introduce a modularity-based approach, called Hierarchical…

Machine Learning · Computer Science 2024-11-06 Thomas P Cannon , Özgür Simsek

The current thesis aims to explore the reinforcement learning field and build on existing methods to produce improved ones to tackle the problem of learning in high-dimensional and complex environments. It addresses such goals by…

Machine Learning · Computer Science 2024-03-26 Ayoub Ghriss , Masashi Sugiyama , Alessandro Lazaric

This paper investigates the problem of designing control policies that satisfy high-level specifications described by signal temporal logic (STL) in unknown, stochastic environments. While many existing works concentrate on optimizing the…

Systems and Control · Electrical Eng. & Systems 2024-12-16 Siqi Wang , Shaoyuan Li , Li Yin , Xiang Yin

This paper presents an approach for data-driven policy refinement in reinforcement learning, specifically designed for safety-critical applications. Our methodology leverages the strengths of data-driven optimization and reinforcement…

Machine Learning · Computer Science 2023-05-16 Ali Baheri

Biological intelligence can learn to solve many diverse tasks in a data efficient manner by re-using basic knowledge and skills from one task to another. Furthermore, many of such skills are acquired without explicit supervision in an…

Exploration and adaptation to new tasks in a transfer learning setup is a central challenge in reinforcement learning. In this work, we build on the idea of modeling a distribution over policies in a Bayesian deep reinforcement learning…

Machine Learning · Computer Science 2019-06-11 Disha Shrivastava , Eeshan Gunesh Dhekane , Riashat Islam

Many instances of similar or almost-identical industrial machines or tools are often deployed at once, or in quick succession. For instance, a particular model of air compressor may be installed at hundreds of customers. Because these tools…

Artificial Intelligence · Computer Science 2023-01-31 Hélène Plisnier , Denis Steckelmacher , Jeroen Willems , Bruno Depraetere , Ann Nowé

Advancements in additive manufacturing have enabled design and fabrication of materials and structures not previously realizable. In particular, the design space of composite materials and structures has vastly expanded, and the resulting…