English
Related papers

Related papers: Learning specifications for reactive synthesis wit…

200 papers

We present Confidence-Based Autonomy (CBA), an interactive algorithm for policy learning from demonstration. The CBA algorithm consists of two components which take advantage of the complimentary abilities of humans and computer agents. The…

Artificial Intelligence · Computer Science 2014-01-16 Sonia Chernova , Manuela Veloso

In formal synthesis of reactive systems an implementation of a system is automatically constructed from its formal specification. The great advantage of synthesis is that the resulting implementation is correct by construction; therefore…

Logic in Computer Science · Computer Science 2019-01-04 Hadas Kress-Gazit , Hazem Torfah

Manufacturing advanced materials and products with a specific property or combination of properties is often warranted. To achieve that it is crucial to find out the optimum recipe or processing conditions that can generate the ideal…

Machine Learning · Computer Science 2023-04-20 Hamed Khosravi , Taofeeq Olajire , Ahmed Shoyeb Raihan , Imtiaz Ahmed

Traditional robotic approaches rely on an accurate model of the environment, a detailed description of how to perform the task, and a robust perception system to keep track of the current state. On the other hand, reinforcement learning…

Reactive synthesis is a paradigm for automatically building correct-by-construction systems that interact with an unknown or adversarial environment. We study how to do reactive synthesis when part of the specification of the system is that…

Logic in Computer Science · Computer Science 2018-04-23 Daniel J. Fremont , Sanjit A. Seshia

In order to satisfy safety conditions, an agent may be constrained from acting freely. A safe controller can be designed a priori if an environment is well understood, but not when learning is employed. In particular, reinforcement learned…

Machine Learning · Computer Science 2020-10-15 Eleanor Quint , Dong Xu , Samuel Flint , Stephen Scott , Matthew Dwyer

This paper presents a model-free reinforcement learning (RL) algorithm to synthesize a control policy that maximizes the satisfaction probability of linear temporal logic (LTL) specifications. Due to the consideration of environment and…

Formal Languages and Automata Theory · Computer Science 2022-01-04 Mingyu Cai , Shaoping Xiao , Baoluo Li , Zhiliang Li , Zhen Kan

With growing access to versatile robotics, it is beneficial for end users to be able to teach robots tasks without needing to code a control policy. One possibility is to teach the robot through successful task executions. However,…

Robotics · Computer Science 2021-04-01 Aleksandra Kalinowska , Ahalya Prabhakar , Kathleen Fitzsimons , Todd Murphey

Expert demonstrations have proven an easy way to indirectly specify complex tasks. Recent algorithms even support extracting unambiguous formal specifications, e.g. deterministic finite automata (DFA), from demonstrations. Unfortunately,…

Machine Learning · Computer Science 2025-06-24 Marcell Vazquez-Chanlatte , Karim Elmaaroufi , Stefan J. Witwicki , Matei Zaharia , Sanjit A. Seshia

We introduce a Learning from Demonstration (LfD) approach for contact-rich manipulation tasks with articulated mechanisms. The extracted policy from a single human demonstration generalizes to different mechanisms of the same type and is…

Robotics · Computer Science 2022-10-14 Xing Li , Manuel Baum , Oliver Brock

We consider the problem of optimal reactive synthesis - compute a strategy that satisfies a mission specification in a dynamic environment, and optimizes a performance metric. We incorporate task-critical information, that is only available…

Robotics · Computer Science 2020-08-03 Suda Bharadwaj , Abraham P. Vinod , Rayna Dimitrova , Ufuk Topcu

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone

Robot skill learning and execution in uncertain and dynamic environments is a challenging task. This paper proposes an adaptive framework that combines Learning from Demonstration (LfD), environment state prediction, and high-level decision…

Robotics · Computer Science 2024-05-27 Ryan Donald , Brendan Hertel , Stephen Misenti , Yan Gu , Reza Azadeh

Learning from Demonstration (LfD) enables robots to acquire versatile skills by learning motion policies from human demonstrations. It endows users with an intuitive interface to transfer new skills to robots without the need for…

Robotics · Computer Science 2023-10-27 Jianyong Sun , Jens Kober , Michael Gienger , Jihong Zhu

Automata learning is a successful tool for many application domains such as robotics and automatic verification. Typically, automata learning techniques operate in a supervised learning setting (active or passive) where they learn a finite…

Machine Learning · Computer Science 2025-08-25 Simon Lutz , Daniil Kaminskyi , Florian Wittbold , Simon Dierl , Falk Howar , Barbara König , Emmanuel Müller , Daniel Neider

Ensuring human safety in collaborative robotics can compromise efficiency because traditional safety measures increase robot cycle time when human interaction is frequent. This paper proposes a safety-aware approach to mitigate efficiency…

Robotics · Computer Science 2025-12-22 M. Faroni , A. Spano , A. M. Zanchettin , P. Rocco

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

We present a novel method for learning hybrid force/position control from demonstration. We learn a dynamic constraint frame aligned to the direction of desired force using Cartesian Dynamic Movement Primitives. In contrast to approaches…

Robotics · Computer Science 2022-05-05 Adam Conkey , Tucker Hermans

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution. While goal conditioning of policies has been studied in the RL literature,…

Several model-based and model-free methods have been proposed for the robot trajectory learning task. Both approaches have their benefits and drawbacks. They can usually complement each other. Many research works are trying to integrate…

Robotics · Computer Science 2020-12-24 Shidi Li