English
Related papers

Related papers: Structured Policy Representation: Imposing Stabili…

200 papers

The requirement that planetary systems be dynamically stable is often used to vet new discoveries or set limits on unconstrained masses or orbital elements. This is typically carried out via computationally expensive N-body simulations. We…

Discrete-time regulatory networks are dynamical systems on directed graphs, with a structure inspired on natural systems of interacting units. There is a natural notion of determination amongst vertices, which we use to classify the nodes…

Adaptation and Self-Organizing Systems · Physics 2009-11-13 Beatriz Luna , Edgardo Ugalde

Deep reinforcement learning could be used to learn dexterous robotic policies but it is challenging to transfer them to new robots with vastly different hardware properties. It is also prohibitively expensive to learn a new policy from…

Robotics · Computer Science 2019-01-15 Tao Chen , Adithyavairavan Murali , Abhinav Gupta

In order to effectively interact with or supervise a robot, humans need to have an accurate mental model of its capabilities and how it acts. Learned neural network policies make that particularly challenging. We propose an approach for…

Robotics · Computer Science 2018-10-19 Sandy H. Huang , Kush Bhatia , Pieter Abbeel , Anca D. Dragan

We introduce the framework of performative reinforcement learning where the policy chosen by the learner affects the underlying reward and transition dynamics of the environment. Following the recent literature on performative…

Machine Learning · Computer Science 2023-06-08 Debmalya Mandal , Stelios Triantafyllou , Goran Radanovic

Learning stable dynamics from observed time-series data is an essential problem in robotics, physical modeling, and systems biology. Many of these dynamics are represented as an inputs-output system to communicate with the external…

Dynamical Systems · Mathematics 2023-01-18 Yuji Okamoto , Ryosuke Kojima

In many real-world decision making problems, reaching an optimal decision requires taking into account a variable number of objects around the agent. Autonomous driving is a domain in which this is especially relevant, since the number of…

Machine Learning · Computer Science 2020-08-13 Maria Hügle , Gabriel Kalweit , Branka Mirchevska , Moritz Werling , Joschka Boedecker

While the exact definition and implementation of accountability depend on the specific context, at its core accountability describes a mechanism that will make decisions transparent and often provides means to sanction "bad" decisions. As…

Software Engineering · Computer Science 2020-05-18 Severin Kacianka , Amjad Ibrahim , Alexander Pretschner

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals. We seek to replicate some of these abilities with a neural network that…

Machine Learning · Computer Science 2018-02-22 Nick Haber , Damian Mrowca , Li Fei-Fei , Daniel L. K. Yamins

Learning disentangled representations is a key step towards effectively discovering and modelling the underlying structure of environments. In the natural sciences, physics has found great success by describing the universe in terms of…

Machine Learning · Computer Science 2020-10-27 Robin Quessard , Thomas D. Barrett , William R. Clements

In this paper we study collective decision making on a multi-population, represented by a regular network of groups of individuals. Each group consists of a collection of players and every player can choose between two options. A group is…

Optimization and Control · Mathematics 2020-11-18 Wouter Baar , Dario Bauso

A policy is said to be robust if it maximizes the reward while considering a bad, or even adversarial, model. In this work we formalize two new criteria of robustness to action uncertainty. Specifically, we consider two scenarios in which…

Machine Learning · Computer Science 2019-05-08 Chen Tessler , Yonathan Efroni , Shie Mannor

The reduction of dynamical systems has a rich history, with many important applications related to stability, control and verification. Reduction of nonlinear systems is typically performed in an exact manner - as is the case with…

Optimization and Control · Mathematics 2007-07-26 Paulo Tabuada , Aaron D. Ames , Agung Julius , George J. Pappas

It is difficult to create robust, reusable, and reactive behaviors for robots that can be easily extended and combined. Frameworks such as Behavior Trees are flexible but difficult to characterize, especially when designing reactions and…

Robotics · Computer Science 2019-08-07 Chris Paxton , Nathan Ratliff , Clemens Eppner , Dieter Fox

An input-output approach to stability analysis is explored for networked systems with uncertain link dynamics. The main result consists of a collection of integral quadratic constraints, which together imply robust stability of the…

Systems and Control · Electrical Eng. & Systems 2024-11-22 Simone Mariano , Michael Cantoni

Linear dynamical systems are canonical models for learning-based control of plants with uncertain dynamics. The setting consists of a stochastic differential equation that captures the state evolution of the plant understudy, while the true…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications…

Machine Learning · Computer Science 2021-03-30 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , Johan U. Backström , R. Bhushan Gopaluni

Networked dynamical systems are common throughout science in engineering; e.g., biological networks, reaction networks, power systems, and the like. For many such systems, nonlinearity drives populations of identical (or near-identical)…

Dynamical Systems · Mathematics 2023-02-10 James Koch , Zhao Chen , Aaron Tuor , Jan Drgona , Draguna Vrabie

Dynamical systems see widespread use in natural sciences like physics, biology, chemistry, as well as engineering disciplines such as circuit analysis, computational fluid dynamics, and control. For simple systems, the differential…

Human environments contain numerous objects configured in a variety of arrangements. Our goal is to enable robots to repose previously unseen objects according to learned semantic relationships in novel environments. We break this problem…

Robotics · Computer Science 2021-08-30 Chris Paxton , Chris Xie , Tucker Hermans , Dieter Fox