English
Related papers

Related papers: Efficient Empowerment Estimation for Unsupervised …

200 papers

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

Model generalization of the underlying dynamics is critical for achieving data efficiency when learning for robot control. This paper proposes a novel approach for learning dynamics leveraging the symmetry in the underlying robotic system,…

Robotics · Computer Science 2022-10-17 Jee-eun Lee , Jaemin Lee , Tirthankar Bandyopadhyay , Luis Sentis

An incremental version of the ELMVIS+ method is proposed in this paper. It iteratively selects a few best fitting data samples from a large pool, and adds them to the model. The method keeps high speed of ELMVIS+ while allowing for much…

Machine Learning · Computer Science 2019-12-19 Anton Akusok , Emil Eirola , Yoan Miche , Ian Oliver , Kaj-Mikael Björk , Andrey Gritsenko , Stephen Baek , Amaury Lendasse

Disentangled visual representations have largely been studied with generative models such as Variational AutoEncoders (VAEs). While prior work has focused on generative methods for disentangled representation learning, these approaches do…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Andrea Burns , Aaron Sarna , Dilip Krishnan , Aaron Maschinot

Accurate identification of parameters of load models is essential in power system computations, including simulation, prediction, and stability and reliability analysis. Conventional point estimation based composite load modeling approaches…

Systems and Control · Computer Science 2019-03-27 Chang Fu , Zhe Yu , Di Shi , Haifeng Li , Caisheng Wang , Zhiwei Wang , Jie Li

Collective variable (CV) or order parameter based enhanced sampling algorithms have achieved great success due to their ability to efficiently explore the rough potential energy landscapes of complex systems. However, the degeneracy of…

Chemical Physics · Physics 2018-07-11 Jing Zhang , Ming Chen

In the field of reinforcement learning there has been recent progress towards safety and high-confidence bounds on policy performance. However, to our knowledge, no practical methods exist for determining high-confidence policy performance…

Artificial Intelligence · Computer Science 2018-06-26 Daniel S. Brown , Scott Niekum

Increasingly demanding performance requirements for dynamical systems motivates the adoption of nonlinear and adaptive control techniques. One challenge is the nonlinearity of the resulting closed-loop system complicates verification that…

Systems and Control · Computer Science 2017-10-03 John F. Quindlen , Ufuk Topcu , Girish Chowdhary , Jonathan P. How

We study the estimation of the latent variable Gaussian graphical model (LVGGM), where the precision matrix is the superposition of a sparse matrix and a low-rank matrix. In order to speed up the estimation of the sparse plus low-rank…

Machine Learning · Statistics 2017-03-01 Pan Xu , Jian Ma , Quanquan Gu

Reducing reinforcement learning to supervised learning is a well-studied and effective approach that leverages the benefits of compact function approximation to deal with large-scale Markov decision processes. Independently, the boosting…

Machine Learning · Computer Science 2023-01-26 Nataly Brukhim , Elad Hazan , Karan Singh

Model-based reinforcement learning algorithms tend to achieve higher sample efficiency than model-free methods. However, due to the inevitable errors of learned models, model-based methods struggle to achieve the same asymptotic performance…

Machine Learning · Computer Science 2019-12-02 Qi Zhou , Houqiang Li , Jie Wang

We consider large-scale Markov decision processes with an unknown cost function and address the problem of learning a policy from a finite set of expert demonstrations. We assume that the learner is not allowed to interact with the expert…

Machine Learning · Computer Science 2021-12-30 Angeliki Kamoutsi , Goran Banjac , John Lygeros

State-space graphical models and the variational autoencoder framework provide a principled apparatus for learning dynamical systems from data. State-of-the-art probabilistic approaches are often able to scale to large problems at the cost…

Machine Learning · Statistics 2024-11-05 Matthew Dowling , Yuan Zhao , Il Memming Park

We consider a large population of learning agents noncooperatively selecting strategies from a common set, influencing the dynamics of an exogenous system (ES) we seek to stabilize at a desired equilibrium. Our approach is to design a…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Jair Certório , Nuno C. Martins , Richard J. La , Murat Arcak

In this paper, we present a robotic model-based reinforcement learning method that combines ideas from model identification and model predictive control. We use a feature-based representation of the dynamics that allows the dynamics model…

Machine Learning · Computer Science 2016-03-16 Christopher Xie , Sachin Patil , Teodor Moldovan , Sergey Levine , Pieter Abbeel

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Applying reinforcement learning to robotic systems poses a number of challenging problems. A key requirement is the ability to handle continuous state and action spaces while remaining within a limited time and resource budget.…

Machine Learning · Computer Science 2020-06-29 Benjamin van Niekerk , Andreas Damianou , Benjamin Rosman

Disentanglement is at the forefront of unsupervised learning, as disentangled representations of data improve generalization, interpretability, and performance in downstream tasks. Current unsupervised approaches remain inapplicable for…

Machine Learning · Computer Science 2020-10-27 Benjamin Estermann , Markus Marks , Mehmet Fatih Yanik

A defining feature of sampling-based motion planning is the reliance on an implicit representation of the state space, which is enabled by a set of probing samples. Traditionally, these samples are drawn either probabilistically or…

Robotics · Computer Science 2019-03-13 Brian Ichter , James Harrison , Marco Pavone

Model-based reinforcement learning methods typically learn models for high-dimensional state spaces by aiming to reconstruct and predict the original observations. However, drawing inspiration from model-free reinforcement learning, we…

Machine Learning · Computer Science 2019-12-10 Aaron Havens , Yi Ouyang , Prabhat Nagarajan , Yasuhiro Fujita