English
Related papers

Related papers: Learning Hybrid Dynamics Models With Simulator-Inf…

200 papers

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

Learning task-agnostic dynamics models in high-dimensional observation spaces can be challenging for model-based RL agents. We propose a novel way to learn latent world models by learning to predict sequences of future actions conditioned…

Machine Learning · Computer Science 2020-12-07 Keiran Paster , Sheila A. McIlraith , Jimmy Ba

Learning identifiable representations and models from low-level observations is helpful for an intelligent spacecraft to complete downstream tasks reliably. For temporal observations, to ensure that the data generating process is provably…

Machine Learning · Computer Science 2024-12-05 Congxi Zhang , Yongchun Xie

Continual learning in environments with shifting data distributions is a challenging problem with several real-world applications. In this paper we consider settings in which the data distribution(task) shifts abruptly and the timing of…

Machine Learning · Computer Science 2022-01-07 Mengda Xu , Sumitra Ganesh , Pranay Pasula

End-to-end learning of dynamical systems with black-box models, such as neural ordinary differential equations (ODEs), provides a flexible framework for learning dynamics from data without prescribing a mathematical model for the dynamics.…

Machine Learning · Statistics 2022-06-20 Paidamoyo Chapfuwa , Sherri Rose , Lawrence Carin , Edward Meeds , Ricardo Henao

We consider the setting of an agent with a fixed body interacting with an unknown and uncertain external world. We show that models trained to predict proprioceptive information about the agent's body come to represent objects in the…

Reinforcement learning has shown great potential in developing high-level autonomous driving. However, for high-dimensional tasks, current RL methods suffer from low data efficiency and oscillation in the training process. This paper…

Machine Learning · Computer Science 2021-02-17 Yuhang Zhang , Yao Mu , Yujie Yang , Yang Guan , Shengbo Eben Li , Qi Sun , Jianyu Chen

We introduce a data-driven approach to computing finite bisimulations for state transition systems with very large, possibly infinite state space. Our novel technique computes stutter-insensitive bisimulations of deterministic systems,…

Logic in Computer Science · Computer Science 2024-05-27 Alessandro Abate , Mirco Giacobbe , Yannik Schnitzer

The robotic systems continuously interact with complex dynamical systems in the physical world. Reliable predictions of spatiotemporal evolution of these dynamical systems, with limited knowledge of system dynamics, are crucial for…

Artificial Intelligence · Computer Science 2019-01-08 Yun Long , Xueyuan She , Saibal Mukhopadhyay

This work presents a scalable control framework based on nonlinear Model Predictive Control for high-dimensional dynamical systems. The proposed approach addresses the key challenges of model scalability and partial observability by…

Machine learning models that incorporate concept learning as an intermediate step in their decision making process can match the performance of black-box predictive models while retaining the ability to explain outcomes in human…

Machine Learning · Computer Science 2021-06-28 Anita Mahinpei , Justin Clark , Isaac Lage , Finale Doshi-Velez , Weiwei Pan

Modeling interaction dynamics to generate robot trajectories that enable a robot to adapt and react to a human's actions and intentions is critical for efficient and effective collaborative Human-Robot Interactions (HRI). Learning from…

Robotics · Computer Science 2023-01-24 Vignesh Prasad , Dorothea Koert , Ruth Stock-Homburg , Jan Peters , Georgia Chalvatzaki

Precise identification of dynamic models in robotics is essential to support control design, friction compensation, output torque estimation, etc. A longstanding challenge remains in the identification of friction models for robotic joints,…

Robotics · Computer Science 2024-12-23 Victor Vantilborgh , Sander De Witte , Frederik Ostyn , Tom Lefebvre , Guillaume Crevecoeur

Rigid bodies, plastic impact, persistent contact, Coulomb friction, and massless limbs are ubiquitous simplifications introduced to reduce the complexity of mechanics models despite the obvious physical inaccuracies that each incurs…

Robotics · Computer Science 2020-07-31 Aaron M. Johnson , Samuel A. Burden , Daniel E. Koditschek

This paper revisits building machine learning algorithms that involve interactions between entities, such as those between financial assets in an actively managed portfolio, or interactions between users in a social network. Our goal is to…

Machine Learning · Computer Science 2022-12-05 Qiong Wu , Jian Li , Zhenming Liu , Yanhua Li , Mihai Cucuringu

An open problem in artificial intelligence is how systems can flexibly learn discrete abstractions that are useful for solving inherently continuous problems. Previous work in computational neuroscience has considered this functional…

Artificial Intelligence · Computer Science 2024-09-04 Poppy Collis , Ryan Singh , Paul F Kinghorn , Christopher L Buckley

Deep networks are commonly used to model dynamical systems, predicting how the state of a system will evolve over time (either autonomously or in response to control inputs). Despite the predictive power of these systems, it has been…

Machine Learning · Computer Science 2020-01-20 Gaurav Manek , J. Zico Kolter

Widespread deployment of societal-scale machine learning systems necessitates a thorough understanding of the resulting long-term effects these systems have on their environment, including loss of trustworthiness, bias amplification, and…

Machine Learning · Computer Science 2024-05-07 Andrey Veprikov , Alexander Afanasiev , Anton Khritankov

Microscopic traffic simulation plays a crucial role in transportation engineering by providing insights into individual vehicle behavior and overall traffic flow. However, creating a realistic simulator that accurately replicates human…

Artificial Intelligence · Computer Science 2024-05-24 Ke Guo , Zhenwei Miao , Wei Jing , Weiwei Liu , Weizi Li , Dayang Hao , Jia Pan

State space models are emerging as a dominant model class for sequence problems with many relying on the HiPPO framework to initialize their dynamics. However, HiPPO fundamentally assumes data to be noise-free; an assumption often violated…

Machine Learning · Computer Science 2025-06-06 Marten Lienen , Abdullah Saydemir , Stephan Günnemann