English
Related papers

Related papers: Model-based Meta Reinforcement Learning using Grap…

200 papers

The optimization of structural parameters, such as mass(m), stiffness(k), and damping coefficient(c), is critical for designing efficient, resilient, and stable structures. Conventional numerical approaches, including Finite Element Method…

Neural and Evolutionary Computing · Computer Science 2026-02-24 Sagnik Mukherjee , Indrajit Barua

In this paper, we present a robotic model-based reinforcement learning method that combines ideas from model identification and model predictive control. We use a feature-based representation of the dynamics that allows the dynamics model…

Machine Learning · Computer Science 2016-03-16 Christopher Xie , Sachin Patil , Teodor Moldovan , Sergey Levine , Pieter Abbeel

High-fidelity simulation models are widely used to analyze complex stochastic systems, but their high computational cost motivates the development of cheaper surrogate models that approximate the simulation model's input-output…

Machine Learning · Statistics 2026-05-28 Mohammadmahdi Ghasemloo , David J. Eckman , Yaxian Li

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

In meta-reinforcement learning, an agent is trained in multiple different environments and attempts to learn a meta-policy that can efficiently adapt to a new environment. This paper presents RAMP, a Reinforcement learning Agent using Model…

Machine Learning · Computer Science 2022-10-28 Gabriel Hartmann , Amos Azaria

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

Probabilistic graphical models (PGMs) are widely used to discover latent structure in data, but their success hinges on selecting an appropriate model design. In practice, model specification is difficult and often requires iterative…

Machine Learning · Computer Science 2026-04-08 Kevin Zhang , Yixin Wang

Learning-based methods have been used to pro-gram robotic tasks in recent years. However, extensive training is usually required not only for the initial task learning but also for generalizing the learned model to the same task but in…

Robotics · Computer Science 2019-12-12 Tianying Wang , Hao Zhang , Wei Qi Toh , Hongyuan Zhu , Cheston Tan , Yan Wu , Yong Liu , Wei Jing

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

This paper investigates a new approach to model-based reinforcement learning using background planning: mixing (approximate) dynamic programming updates and model-free updates, similar to the Dyna architecture. Background planning with…

Machine Learning · Computer Science 2024-06-04 Kevin Roice , Parham Mohammad Panahi , Scott M. Jordan , Adam White , Martha White

Despite recent progress in time-series foundation models, challenges persist in improving representation learning and adapting to diverse downstream tasks. We introduce a General Time-series Model (GTM), which advances representation…

Machine Learning · Computer Science 2026-03-13 Cheng He , Xu Huang , Gangwei Jiang , Zhaoyi Li , Defu Lian , Hong Xie , Enhong Chen , Xijie Liang , Zengrong Zheng , Patrick P. C. Lee

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Sample efficiency in the face of computationally expensive simulations is a common concern in surrogate modeling. Current strategies to minimize the number of samples needed are not as effective in simulated environments with wide state…

Machine Learning · Computer Science 2025-09-03 Julen Cestero , Marco Quartulli , Marcello Restelli

Despite increasing attention paid to the need for fast, scalable methods to analyze next-generation neuroscience data, comparatively little attention has been paid to the development of similar methods for behavioral analysis. Just as the…

Neurons and Cognition · Quantitative Biology 2017-11-02 Shariq Iqbal , John Pearson

We introduce a unified probabilistic framework for solving sequential decision making problems ranging from Bayesian optimisation to contextual bandits and reinforcement learning. This is accomplished by a probabilistic model-based approach…

In many-task optimization scenarios, surrogate models are valuable for mitigating the computational burden of repeated fitness evaluations across tasks. This study proposes a novel meta-surrogate framework to assist many-task optimization,…

Machine Learning · Computer Science 2026-02-05 Xian-Rong Zhang , Yue-Jiao Gong , Yuan-Ting Zhong , Ting Huang , Jun Zhang

Most reinforcement learning (RL) methods only focus on learning a single task from scratch and are not able to use prior knowledge to learn other tasks more effectively. Context-based meta RL techniques are recently proposed as a possible…

Machine Learning · Computer Science 2022-08-01 Xu Han , Feng Wu

Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to generalize across…

Machine Learning · Computer Science 2023-05-30 Boyuan Chen , Chuning Zhu , Pulkit Agrawal , Kaiqing Zhang , Abhishek Gupta

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Systematic exploration of Agent-Based Models (ABMs) is challenged by the curse of dimensionality and their inherent stochasticity. We present a multi-stage pipeline integrating the systematic design of experiments with machine learning…

Machine Learning · Computer Science 2026-04-07 Paul Saves , Matthieu Mastio , Nicolas Verstaevel , Benoit Gaudou