中文
相关论文

相关论文: Any-step Dynamics Model Improves Future Prediction…

200 篇论文

Self-evaluation, a model's ability to assess the correctness of its own output, is crucial for Large Multimodal Models (LMMs) to achieve self-improvement in multi-turn conversations, yet largely absent in foundation models. Recent work has…

机器学习 · 计算机科学 2025-08-14 Wenkai Wang , Hongcan Guo , Zheqi Lv , Shengyu Zhang

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

机器学习 · 计算机科学 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

Model-based next state prediction and state value prediction are slow to converge. To address these challenges, we do the following: i) Instead of a neural network, we do model-based planning using a parallel memory retrieval system (which…

人工智能 · 计算机科学 2023-02-02 John Chong Min Tan , Mehul Motani

Online planning has proven effective in reinforcement learning (RL) for improving sample efficiency and final performance. However, using planning for environment interaction inevitably introduces a divergence between the collected data and…

机器学习 · 计算机科学 2026-01-16 Guojian Zhan , Likun Wang , Xiangteng Zhang , Jiaxin Gao , Masayoshi Tomizuka , Shengbo Eben Li

One of the key challenges in applying reinforcement learning to complex robotic control tasks is the need to gather large amounts of experience in order to find an effective policy for the task at hand. Model-based reinforcement learning…

机器学习 · 计算机科学 2016-08-12 Justin Fu , Sergey Levine , Pieter Abbeel

Offline model-based reinforcement learning (MBRL) serves as a competitive framework that can learn well-performing policies solely from pre-collected data with the help of learned dynamics models. To fully unleash the power of offline MBRL,…

机器学习 · 计算机科学 2025-02-18 Yu-Wei Yang , Yun-Ming Chan , Wei Hung , Xi Liu , Ping-Chun Hsieh

This study addresses the critical challenge of error accumulation in spatio-temporal auto-regressive (AR) predictions within scientific machine learning models by exploring temporal integration schemes and adaptive multi-step rollout…

机器学习 · 计算机科学 2025-09-25 Sunwoong Yang , Ricardo Vinuesa , Namwoo Kang

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions.…

最优化与控制 · 数学 2020-09-16 David Biagioni , Peter Graf , Xiangyu Zhang , Ahmed Zamzam , Kyri Baker , Jennifer King

We propose a new method for computing Dynamic Mode Decomposition (DMD) evolution matrices, which we use to analyze dynamical systems. Unlike the majority of existing methods, our approach is based on a variational formulation consisting of…

数值分析 · 数学 2019-05-24 Omri Azencot , Wotao Yin , Andrea Bertozzi

Automated planning algorithms require an action model specifying the preconditions and effects of each action, but obtaining such a model is often hard. Learning action models from observations is feasible, but existing algorithms for…

人工智能 · 计算机科学 2026-04-13 Yarin Benyamin , Argaman Mordoch , Shahaf S. Shperberg , Roni Stern

When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a…

机器学习 · 计算机科学 2018-11-02 Kavosh Asadi , Evan Cater , Dipendra Misra , Michael L. Littman

A promising way to improve the sample efficiency of reinforcement learning is model-based methods, in which many explorations and evaluations can happen in the learned models to save real-world samples. However, when the learned model has a…

机器学习 · 计算机科学 2022-09-14 Haoxin Lin , Yihao Sun , Jiaji Zhang , Yang Yu

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

Modeling dynamics is often the first step to making a vehicle autonomous. While on-road autonomous vehicles have been extensively studied, off-road vehicles pose many challenging modeling problems. An off-road vehicle encounters highly…

Active learning is a machine learning paradigm that aims to improve the performance of a model by strategically selecting and querying unlabeled data. One effective selection strategy is to base it on the model's predictive uncertainty,…

机器学习 · 计算机科学 2024-05-17 Seong Jin Cho , Gwangsu Kim , Junghyun Lee , Jinwoo Shin , Chang D. Yoo

Model usage is the central challenge of model-based reinforcement learning. Although dynamics model based on deep neural networks provide good generalization for single step prediction, such ability is over exploited when it is used to…

机器学习 · 计算机科学 2020-06-30 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

Reinforcement learning has become a cornerstone technique for developing reasoning models in complex tasks, ranging from mathematical problem-solving to imaginary reasoning. The optimization of these models typically relies on policy…

机器学习 · 计算机科学 2026-02-11 Qingnan Ren , Shiting Huang , Zhen Fang , Zehui Chen , Lin Chen , Lijun Li , Feng Zhao

Collaborative transportation of heavy payloads via loco-manipulation is a challenging yet essential capability for legged robots operating in complex, unstructured environments. Centralized planning methods, e.g., holistic trajectory…

机器人学 · 计算机科学 2026-03-10 Ziyi Zhou , Pengyuan Shu , Ruize Cao , Yuntian Zhao , Ye Zhao

Dynamic model averaging (DMA) combines the forecasts of a large number of dynamic linear models (DLMs) to predict the future value of a time series. The performance of DMA critically depends on the appropriate choice of two forgetting…

计量经济学 · 经济学 2019-12-11 Alisa Yusupova , Nicos G. Pavlidis , Efthymios G. Pavlidis

Accurately predicting the dynamics of robotic systems is crucial for model-based control and reinforcement learning. The most common way to estimate dynamics is by fitting a one-step ahead prediction model and using it to recursively…

机器学习 · 计算机科学 2021-09-02 Nathan O. Lambert , Albert Wilcox , Howard Zhang , Kristofer S. J. Pister , Roberto Calandra