中文
相关论文

相关论文: Objective Mismatch in Model-based Reinforcement Le…

200 篇论文

Large Multimodal Models (LMMs) have demonstrated impressive performance across numerous academic benchmarks. However, fine-tuning still remains essential to achieve satisfactory performance on downstream tasks, while the task-specific…

计算与语言 · 计算机科学 2024-12-23 Barry Menglong Yao , Qifan Wang , Lifu Huang

Offline reinforcement learning aims to train agents from pre-collected datasets. However, this comes with the added challenge of estimating the value of behaviors not covered in the dataset. Model-based methods offer a potential solution by…

机器学习 · 计算机科学 2024-12-03 Anya Sims , Cong Lu , Jakob Foerster , Yee Whye Teh

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

系统与控制 · 电气工程与系统科学 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Multimodal learning (MML) aims to jointly exploit the common priors of different modalities to compensate for their inherent limitations. However, existing MML methods often optimize a uniform objective for different modalities, leading to…

机器学习 · 计算机科学 2022-11-15 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Junxiao Wang , Song Guo

This paper studies the fast adaptive beamforming for the multiuser multiple-input single-output downlink. Existing deep learning-based approaches assume that training and testing channels follow the same distribution which causes task…

信息论 · 计算机科学 2021-09-21 Juping Zhang , Yi Yuan , Gan Zheng , Ioannis Krikidis , Kai-Kit Wong

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

机器学习 · 计算机科学 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider

Model-driven engineering problems often require complex model transformations (MTs), i.e., MTs that are chained in extensive sequences. Pertinent examples of such problems include model synchronization, automated model repair, and design…

软件工程 · 计算机科学 2025-08-08 Kyanna Dagenais , Istvan David

Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is a important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This paper…

机器学习 · 计算机科学 2022-04-01 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

To further improve the learning efficiency and performance of reinforcement learning (RL), in this paper we propose a novel uncertainty-aware model-based RL (UA-MBRL) framework, and then implement and validate it in autonomous driving under…

机器人学 · 计算机科学 2021-07-06 Jingda Wu , Zhiyu Huang , Chen Lv

Prolonged reinforcement learning with verifiable rewards (RLVR) has been shown to drive continuous improvements in the reasoning capabilities of large language models, but the training is often prone to instabilities, especially in…

人工智能 · 计算机科学 2026-05-13 Yiming Dong , Kun Fu , Haoyu Li , Xinyuan Zhu , Yurou Liu , Lijing Shao , Jieping Ye , Zheng Wang

Misalignment between model predictions and intended usage can be detrimental for the deployment of computer vision models. The issue is exacerbated when the task involves complex structured outputs, as it becomes harder to design procedures…

计算机视觉与模式识别 · 计算机科学 2023-02-17 André Susano Pinto , Alexander Kolesnikov , Yuge Shi , Lucas Beyer , Xiaohua Zhai

Reward functions, learned or manually specified, are rarely perfect. Instead of accurately expressing human goals, these reward functions are often distorted by human beliefs about how best to achieve those goals. Specifically, these reward…

机器学习 · 计算机科学 2025-07-16 Henrik Marklund , Alex Infanger , Benjamin Van Roy

We develop a mathematical framework for solving multi-task reinforcement learning (MTRL) problems based on a type of policy gradient method. The goal in MTRL is to learn a common policy that operates effectively in different environments;…

机器学习 · 计算机科学 2021-05-31 Sihan Zeng , Aqeel Anwar , Thinh Doan , Arijit Raychowdhury , Justin Romberg

Reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems. For many such systems, these policies are trained in a simulated environment. Due to discrepancies between the simulated…

系统与控制 · 电气工程与系统科学 2020-11-23 Anubhav Guha , Anuradha Annaswamy

Unsupervised object-centric representation (OCR) learning has recently drawn attention as a new paradigm of visual representation. This is because of its potential of being an effective pre-training technique for various downstream tasks in…

机器学习 · 计算机科学 2024-02-27 Jaesik Yoon , Yi-Fu Wu , Heechul Bae , Sungjin Ahn

Reinforcement learning (RL) is a powerful approach for robot learning. However, model-free RL (MFRL) requires a large number of environment interactions to learn successful control policies. This is due to the noisy RL training updates and…

机器人学 · 计算机科学 2025-02-28 Maria Krinner , Elie Aljalbout , Angel Romero , Davide Scaramuzza

Model-Predictive Control (MPC) is a powerful tool for controlling complex, real-world systems that uses a model to make predictions about future behavior. For each state encountered, MPC solves an online optimization problem to choose a…

机器学习 · 计算机科学 2021-04-15 Mohak Bhardwaj , Sanjiban Choudhury , Byron Boots

Offline model-based reinforcement learning (MBRL) enhances data efficiency by utilizing pre-collected datasets to learn models and policies, especially in scenarios where exploration is costly or infeasible. Nevertheless, its performance…

机器学习 · 计算机科学 2025-03-04 Haohong Lin , Wenhao Ding , Jian Chen , Laixi Shi , Jiacheng Zhu , Bo Li , Ding Zhao

Continual learning in robotics seeks systems that can constantly adapt to changing environments and tasks, mirroring human adaptability. A key challenge is refining dynamics models, essential for planning and control, while addressing…

机器人学 · 计算机科学 2025-09-09 Alejandro Murillo-Gonzalez , Lantao Liu

The aim of Inverse Reinforcement Learning (IRL) is to infer a reward function $R$ from a policy $\pi$. To do this, we need a model of how $\pi$ relates to $R$. In the current literature, the most common models are optimality, Boltzmann…

机器学习 · 计算机科学 2023-03-27 Joar Skalse , Alessandro Abate