中文
相关论文

相关论文: How to Fine-tune the Model: Unified Model Shift an…

200 篇论文

Decentralized policy optimization has been commonly used in cooperative multi-agent tasks. However, since all agents are updating their policies simultaneously, from the perspective of individual agents, the environment is non-stationary,…

机器学习 · 计算机科学 2023-02-17 Hao Luo , Jiechuan Jiang , Zongqing Lu

Informed and robust decision making in the face of uncertainty is critical for robots that perform physical tasks alongside people. We formulate this as Bayesian Reinforcement Learning over latent Markov Decision Processes (MDPs). While…

机器人学 · 计算机科学 2020-02-11 Gilwoo Lee , Brian Hou , Sanjiban Choudhury , Siddhartha S. Srinivasa

It is challenging for reinforcement learning (RL) algorithms to succeed in real-world applications like financial trading and logistic system due to the noisy observation and environment shifting between training and evaluation. Thus, it…

机器学习 · 计算机科学 2022-05-20 Zhengyu Yang , Kan Ren , Xufang Luo , Minghuan Liu , Weiqing Liu , Jiang Bian , Weinan Zhang , Dongsheng Li

The field of risk-constrained reinforcement learning (RCRL) has been developed to effectively reduce the likelihood of worst-case scenarios by explicitly handling risk-measure-based constraints. However, the nonlinearity of risk measures…

机器学习 · 计算机科学 2024-05-30 Dohyeong Kim , Taehyun Cho , Seungyub Han , Hojun Chung , Kyungjae Lee , Songhwai Oh

Chemical process optimization and control are affected by 1) plant-model mismatch, 2) process disturbances, and 3) constraints for safe operation. Reinforcement learning by policy optimization would be a natural way to solve this due to its…

Reinforcement learning has become a cornerstone for aligning and unlocking the reasoning capabilities of large-scale models. At its core, the training loop of GRPO and its variants alternates between rollout sampling and policy update.…

机器学习 · 计算机科学 2026-05-21 Xikai Zhang , Yongzhi Li , Likang Xiao , Yingze Zhang , Yanhua Cheng , Quan Chen , Peng Jiang , Wenjun Wu , Liu Liu

In reinforcement learning (RL), an autonomous agent learns to perform complex tasks by maximizing an exogenous reward signal while interacting with its environment. In real-world applications, test conditions may differ substantially from…

机器人学 · 计算机科学 2019-10-30 Matteo Turchetta , Andreas Krause , Sebastian Trimpe

As Large Language Models (LLMs) demonstrate remarkable capabilities learned from vast corpora, concerns regarding data privacy and safety are receiving increasing attention. LLM unlearning, which aims to remove the influence of specific…

机器学习 · 计算机科学 2025-10-07 Kai Qin , Jiaqi Wu , Jianxiang He , Haoyuan Sun , Yifei Zhao , Bin Liang , Yongzhe Chang , Tiantian Zhang , Houde Liu

Fine-tuning pre-trained robot policies with reinforcement learning (RL) often inherits the bottlenecks introduced by pre-training with behavioral cloning (BC), which produces narrow action distributions that lack the coverage necessary for…

机器人学 · 计算机科学 2026-05-13 Matthew M. Hong , Jesse Zhang , Anusha Nagabandi , Abhishek Gupta

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

机器学习 · 计算机科学 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

Reinforcement Learning with Verifiable Rewards (RLVR) has achieved substantial gains in single-attempt accuracy (Pass@1) on reasoning tasks, yet often suffers from reduced multi-sample coverage (Pass@K), indicating diversity collapse. We…

机器学习 · 计算机科学 2026-05-04 Anamika Lochab , Bolian Li , Ruqi Zhang

In this paper, we present a Model-Based Reinforcement Learning (MBRL) algorithm named \emph{Monte Carlo Probabilistic Inference for Learning COntrol} (MC-PILCO). The algorithm relies on Gaussian Processes (GPs) to model the system dynamics…

Current methods for end-to-end constructive neural combinatorial optimization usually train a policy using behavior cloning from expert solutions or policy gradient methods from reinforcement learning. While behavior cloning is…

机器学习 · 计算机科学 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

This paper presents a deep reinforcement learning (DRL) framework for dynamic portfolio optimization under market uncertainty and risk. The proposed model integrates a Sharpe ratio-based reward function with direct risk control mechanisms,…

投资组合管理 · 定量金融 2025-11-17 Emmanuel Lwele , Sabuni Emmanuel , Sitali Gabriel Sitali

Large language models (LLMs) trained with reinforcement objectives often achieve superficially correct answers via shortcut strategies, pairing correct outputs with spurious or unfaithful reasoning and degrading under small causal…

机器学习 · 计算机科学 2025-09-30 Xiangqi Wang , Yue Huang , Yujun Zhou , Xiaonan Luo , Kehan Guo , Xiangliang Zhang

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

最优化与控制 · 数学 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Reinforcement learning with verifiable rewards (RLVR) has become a core post-training recipe. Introducing suitable off-policy trajectories into on-policy exploration accelerates RLVR convergence and raises the performance ceiling, yet…

机器学习 · 计算机科学 2026-04-23 Chuanyu Qin , Chenxu Yang , Qingyi Si , Naibin Gu , Dingyu Yao , Zheng Lin , Peng Fu , Nan Duan , Jiaqi Wang

The Group Relative Policy Optimization (GRPO), a reinforcement learning method used to fine-tune large language models (LLMs), has proved its effectiveness in practical applications such as DeepSeek-R1. It raises a question whether GRPO can…

机器学习 · 计算机科学 2025-11-20 Yanchen Xu , Ziheng Jiao , Hongyuan Zhang , Xuelong Li

This paper addresses the slow policy optimization convergence of Monte Carlo Probabilistic Inference for Learning Control (MC-PILCO), a state-of-the-art model-based reinforcement learning (MBRL) algorithm, by integrating it with iterative…

机器学习 · 计算机科学 2025-06-04 Marco Calì , Giulio Giacomuzzo , Ruggero Carli , Alberto Dalla Libera

Universal machine-learned interatomic potentials (U-MLIPs) have demonstrated effectiveness across diverse atomistic systems but often require fine-tuning for task-specific accuracy. We investigate the fine-tuning of two MACE-based…

计算物理 · 物理学 2025-06-10 Xiaoqing Liu , Kehan Zeng , Yangshuai Wang , Teng Zhao