中文
相关论文

相关论文: Bellman operator convergence enhancements in reinf…

200 篇论文

Learned representations in deep reinforcement learning (DRL) have to extract task-relevant information from complex observations, balancing between robustness to distraction and informativeness to the policy. Such stable and rich…

机器学习 · 计算机科学 2021-10-28 Mete Kemertas , Tristan Aumentado-Armstrong

We study reinforcement learning under model misspecification, where we do not have access to the true environment but only to a reasonably close approximation to it. We address this problem by extending the framework of robust MDPs to the…

机器学习 · 计算机科学 2017-11-10 Aurko Roy , Huan Xu , Sebastian Pokutta

As large language models (LLMs) continue to grow in capability, so do the risks of harmful misuse through fine-tuning. While most prior studies assume that attackers rely on supervised fine-tuning (SFT) for such misuse, we systematically…

机器学习 · 计算机科学 2026-05-12 Weitao Feng , Lixu Wang , Peizhuo Lv , Tianyi Wei , Jie Zhang , Chongyang Gao , Sinong Zhan , Wei Dong

Offline Reinforcement Learning (RL) is a promising approach for next-generation wireless networks, where online exploration is unsafe and large amounts of operational data can be reused across the model lifecycle. However, the behavior of…

网络与互联网体系结构 · 计算机科学 2026-03-05 Nicolas Helson , Pegah Alizadeh , Anastasios Giovanidis

Here, we report a case study implementation of reinforcement learning (RL) to automate operations in the scanning transmission electron microscopy (STEM) workflow. To do so, we design a virtual, prototypical RL environment to test and…

仪器与探测器 · 物理学 2022-08-08 Michael Xu , Abinash Kumar , James M. LeBeau

Designing model-free algorithms for distributionally robust reinforcement learning (DRRL) poses fundamental challenges. The robust Bellman operator is nonlinear in the transition kernel, which makes one-sample Bellman updates biased, while…

机器学习 · 计算机科学 2026-05-12 Shengbo Wang , Zexi Zhang

Reinforcement learning (RL) algorithms have demonstrated promising results on complex tasks, yet often require impractical numbers of samples since they learn from scratch. Meta-RL aims to address this challenge by leveraging experience…

机器学习 · 计算机科学 2020-10-28 Russell Mendonca , Abhishek Gupta , Rosen Kralev , Pieter Abbeel , Sergey Levine , Chelsea Finn

Offline reinforcement learning (RL) defines the task of learning from a fixed batch of data. Due to errors in value estimation from out-of-distribution actions, most offline RL algorithms take the approach of constraining or regularizing…

机器学习 · 计算机科学 2021-12-06 Scott Fujimoto , Shixiang Shane Gu

Most value function learning algorithms in reinforcement learning are based on the mean squared (projected) Bellman error. However, squared errors are known to be sensitive to outliers, both skewing the solution of the objective and…

机器学习 · 计算机科学 2023-04-19 Andrew Patterson , Victor Liao , Martha White

In recent years, reinforcement learning (RL) has acquired a prominent position in health-related sequential decision-making problems, gaining traction as a valuable tool for delivering adaptive interventions (AIs). However, in part due to a…

机器学习 · 统计学 2024-07-16 Nina Deliu , Joseph Jay Williams , Bibhas Chakraborty

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

系统与控制 · 电气工程与系统科学 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

Much of our understanding of critical phenomena is based on the notion of Renormalization Group (RG), but the actual determination of its fixed points is usually based on approximations and truncations, and predictions of physical…

高能物理 - 理论 · 物理学 2021-02-02 Alessandro Giuliani , Vieri Mastropietro , Slava Rychkov

Reasoning abilities, especially those for solving complex math problems, are crucial components of general intelligence. Recent advances by proprietary companies, such as o-series models of OpenAI, have made remarkable progress on reasoning…

In the era of Large Language Models (LLMs), alignment has emerged as a fundamental yet challenging problem in the pursuit of more reliable, controllable, and capable machine intelligence. The recent success of reasoning models and…

机器学习 · 计算机科学 2025-07-18 Hao Sun , Mihaela van der Schaar

While originally developed for continuous control problems, Proximal Policy Optimization (PPO) has emerged as the work-horse of a variety of reinforcement learning (RL) applications, including the fine-tuning of generative models.…

Operator learning refers to the application of ideas from machine learning to approximate (typically nonlinear) operators mapping between Banach spaces of functions. Such operators often arise from physical models expressed in terms of…

机器学习 · 计算机科学 2024-02-27 Nikola B. Kovachki , Samuel Lanthaler , Andrew M. Stuart

Reinforcement learning (RL) combines a control problem with statistical estimation: The system dynamics are not known to the agent, but can be learned through experience. A recent line of research casts `RL as inference' and suggests a…

机器学习 · 计算机科学 2020-11-05 Brendan O'Donoghue , Ian Osband , Catalin Ionescu

Wasserstein policy gradient (WPG) is a policy optimization method for reinforcement learning (RL) that exploits the optimal-transport geometry of action distributions. For the entropy-regularized RL objective, WPG evolves each…

机器学习 · 计算机科学 2026-05-27 Zhaoyu Zhu , Rui Gao , Shuang Li

Deep Reinforcement Learning (RL) is remarkably effective in addressing sequential resource allocation problems in domains such as healthcare, public policy, and resource management. However, deep RL policies often lack transparency and…

机器学习 · 计算机科学 2025-02-18 Mauricio Tec , Guojun Xiong , Haichuan Wang , Francesca Dominici , Milind Tambe

Empowerment is an information-theoretic method that can be used to intrinsically motivate learning agents. It attempts to maximize an agent's control over the environment by encouraging visiting states with a large number of reachable next…

机器学习 · 计算机科学 2020-01-09 Felix Leibfried , Sergio Pascual-Diaz , Jordi Grau-Moya