中文
相关论文

相关论文: Boosting Trust Region Policy Optimization by Norma…

200 篇论文

Normalizing flows are exact-likelihood generative neural networks which approximately transform samples from a simple prior distribution to samples of the probability distribution of interest. Recent work showed that such generative models…

机器学习 · 统计学 2020-10-27 Jonas Köhler , Leon Klein , Frank Noé

A normalizing flow models a complex probability density as an invertible transformation of a simple base density. Flows based on either coupling or autoregressive transforms both offer exact density evaluation and sampling, but rely on the…

机器学习 · 统计学 2019-12-03 Conor Durkan , Artur Bekasov , Iain Murray , George Papamakarios

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

机器学习 · 统计学 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

In real-world decision making tasks, it is critical for data-driven reinforcement learning methods to be both stable and sample efficient. On-policy methods typically generate reliable policy improvement throughout training, while…

机器学习 · 计算机科学 2021-11-02 James Queeney , Ioannis Ch. Paschalidis , Christos G. Cassandras

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

机器学习 · 计算机科学 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden

Large pre-trained models, such as Bert, GPT, and Wav2Vec, have demonstrated great potential for learning representations that are transferable to a wide variety of downstream tasks . It is difficult to obtain a large quantity of supervised…

计算与语言 · 计算机科学 2022-12-23 Neeraj Kumar , Ankur Narang , Brejesh Lall

The transfer of knowledge from one policy to another is an important tool in Deep Reinforcement Learning. This process, referred to as distillation, has been used to great success, for example, by enhancing the optimisation of agents,…

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

机器人学 · 计算机科学 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these…

机器学习 · 统计学 2022-07-13 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

One of the fundamental challenges for offline reinforcement learning (RL) is ensuring robustness to data distribution. Whether the data originates from a near-optimal policy or not, we anticipate that an algorithm should demonstrate its…

机器学习 · 计算机科学 2023-10-18 Xiaohan Hu , Yi Ma , Chenjun Xiao , Yan Zheng , Jianye Hao

Recent machine-learning approaches to deterministic search and domain-independent planning employ policy learning to speed up search. Unfortunately, when attempting to solve a search problem by successively applying a policy, no guarantees…

人工智能 · 计算机科学 2021-08-05 Pablo Araneda , Matias Greco , Jorge A. Baier

Recently, Large Language Models (LLMs) have rapidly evolved, approaching Artificial General Intelligence (AGI) while benefiting from large-scale reinforcement learning to enhance Human Alignment (HA) and Reasoning. Recent reward-based…

机器学习 · 计算机科学 2025-06-19 Xuerui Su , Shufang Xie , Guoqing Liu , Yingce Xia , Renqian Luo , Peiran Jin , Zhiming Ma , Yue Wang , Zun Wang , Yuting Liu

Model-free reinforcement learning algorithms have seen remarkable progress, but key challenges remain. Trust Region Policy Optimization (TRPO) is known for ensuring monotonic policy improvement through conservative updates within a trust…

机器学习 · 计算机科学 2025-07-29 Zhengpeng Xie , Qiang Zhang , Fan Yang , Marco Hutter , Renjing Xu

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that is routinely generated. In applications that are constrained by memory and computational intensity, excessively large…

机器学习 · 计算机科学 2023-02-28 Malik Hassanaly , Bruce A. Perry , Michael E. Mueller , Shashank Yellapantula

Our goal is to compute a policy that guarantees improved return over a baseline policy even when the available MDP model is inaccurate. The inaccurate model may be constructed, for example, by system identification techniques when the true…

最优化与控制 · 数学 2015-06-17 Yinlam Chow , Marek Petrik , Mohammad Ghavamzadeh

Extracting the maximum amount of cosmological and astrophysical information from upcoming large-scale surveys remains a challenge. This includes evaluating the exact likelihood, parameter inference and generating new diverse synthetic…

宇宙学与河外天体物理 · 物理学 2022-11-24 Roy Friedman , Sultan Hassan

Lack of standardization and various intrinsic parameters for magnetic resonance (MR) image acquisition results in heterogeneous images across different sites and devices, which adversely affects the generalization of deep neural networks.…

The trust region method is an algorithm traditionally used in the field of derivative free optimization. The method works by iteratively constructing surrogate models (often linear or quadratic functions) to approximate the true objective…

最优化与控制 · 数学 2017-06-12 Ky Vu , Pierre-Louis Poirion , Claudia D'Ambrosio , Leo Liberti

Normalizing flows can transform a simple prior probability distribution into a more complex target distribution. Here, we evaluate the ability and efficiency of generative machine learning methods to sample the Boltzmann distribution of an…

软凝聚态物质 · 物理学 2024-09-16 Gerhard Jung , Giulio Biroli , Ludovic Berthier

In many scientific applications, the target probability distribution cannot be evaluated in closed form or sampled from directly. Instead, it can often be decomposed into multiple components, some of which are accessible only through…

统计方法学 · 统计学 2026-03-10 Roxana Darvishi , David C. Stenning , Ted von Hippel , Owen G. Ward