中文
相关论文

相关论文: FLAC: Maximum Entropy RL via Kinetic Energy Regula…

200 篇论文

Safe reinforcement learning (RL) with hard constraint guarantees is a promising optimal control direction for multi-energy management systems. It only requires the environment-specific constraint functions itself a priori and not a complete…

系统与控制 · 电气工程与系统科学 2023-11-07 Glenn Ceusters , Muhammad Andy Putratama , Rüdiger Franke , Ann Nowé , Maarten Messagie

RLHF is widely used to align flow-matching text-to-image models with human preferences, but often leads to severe diversity collapse after fine-tuning. In RL, diversity is often assumed to correlate with policy entropy, motivating entropy…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Xiaofeng Tan , Jun Liu , Bin-Bin Gao , Yuanting Fan , Xi Jiang , Chengjie Wang , Hongsong Wang , Feng Zheng

Reinforcement learning (RL) with combinatorial action spaces remains challenging because feasible action sets are exponentially large and governed by complex feasibility constraints, making direct policy parameterization impractical.…

Acquiring labeled data is challenging in many machine learning applications with limited budgets. Active learning gives a procedure to select the most informative data points and improve data efficiency by reducing the cost of labeling. The…

机器学习 · 计算机科学 2023-04-18 Jae Oh Woo

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

机器学习 · 计算机科学 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

Entropy regularization is an important idea in reinforcement learning, with great success in recent algorithms like Soft Q Network (SQN) and Soft Actor-Critic (SAC1). In this work, we extend this idea into the on-policy realm. We propose…

机器学习 · 计算机科学 2020-10-19 Jingbin Liu , Xinyang Gu , Shuai Liu

This work uses the entropy-regularised relaxed stochastic control perspective as a principled framework for designing reinforcement learning (RL) algorithms. Herein agent interacts with the environment by generating noisy controls…

机器学习 · 计算机科学 2023-09-18 Lukasz Szpruch , Tanut Treetanthiploet , Yufei Zhang

Simplicity is a critical inductive bias for designing data-driven controllers, especially when robustness is important. Despite the impressive results of deep reinforcement learning in complex control tasks, it is prone to capturing…

机器学习 · 计算机科学 2025-05-09 Bang You , Chenxu Wang , Huaping Liu

We propose an optimization framework for stochastic optimal power flow with uncertain loads and renewable generator capacity. Our model follows previous work in assuming that generator outputs respond to load imbalances according to an…

最优化与控制 · 数学 2019-10-11 Rohit Kannan , James R. Luedtke , Line A. Roald

We study optimal policy learning under combined budget and minimum coverage constraints. We show that the problem admits a knapsack-type structure and that the optimal policy can be characterized by an affine threshold rule involving both…

机器学习 · 统计学 2026-05-13 Giovanni Cerulli

Active flow control (AFC) involves manipulating fluid flow over time to achieve a desired performance or efficiency. AFC, as a sequential optimisation task, can benefit from utilising Reinforcement Learning (RL) for dynamic optimisation. In…

机器学习 · 计算机科学 2023-05-04 Mosayeb Shams , Ahmed H. Elsheikh

Reinforcement learning (RL) agents have long sought to approach the efficiency of human learning. Humans are great observers who can learn by aggregating external knowledge from various sources, including observations from others' policies…

机器学习 · 计算机科学 2023-10-11 Zih-Yun Chiu , Yi-Lin Tuan , William Yang Wang , Michael C. Yip

Mixture models are an expressive hypothesis class that can approximate a rich set of policies. However, using mixture policies in the Maximum Entropy (MaxEnt) framework is not straightforward. The entropy of a mixture model is not equal to…

机器学习 · 计算机科学 2021-03-19 Nir Baram , Guy Tennenholtz , Shie Mannor

There is a growing need for new optimization methods to facilitate the reliable and cost-effective operation of power systems with intermittent renewable energy resources. In this paper, we formulate the robust AC optimal power flow…

最优化与控制 · 数学 2018-04-03 Raphael Louca , Eilyan Bitar

This paper presents a general framework for exploiting the representational capacity of neural networks to approximate complex, nonlinear reward functions in the context of solving the inverse reinforcement learning (IRL) problem. We show…

机器学习 · 计算机科学 2016-03-14 Markus Wulfmeier , Peter Ondruska , Ingmar Posner

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

机器学习 · 计算机科学 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

We establish a new connection between value and policy based reinforcement learning (RL) based on a relationship between softmax temporal value consistency and policy optimality under entropy regularization. Specifically, we show that…

人工智能 · 计算机科学 2017-11-27 Ofir Nachum , Mohammad Norouzi , Kelvin Xu , Dale Schuurmans

We focus on a simulation-based optimization problem of choosing the best design from the feasible space. Although the simulation model can be queried with finite samples, its internal processing rule cannot be utilized in the optimization…

机器学习 · 计算机科学 2021-11-02 Kuo Li , Qing-Shan Jia , Jiaqi Yan

Model-free deep reinforcement learning (RL) algorithms have achieved tremendous success on a range of challenging tasks. However, safety concerns remain when these methods are deployed on real-world applications, necessitating risk-aware…

机器学习 · 计算机科学 2026-02-10 Alonso Granados , Jason Pacheco

Modern vision generators transport a base distribution to data through time-indexed measures, implemented as deterministic flows (ODEs) or stochastic diffusions (SDEs). Despite strong empirical performance, standard flow-matching objectives…

机器学习 · 计算机科学 2026-02-27 Chika Maduabuchi