English
Related papers

Related papers: Path-Coupled Bellman Flows for Distributional Rein…

200 papers

The escalating interests on underwater exploration/reconnaissance applications have motivated high-rate data transmission from underwater to airborne relaying platforms, especially under high-sea scenarios. Thanks to its broad bandwidth and…

Signal Processing · Electrical Eng. & Systems 2024-09-06 Jiayue Liu , Tianqi Mao , Dongxuan He , Yang Yang , Zhen Gao , Dezhi Zheng , Jun Zhang

We propose a novel algorithmic framework for distributional reinforcement learning, based on learning finite-dimensional mean embeddings of return distributions. We derive several new algorithms for dynamic programming and…

Training energy-based models (EBMs) on high-dimensional data can be both challenging and time-consuming, and there exists a noticeable gap in sample quality between EBMs and other generative frameworks like GANs and diffusion models. To…

Machine Learning · Statistics 2024-11-12 Yaxuan Zhu , Jianwen Xie , Yingnian Wu , Ruiqi Gao

The distributional reinforcement learning (RL) approach advocates for representing the complete probability distribution of the random return instead of only modelling its expectation. A distributional RL algorithm may be characterised by…

Machine Learning · Computer Science 2023-03-20 Thibaut Théate , Antoine Wehenkel , Adrien Bolland , Gilles Louppe , Damien Ernst

The goal of many applications in energy and transport sectors is to control turbulent flows. However, because of chaotic dynamics and high dimensionality, the control of turbulent flows is exceedingly difficult. Model-free reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Defne E. Ozan , Andrea Nóvoa , Luca Magri

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

Designing effective task sequences is crucial for curriculum reinforcement learning (CRL), where agents must gradually acquire skills by training on intermediate tasks. A key challenge in CRL is to identify tasks that promote exploration,…

Machine Learning · Computer Science 2025-07-08 Geonwoo Cho , Jaegyun Im , Doyoon Kim , Sundong Kim

Many real-world control problems, ranging from finance to robotics, evolve in continuous time with non-uniform, event-driven decisions. Standard discrete-time reinforcement learning (RL), based on fixed-step Bellman updates, struggles in…

Machine Learning · Computer Science 2026-02-17 Minh Nguyen

Ultra-Reliable and Low-Latency Communications (URLLC) services in vehicular networks on millimeter-wave bands present a significant challenge, considering the necessity of constantly adjusting the beam directions. Conventional methods are…

Information Theory · Computer Science 2020-02-14 Yan Liu , Zhiyuan Jiang , Shunqing Zhang , Shugong Xu

Decision-focused learning (DFL) has emerged as a powerful end-to-end alternative to conventional predict-then-optimize (PTO) pipelines by directly optimizing predictive models through downstream decision losses. Existing DFL frameworks are…

Machine Learning · Computer Science 2025-12-01 Xinyu Wang , Jinxiao Du , Yiyang Peng , Wei Ma

Distributional Reinforcement Learning (RL) maintains the entire probability distribution of the reward-to-go, i.e. the return, providing more learning signals that account for the uncertainty associated with policy performance, which may be…

Machine Learning · Computer Science 2021-03-24 Luchen Li , A. Aldo Faisal

Reinforcement Learning (RL) algorithms suffer from the dependency on accurately engineered reward functions to properly guide the learning agents to do the required tasks. Preference-based reinforcement learning (PbRL) addresses that by…

Artificial Intelligence · Computer Science 2024-08-23 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

Federated learning (FL) aims to train machine learning (ML) models collaboratively using decentralized data, bypassing the need for centralized data aggregation. Standard FL models often assume that all data come from the same unknown…

Machine Learning · Computer Science 2025-03-25 Wen Bai , Yi Wong , Xiao Qiao , Chin Pang Ho

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Diffusion and flow policies are gaining prominence in online reinforcement learning (RL) due to their expressive power, yet training them efficiently remains a critical challenge. A fundamental difficulty in online RL is the lack of direct…

Machine Learning · Computer Science 2026-01-14 Zeyang Li , Sunbochen Tang , Navid Azizan

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

Training neural networks with reinforcement learning (RL) typically relies on backpropagation (BP), necessitating storage of activations from the forward pass for subsequent backward updates. Furthermore, backpropagating error signals…

Machine Learning · Computer Science 2025-07-16 Daniel Tanneberg

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Deep Reinforcement Learning (DRL) has emerged as a promising approach for handling highly dynamic and nonlinear Active Flow Control (AFC) problems. However, the computational cost associated with training DRL models presents a significant…

Machine Learning · Computer Science 2024-09-27 Wang Jia , Hang Xu