English
Related papers

Related papers: Parameter-Efficient Distributional RL via Normaliz…

200 papers

Distributional reinforcement learning (DRL) has achieved empirical success in various domains. One core task in DRL is distributional policy evaluation, which involves estimating the return distribution $\eta^\pi$ for a given policy $\pi$.…

Machine Learning · Statistics 2025-01-17 Yang Peng , Liangyu Zhang , Zhihua Zhang

Modern deep generative models can assign high likelihood to inputs drawn from outside the training distribution, posing threats to models in open-world deployments. While much research attention has been placed on defining new test-time…

Machine Learning · Computer Science 2022-08-22 Mu Cai , Yixuan Li

Although distributional reinforcement learning (DRL) has been widely examined in the past few years, very few studies investigate the validity of the obtained Q-function estimator in the distributional setting. To fully understand how the…

Machine Learning · Computer Science 2023-08-01 Qi Kuang , Zhoufan Zhu , Liwen Zhang , Fan Zhou

We propose a framework for distributed robust statistical learning on {\em big contaminated data}. The Distributed Robust Learning (DRL) framework can reduce the computational time of traditional robust learning methods by several orders of…

Machine Learning · Statistics 2015-02-10 Jiashi Feng , Huan Xu , Shie Mannor

We consider the problem of learning a set of probability distributions from the empirical Bellman dynamics in distributional reinforcement learning (RL), a class of state-of-the-art methods that estimate the distribution, as opposed to only…

Machine Learning · Computer Science 2020-12-10 Thanh Tang Nguyen , Sunil Gupta , Svetha Venkatesh

To mitigate the limitation that the classical reinforcement learning (RL) framework heavily relies on identical training and test environments, Distributionally Robust RL (DRRL) has been proposed to enhance performance across a range of…

Machine Learning · Statistics 2024-09-24 Zhipeng Liang , Xiaoteng Ma , Jose Blanchet , Jiheng Zhang , Zhengyuan Zhou

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

Disentangled representation learning (DRL) aims to break down observed data into core intrinsic factors for a profound understanding of the data. In real-world scenarios, manually defining and labeling these factors are non-trivial, making…

Machine Learning · Computer Science 2024-11-01 Youngjun Jun , Jiwoo Park , Kyobin Choo , Tae Eun Choi , Seong Jae Hwang

Training energy-based models (EBMs) on high-dimensional data can be both challenging and time-consuming, and there exists a noticeable gap in sample quality between EBMs and other generative frameworks like GANs and diffusion models. To…

Machine Learning · Statistics 2024-11-12 Yaxuan Zhu , Jianwen Xie , Yingnian Wu , Ruiqi Gao

Optimal control of parametric partial differential equations (PDEs) is crucial in many applications in engineering and science. In recent years, the progress in scientific machine learning has opened up new frontiers for the control of…

Machine Learning · Computer Science 2024-10-10 Nicolò Botteghi , Urban Fasel

In recent years, Rectified flow (RF) has gained considerable popularity largely due to its generation efficiency and state-of-the-art performance. In this paper, we investigate the degree to which RF automatically adapts to the intrinsic…

Machine Learning · Statistics 2026-02-24 Saptarshi Roy , Alessandro Rinaldo , Purnamrita Sarkar

Causal Disentangled Representation Learning(CDRL) aims to learn and disentangle low dimensional representations and their underlying causal structure from observations. However, existing disentanglement methods rely on a standard mean-field…

Machine Learning · Computer Science 2026-01-30 Yutao Jin , Yuang Tao , Junyong Zhai

Statistical learning under distribution shift is challenging when neither prior knowledge nor fully accessible data from the target distribution is available. Distributionally robust learning (DRL) aims to control the worst-case statistical…

Methodology · Statistics 2024-12-19 Yu Gui , Rina Foygel Barber , Cong Ma

While few-step generative models have enabled powerful image and video generation at significantly lower cost, generic reinforcement learning (RL) paradigms for few-step models remain an unsolved problem. Existing RL approaches for few-step…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yihong Luo , Tianyang Hu , Weijian Luo , Jing Tang

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

Machine Learning · Computer Science 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

Normalizing flow (NF) has gained popularity over traditional maximum likelihood based methods due to its strong capability to model complex data distributions. However, the standard approach, which maps the observed data to a normal…

Machine Learning · Computer Science 2022-11-22 Hanze Dong , Shizhe Diao , Weizhong Zhang , Tong Zhang

Effective traffic control methods have great potential in alleviating network congestion. Existing literature generally focuses on a single control approach, while few studies have explored the effectiveness of integrated and coordinated…

Machine Learning · Computer Science 2023-03-08 Zijian Hu , Wei Ma

A key task in actuarial modelling involves modelling the distributional properties of losses. Classic (distributional) regression approaches like Generalized Linear Models (GLMs; Nelder and Wedderburn, 1972) are commonly used, but…

Machine Learning · Statistics 2024-06-04 Benjamin Avanzi , Eric Dong , Patrick J. Laub , Bernard Wong

We propose a reinforcement learning (RL) framework for the dynamic selection of the filter parameter in Evolve-Filter (EF) regularization strategies for incompressible turbulent flows. Instead of prescribing the filter radius heuristically,…

Numerical Analysis · Mathematics 2026-03-03 Anna Ivagnes , Maria Strazzullo , Gianluigi Rozza

In this work we compare different drag-reduction strategies that compute their actuation based on the fluctuations at a given wall-normal location in turbulent open channel flow. In order to perform this study, we implement and describe in…

Fluid Dynamics · Physics 2023-09-07 L. Guastoni , J. Rabault , H. Azizpour , R. Vinuesa