English
Related papers

Related papers: Scalable On-Policy Reinforcement Learning via Adap…

200 papers

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

Machine Learning · Computer Science 2026-01-16 Nadav Merlis

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

Reinforcement learning (RL) policies often fail under dynamics that differ from training, a gap not fully addressed by domain randomization or existing adversarial RL methods. Distributionally robust RL provides a formal remedy but still…

Machine Learning · Computer Science 2026-04-16 Mintae Kim , Koushil Sreenath

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

Robotics · Computer Science 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

Bayesian policy reuse (BPR) is a general policy transfer framework for selecting a source policy from an offline library by inferring the task belief based on some observation signals and a trained observation model. In this paper, we…

Machine Learning · Computer Science 2023-07-14 Jinmei Liu , Zhi Wang , Chunlin Chen , Daoyi Dong

We study multi-agent reinforcement learning (MARL) in a stochastic network of agents. The objective is to find localized policies that maximize the (discounted) global reward. In general, scalability is a challenge in this setting because…

Machine Learning · Computer Science 2021-11-03 Yiheng Lin , Guannan Qu , Longbo Huang , Adam Wierman

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

Machine Learning · Computer Science 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

To imitate the ability of keeping learning of human, continual learning which can learn from a never-ending data stream has attracted more interests recently. In all settings, the online class incremental learning (OCIL), where incoming…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Guoqiang Liang , Zhaojie Chen , Zhaoqiang Chen , Shiyu Ji , Yanning Zhang

Overparameterized models have recently challenged conventional learning theory by exhibiting improved generalization beyond the interpolation limit, a phenomenon known as benign overfitting. This work introduces Adaptive Benign Overfitting…

Statistical Finance · Quantitative Finance 2026-02-02 Luis Ontaneda Mijares , Nick Firoozye

Agent-based simulators (ABS) are a popular epidemiological modelling tool to study the impact of various non-pharmaceutical interventions in managing an epidemic in a city (or a region). They provide the flexibility to accurately model a…

Physics and Society · Physics 2025-10-13 Daksh Mittal , Sandeep Juneja

The choice of batch sizes in minibatch stochastic gradient optimizers is critical in large-scale model training for both optimization and generalization performance. Although large-batch training is arguably the dominant training paradigm…

Machine Learning · Computer Science 2024-05-29 Tim Tsz-Kit Lau , Han Liu , Mladen Kolar

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

Large-scale finite element simulations of complex physical systems governed by partial differential equations (PDE) crucially depend on adaptive mesh refinement (AMR) to allocate computational budget to regions where higher resolution is…

Modern data centers suffer from immense power consumption. As a result, data center operators have heavily invested in capacity scaling solutions, which dynamically deactivate servers if the demand is low and activate them again when the…

Data Structures and Algorithms · Computer Science 2022-04-21 Daan Rutten , Debankur Mukherjee

Spiking Neural Networks (SNNs) offer low-latency and energy-efficient decision-making on neuromorphic hardware by mimicking the event-driven dynamics of biological neurons. However, the discrete and non-differentiable nature of spikes leads…

Neural and Evolutionary Computing · Computer Science 2026-03-05 Zijie Xu , Xinyu Shi , Yiting Dong , Zihan Huang , Zhaofei Yu

Active learning has demonstrated data efficiency in many fields. Existing active learning algorithms, especially in the context of batch-mode deep Bayesian active models, rely heavily on the quality of uncertainty estimations of the model,…

Machine Learning · Computer Science 2023-02-22 Renyu Zhang , Aly A. Khan , Robert L. Grossman , Yuxin Chen

We propose a first-order stochastic optimization algorithm incorporating adaptive regularization applicable to machine learning problems in deep learning framework. The adaptive regularization is imposed by stochastic process in determining…

Machine Learning · Computer Science 2020-04-15 Kensuke Nakamura , Stefano Soatto , Byung-Woo Hong

The security of cloud environments, such as Amazon Web Services (AWS), is complex and dynamic. Static security policies have become inadequate as threats evolve and cloud resources exhibit elasticity [1]. This paper addresses the…

Cryptography and Security · Computer Science 2025-05-15 Muhammad Saqib , Dipkumar Mehta , Fnu Yashu , Shubham Malhotra