English
Related papers

Related papers: Efficient Baseline-free Sampling in Parameter Expl…

200 papers

In this paper, a novel optimal control-based baseline function is presented for the policy gradient method in deep reinforcement learning (RL). The baseline is obtained by computing the value function of an optimal control problem, which is…

Machine Learning · Computer Science 2024-11-07 Xubo Lyu , Site Li , Seth Siriya , Ye Pu , Mo Chen

Despite their success, policy gradient methods suffer from high variance of the gradient estimate, which can result in unsatisfactory sample complexity. Recently, numerous variance-reduced extensions of policy gradient methods with provably…

Machine Learning · Computer Science 2022-02-02 Matilde Gargiani , Andrea Zanelli , Andrea Martinelli , Tyler Summers , John Lygeros

Parameter-free stochastic optimization aims to design algorithms that are agnostic to the underlying problem parameters while still achieving convergence rates competitive with optimally tuned methods. While some parameter-free methods do…

Machine Learning · Computer Science 2026-04-21 Yuheng Zhao , Yu-Hu Yan , Amit Attia , Tomer Koren , Lijun Zhang , Peng Zhao

Spline basis exploration via Bayesian model selection is a widely employed strategy for determining the optimal set of basis terms in nonparametric regression. However, despite its widespread use, this approach often encounters performance…

Methodology · Statistics 2025-04-09 Sunwoo Lim , Sihyeon Pyeon , Seonghyun Jeong

Efficient exploration is one of the key challenges for reinforcement learning (RL) algorithms. Most traditional sample efficiency bounds require strategic exploration. Recently many deep RL algorithms with simple heuristic exploration…

Machine Learning · Computer Science 2019-04-19 Yao Liu , Emma Brunskill

We study reward-free and reward-agnostic exploration in episodic finite-horizon Markov decision processes (MDPs), where an agent explores an unknown environment without observing external rewards. Reward-free exploration aims to enable…

Machine Learning · Computer Science 2026-05-18 Oran Ridel , Alon Cohen

Rejection sampling is a common tool for low dimensional problems ($d \leq 2$), often touted as an "easy" way to obtain valid samples from a distribution $f(\cdot)$ of interest. In practice it is non-trivial to apply, often requiring…

Computation · Statistics 2023-10-03 Edward Raff , Mark McLean , James Holt

Optimal stopping problems consider the question of deciding when to stop an observation-generating process in order to maximize a return. We examine the problem of simultaneously learning and planning in such domains, when data is collected…

Artificial Intelligence · Computer Science 2017-05-25 Karan Goel , Christoph Dann , Emma Brunskill

Simulations often involve the use of model parameters which are unknown or uncertain. For this reason, simulation experiments are often repeated for multiple combinations of parameter values, often iterating through parameter values lying…

Computation · Statistics 2012-05-22 Jessica W. Leigh , David Bryant

Nearly all simulation-based games have environment parameters that affect incentives in the interaction but are not explicitly incorporated into the game model. To understand the impact of these parameters on strategic incentives, typical…

Computer Science and Game Theory · Computer Science 2026-05-06 Madelyn Gatchel , Bryce Wiedenbeck

We study the policy evaluation problem in an online multi-reward multi-policy discounted setting, where multiple reward functions must be evaluated simultaneously for different policies. We adopt an $(\epsilon,\delta)$-PAC perspective to…

Machine Learning · Computer Science 2025-08-19 Alessio Russo , Aldo Pacchiano

Compressive sampling has become a widely used approach to construct polynomial chaos surrogates when the number of available simulation samples is limited. Originally, these expensive simulation samples would be obtained at random locations…

Computation · Statistics 2018-07-04 Negin Alemazkoor , Hadi Meidani

In this work, we address the challenge of data-efficient exploration in reinforcement learning by examining existing principled, information-theoretic approaches to intrinsic motivation. Specifically, we focus on a class of exploration…

Machine Learning · Computer Science 2025-07-04 Alberto Caron , Chris Hicks , Vasilios Mavroudis

We study the sequential decision making problem of maximizing the expected total reward while satisfying a constraint on the expected total utility. We employ the natural policy gradient method to solve the discounted infinite-horizon…

Optimization and Control · Mathematics 2025-10-16 Dongsheng Ding , Kaiqing Zhang , Jiali Duan , Tamer Başar , Mihailo R. Jovanović

Usual estimation methods for the parameters of extreme values distribution employ only a few values, wasting a lot of information. More precisely, in the case of the Gumbel distribution, only the block maxima values are used. In this work,…

Data Analysis, Statistics and Probability · Physics 2019-02-22 Rubén Gómez González , M. Isabel Parra , Francisco Javier Acero , Jacinto Martín

Some of the issues that make sampling parameter spaces of various beyond the Standard Model (BSM) scenarios computationally expensive are the high dimensionality of the input parameter space, complex likelihoods, and stringent experimental…

High Energy Physics - Phenomenology · Physics 2026-02-16 Atrideb Chatterjee , Arghya Choudhury , Sourav Mitra , Arpita Mondal , Subhadeep Mondal

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

Machine Learning · Computer Science 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu

Current practice in parameter space exploration in euclidean space is dominated by randomized sampling or design of experiment methods. The biggest issue with these methods is not keeping track of what part of parameter space has been…

Machine Learning · Computer Science 2023-03-16 Avinash Kumar , Anish Kumar , Sumit Sharma , Surjeet Singh , Kumar Vardhan

This paper studies an infinite horizon optimal control problem for discrete-time linear system and quadratic criteria, both with random parameters which are independent and identically distributed with respect to time. In this general…

Optimization and Control · Mathematics 2024-03-04 Deyue Li