English
Related papers

Related papers: Provable and Practical: Efficient Exploration in R…

200 papers

Bayesian neural learning feature a rigorous approach to estimation and uncertainty quantification via the posterior distribution of weights that represent knowledge of the neural network. This not only provides point estimates of optimal…

Machine Learning · Computer Science 2018-11-13 Rohitash Chandra , Konark Jain , Ratneel V. Deo , Sally Cripps

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

Markov chain Monte Carlo (MCMC) methods are fundamental to Bayesian computation, but can be computationally intensive, especially in high-dimensional settings. Push-forward generative models, such as generative adversarial networks (GANs),…

Machine Learning · Computer Science 2026-02-25 Jonathan Spence , Tobías I. Liaudat , Konstantinos Zygalakis , Marcelo Pereyra

Inverse reinforcement learning (IRL) aims to estimate the reward function of optimizing agents by observing their response (estimates or actions). This paper considers IRL when noisy estimates of the gradient of a reward function generated…

Machine Learning · Computer Science 2021-01-19 Vikram Krishnamurthy , George Yin

Developing efficient Bayesian computation algorithms for imaging inverse problems is challenging due to the dimensionality involved and because Bayesian imaging models are often not smooth. Current state-of-the-art methods often address…

Computation · Statistics 2023-05-04 Marcelo Pereyra , Luis A. Vargas-Mieles , Konstantinos C. Zygalakis

We study meta-reinforcement learning in finite-horizon MDPs where related tasks share similar structures in their optimal action-value functions. Specifically, we posit a linear representation $Q^*_h(s,a)=\Phi_h(s,a)\,\theta^{(k)}_h$ and…

Machine Learning · Computer Science 2025-10-08 Runlin Zhou , Chixiang Chen , Elynn Chen

We study model-based reinforcement learning (RL) for episodic Markov decision processes (MDP) whose transition probability is parametrized by an unknown transition core with features of state and action. Despite much recent progress in…

Machine Learning · Statistics 2024-11-19 Taehyun Hwang , Min-hwan Oh

Exploration in multi-task reinforcement learning is critical in training agents to deduce the underlying MDP. Many of the existing exploration frameworks such as $E^3$, $R_{max}$, Thompson sampling assume a single stationary MDP and are not…

Artificial Intelligence · Computer Science 2016-12-04 Sai Praveen Bangaru , JS Suhas , Balaraman Ravindran

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

The class of deep deterministic off-policy algorithms is effectively applied to solve challenging continuous control problems. Current approaches commonly utilize random noise as an exploration method, which has several drawbacks, including…

Machine Learning · Computer Science 2024-05-07 Igor Kuznetsov

Deep Reinforcement Learning (RL) methods rely on experience replay to approximate the minibatched supervised learning setting; however, unlike supervised learning where access to lots of training data is crucial to generalization,…

Machine Learning · Computer Science 2021-02-24 Brett Daley , Cameron Hickert , Christopher Amato

Branch-and-bound is a systematic enumerative method for combinatorial optimization, where the performance highly relies on the variable selection strategy. State-of-the-art handcrafted heuristic strategies suffer from relatively slow…

Machine Learning · Computer Science 2022-06-15 Tianyu Zhang , Amin Banitalebi-Dehkordi , Yong Zhang

This paper investigates model robustness in reinforcement learning (RL) to reduce the sim-to-real gap in practice. We adopt the framework of distributionally robust Markov decision processes (RMDPs), aimed at learning a policy that…

Machine Learning · Computer Science 2025-09-09 Laixi Shi , Gen Li , Yuting Wei , Yuxin Chen , Matthieu Geist , Yuejie Chi

Markov Chain Monte Carlo (MCMC) methods sample from unnormalized probability distributions and offer guarantees of exact sampling. However, in the continuous case, unfavorable geometry of the target distribution can greatly limit the…

Machine Learning · Statistics 2020-10-09 Zengyi Li , Yubei Chen , Friedrich T. Sommer

Modern Reinforcement Learning (RL) is commonly applied to practical problems with an enormous number of states, where function approximation must be deployed to approximate either the value function or the policy. The introduction of…

Machine Learning · Computer Science 2019-08-09 Chi Jin , Zhuoran Yang , Zhaoran Wang , Michael I. Jordan

Langevin Monte Carlo (LMC) is a popular Bayesian sampling method. For the log-concave distribution function, the method converges exponentially fast, up to a controllable discretization error. However, the method requires the evaluation of…

Machine Learning · Statistics 2025-03-07 Zhiyan Ding , Qin Li

We propose a Monte Carlo sampler from the reverse diffusion process. Unlike the practice of diffusion models, where the intermediary updates -- the score functions -- are learned with a neural network, we transform the score matching…

Machine Learning · Statistics 2024-03-14 Xunpeng Huang , Hanze Dong , Yifan Hao , Yi-An Ma , Tong Zhang

Sampling from high-dimensional distributions has wide applications in data science and machine learning but poses significant computational challenges. We introduce Subspace Langevin Monte Carlo (SLMC), a novel and efficient sampling method…

Machine Learning · Statistics 2025-05-21 Tyler Maunu , Jiayi Yao

In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is…

Machine Learning · Statistics 2023-01-10 Marelys Crespo Navas , Sébastien Gadat , Xavier Gendre

In recent years deep neural networks have been successfully applied to the domains of reinforcement learning \cite{bengio2009learning,krizhevsky2012imagenet,hinton2006reducing}. Deep reinforcement learning \cite{mnih2015human} is reported…

Machine Learning · Computer Science 2020-05-19 Huihui Zhang , Wu Huang