English
Related papers

Related papers: Reinforcement Learning for Adaptive MCMC

200 papers

Curriculum learning in reinforcement learning is a training methodology that seeks to speed up learning of a difficult target task, by first training on a series of simpler tasks and transferring the knowledge acquired to the target task.…

Machine Learning · Computer Science 2019-09-17 Sanmit Narvekar , Peter Stone

A significant part of MCMC methods can be considered as the Metropolis-Hastings (MH) algorithm with different proposal distributions. From this point of view, the problem of constructing a sampler can be reduced to the question - how to…

Machine Learning · Statistics 2019-06-11 Kirill Neklyudov , Evgenii Egorov , Pavel Shvechikov , Dmitry Vetrov

Machine Reading Comprehension(MRC) has achieved a remarkable result since some powerful models, such as BERT, are proposed. However, these models are not robust enough and vulnerable to adversarial input perturbation and generalization…

Computation and Language · Computer Science 2022-02-25 Jing Jin , Houfeng Wang

In the forthcoming 6G era, extend reality (XR) has been regarded as an emerging application for ultra-reliable and low latency communications (URLLC) with new traffic characteristics and more stringent requirements. In addition to the…

Networking and Internet Architecture · Computer Science 2025-04-08 Luyuan Zhang , An Liu , Kexuan Wang

Vehicular crowdsensing is anticipated to become a key catalyst for data-driven optimization in the Intelligent Transportation System (ITS) domain. Yet, the expected growth in massive Machine-type Communication (mMTC) caused by…

Networking and Internet Architecture · Computer Science 2020-01-16 Benjamin Sliwa , Christian Wietfeld

Based on the algorithm Informed Importance Tempering (IIT) proposed by Li et al. (2023) we propose an algorithm that uses an adaptive bounded balancing function. We argue why implementing parallel tempering where each replica uses a…

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise…

Machine Learning · Computer Science 2020-10-16 Fanghui Liu , Xiaolin Huang , Chen Gong , Jie Yang , Li Li

Model agnostic meta-learning (MAML) is a popular state-of-the-art meta-learning algorithm that provides good weight initialization of a model given a variety of learning tasks. The model initialized by provided weight can be fine-tuned to…

Machine Learning · Computer Science 2021-06-11 Thanh Nguyen , Tung Luu , Trung Pham , Sanzhar Rakhimkul , Chang D. Yoo

Relational learning can be used to augment one data source with other correlated sources of information, to improve predictive accuracy. We frame a large class of relational learning problems as matrix factorization problems, and propose a…

Machine Learning · Computer Science 2012-03-19 Ajit P. Singh , Geoffrey Gordon

We propose an adaptive independent Metropolis--Hastings algorithm with the ability to learn from all previous proposals in the chain except the current location. It is an extension of the independent Metropolis--Hastings algorithm.…

Probability · Mathematics 2009-03-04 Lars Holden , Ragnar Hauge , Marit Holden

Reinforcement learning usually assumes a given or sometimes even fixed environment in which an agent seeks an optimal policy to maximize its long-term discounted reward. In contrast, we consider agents that are not limited to passive…

Machine Learning · Computer Science 2025-10-20 Ziqing Lu , Babak Hassibi , Lifeng Lai , Weiyu Xu

Policy-based algorithms are among the most widely adopted techniques in model-free RL, thanks to their strong theoretical groundings and good properties in continuous action spaces. Unfortunately, these methods require precise and…

Machine Learning · Computer Science 2023-06-14 Luca Sabbioni , Francesco Corda , Marcello Restelli

Model predictive control (MPC) is a powerful trajectory optimization control technique capable of controlling complex nonlinear systems while respecting system constraints and ensuring safe operation. The MPC's capabilities come at the cost…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

Reinforcement learning often needs to deal with the exponential growth of states and actions when exploring optimal control in high-dimensional spaces (often known as the curse of dimensionality). In this work, we address this issue by…

Machine Learning · Computer Science 2023-06-23 Yining Li , Peizhong Ju , Ness Shroff

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

We propose a new approach for solving planning problems with a hierarchical structure, fusing reinforcement learning and MPC planning. Our formulation tightly and elegantly couples the two planning paradigms. It leverages reinforcement…

Machine Learning · Computer Science 2026-04-17 Toshiaki Hori , Jonathan DeCastro , Deepak Gopinath , Avinash Balachandran , Guy Rosman

We examine the zero-temperature Metropolis Monte Carlo algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis…

Machine Learning · Computer Science 2022-08-11 Stephen Whitelam , Viktor Selin , Ian Benlolo , Corneel Casert , Isaac Tamblyn

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

Safety is an essential requirement for reinforcement learning systems. The newly emerging framework of robust constrained Markov decision processes allows learning policies that satisfy long-term constraints while providing guarantees under…

Machine Learning · Computer Science 2025-12-19 David M. Bossens , Atsushi Nitanda