English
Related papers

Related papers: Nonparametric Stochastic Compositional Gradient De…

200 papers

We study multi-objective reinforcement learning with nonlinear preferences over trajectories. That is, we maximize the expected value of a nonlinear function over accumulated rewards (expected scalarized return or ESR) in a multi-objective…

Machine Learning · Computer Science 2025-02-19 Nianli Peng , Muhang Tian , Brandon Fain

We introduce a functional gradient descent trajectory optimization algorithm for robot motion planning in Reproducing Kernel Hilbert Spaces (RKHSs). Functional gradient algorithms are a popular choice for motion planning in complex…

Robotics · Computer Science 2016-01-15 Zita Marinho , Anca Dragan , Arun Byravan , Byron Boots , Siddhartha Srinivasa , Geoffrey Gordon

We develop a framework for convexifying a fairly general class of optimization problems. Under additional assumptions, we analyze the suboptimality of the solution to the convexified problem relative to the original nonconvex problem and…

Systems and Control · Computer Science 2014-06-04 Krishnamurthy Dvijotham , Maryam Fazel , Emanuel Todorov

We study stochastic optimization algorithms for constrained nonconvex stochastic optimization problems with Markovian data. In particular, we focus on the case when the transition kernel of the Markov chain is state-dependent. Such…

Optimization and Control · Mathematics 2022-11-10 Abhishek Roy , Krishnakumar Balasubramanian , Saeed Ghadimi

This paper aims at the algorithmic/theoretical core of reinforcement learning (RL) by introducing the novel class of proximal Bellman mappings. These mappings are defined in reproducing kernel Hilbert spaces (RKHSs), to benefit from the…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Yuki Akiyama , Konstantinos Slavakis

Motivated by broad applications in machine learning, we study the popular accelerated stochastic gradient descent (ASGD) algorithm for solving (possibly nonconvex) optimization problems. We characterize the finite-time performance of this…

Optimization and Control · Mathematics 2020-10-20 Thinh T. Doan , Lam M. Nguyen , Nhan H. Pham , Justin Romberg

We introduce a stochastic approximation method for the solution of an ergodic Kullback-Leibler control problem. A Kullback-Leibler control problem is a Markov decision process on a finite state space in which the control cost is…

Optimization and Control · Mathematics 2012-02-17 Joris Bierkens , Bert Kappen

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

We present a deterministic optimization framework for Neural Network Quantum States (NQS) designed to bypass the sampling variance and slow mixing issues inherent in stochastic optimization. By projecting a neural backflow ansatz onto…

Chemical Physics · Physics 2026-05-12 Zheng Che

We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…

Numerical Analysis · Mathematics 2020-09-15 Stefania Bellavia , Gianmarco Gurioli

The superior performance of ensemble methods with infinite models are well known. Most of these methods are based on optimization problems in infinite-dimensional spaces with some regularization, for instance, boosting methods and convex…

Machine Learning · Statistics 2017-12-18 Atsushi Nitanda , Taiji Suzuki

Distribution Regression on path-space refers to the task of learning functions mapping the law of a stochastic process to a scalar target. The learning procedure based on the notion of path-signature, i.e. a classical transform from rough…

Probability · Mathematics 2023-04-05 Blanka Horvath , Maud Lemercier , Chong Liu , Terry Lyons , Cristopher Salvi

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general…

Machine Learning · Computer Science 2014-11-20 Markus Heinonen , Florence d'Alché-Buc

Due to the strong correlations present in quantum systems, classical machine learning algorithms like stochastic gradient descent are often insufficient for the training of neural network quantum states (NQSs). These difficulties can be…

Quantum Physics · Physics 2021-04-23 J. Thorben Frank , Michael J. Kastoryano

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu

We propose a compositional approach to synthesize policies for networks of continuous-space stochastic control systems with unknown dynamics using model-free reinforcement learning (RL). The approach is based on implicitly abstracting each…

Systems and Control · Electrical Eng. & Systems 2022-08-09 Abolfazl Lavaei , Mateo Perez , Milad Kazemi , Fabio Somenzi , Sadegh Soudjani , Ashutosh Trivedi , Majid Zamani

Continuous-time Markov decision processes are an important class of models in a wide range of applications, ranging from cyber-physical systems to synthetic biology. A central problem is how to devise a policy to control the system in order…

Systems and Control · Computer Science 2016-06-01 Ezio Bartocci , Luca Bortolussi , Tomǎš Brázdil , Dimitrios Milios , Guido Sanguinetti

Estimating the ratio of two probability densities from finitely many observations of the densities is a central problem in machine learning and statistics with applications in two-sample testing, divergence estimation, generative modeling,…

Machine Learning · Computer Science 2024-03-12 Werner Zellinger , Stefan Kindermann , Sergei V. Pereverzyev

We propose a new, nonparametric approach to learning and representing transition dynamics in Markov decision processes (MDPs), which can be combined easily with dynamic programming methods for policy optimisation and value estimation. This…

Machine Learning · Computer Science 2012-06-22 Steffen Grunewalder , Guy Lever , Luca Baldassarre , Massi Pontil , Arthur Gretton