English
Related papers

Related papers: Heavy-Ball Momentum Method in Continuous Time and …

200 papers

The aim of this paper is to apply a high-order discontinuous-in-time scheme to second-order hyperbolic partial differential equations (PDEs). We first discretize the PDEs in time while keeping the spatial differential operators…

Numerical Analysis · Mathematics 2021-11-30 Aili Shao

This paper studies the time-inconsistent MV optimal stopping problem via a game-theoretic approach to find equilibrium strategies. To overcome the mathematical intractability of direct equilibrium analysis, we propose a vanishing…

Optimization and Control · Mathematics 2025-10-29 Yuchao Dong , Harry Zheng

Parallel stochastic gradient methods are gaining prominence in solving large-scale machine learning problems that involve data distributed across multiple nodes. However, obtaining unbiased stochastic gradients, which have been the focus of…

Machine Learning · Computer Science 2025-01-14 Ali Beikmohammadi , Sarit Khirirat , Sindri Magnússon

In this work, we consider smooth unconstrained optimization problems and we deal with the class of gradient methods with momentum, i.e., descent algorithms where the search direction is defined as a linear combination of the current…

Optimization and Control · Mathematics 2025-12-04 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Davide Pucci , Marco Sciandrone

In this paper, we introduce a model-based deep-learning approach to solve finite-horizon continuous-time stochastic control problems with jumps. We iteratively train two neural networks: one to represent the optimal policy and the other to…

Machine Learning · Computer Science 2026-01-16 Patrick Cheridito , Jean-Loup Dupret , Donatien Hainaut

Stochastic dynamical systems often contain nonlinearities which make it hard to compute probability density functions or statistical moments of these systems. For the moment computations, nonlinearities in the dynamics lead to unclosed…

Optimization and Control · Mathematics 2017-03-28 Khem Raj Ghusinga , Mohammad Soltani , Andrew Lamperski , Sairaj Dhople , Abhyudai Singh

Recently, Stochastic Gradient Descent (SGD) and its variants have become the dominant methods in the large-scale optimization of machine learning (ML) problems. A variety of strategies have been proposed for tuning the step sizes, ranging…

Machine Learning · Computer Science 2022-08-02 Xiaoyu Li

Consider a network of $N$ decentralized computing agents collaboratively solving a nonconvex stochastic composite problem. In this work, we propose a single-loop algorithm, called DEEPSTORM, that achieves optimal sample complexity for this…

Optimization and Control · Mathematics 2023-04-14 Gabriel Mancino-Ball , Shengnan Miao , Yangyang Xu , Jie Chen

For continuous systems modeled by dynamical equations such as ODEs and SDEs, Bellman's Principle of Optimality takes the form of the Hamilton-Jacobi-Bellman (HJB) equation, which provides the theoretical target of reinforcement learning…

Machine Learning · Computer Science 2025-10-28 Haruki Settai , Naoya Takeishi , Takehisa Yairi

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…

Machine Learning · Computer Science 2022-06-20 Harley Wiltzer , David Meger , Marc G. Bellemare

An adaptive direct collocation method is developed for solving optimal control problems constrained by parabolic partial differential equations. The partial differential equation is first reformulated in a variational setting, where the…

Optimization and Control · Mathematics 2026-03-18 Alexander M. Davies , Sara Pollock , Miriam E. Dennis , Anil V. Rao

The paper is devoted to the study of a new class of optimal control problems governed by discontinuous constrained differential inclusions of the sweeping type with involving the duration of the dynamic process into optimization. We develop…

Optimization and Control · Mathematics 2023-10-18 Giovanni Colombo , Boris S. Mordukhovich , Dao Nguyen , Trang Nguyen

Multi-material design optimization problems can, after discretization, be solved by the iterative solution of simpler sub-problems which approximate the original problem at an expansion point to first order. In particular, models…

Numerical Analysis · Mathematics 2026-04-01 Peter Gangl , Nico Nees , Michael Stingl

We develop a discrete analogue of Hamilton-Jacobi theory in the framework of discrete Hamiltonian mechanics. The resulting discrete Hamilton-Jacobi equation is discrete only in time. We describe a discrete analogue of Jacobi's solution and…

Optimization and Control · Mathematics 2011-08-15 Tomoki Ohsawa , Anthony M. Bloch , Melvin Leok

Many processes, such as discrete event systems in engineering or population dynamics in biology, evolve in discrete space and continuous time. We consider the problem of optimal decision making in such discrete state and action space…

Machine Learning · Computer Science 2020-10-27 Bastian Alt , Matthias Schultheis , Heinz Koeppl

We adapt the Gradient Discretisation Method (GDM), originally designed for elliptic and parabolic partial differential equations, to the case of a linear scalar hyperbolic equations. This enables the simultaneous design and convergence…

Numerical Analysis · Mathematics 2019-10-28 Jérôme Droniou , Robert Eymard , T. Gallouët , R. Herbin

Existing deterministic variational inference approaches for diffusion processes use simple proposals and target the marginal density of the posterior. We construct the variational process as a controlled version of the prior process and…

Machine Learning · Computer Science 2021-03-02 Christian Wildner , Heinz Koeppl

We present a novel approach for high-order accurate numerical differentiation on unstructured meshes of quadrilateral elements. To differentiate a given function, an auxiliary function with greater smoothness properties is defined which…

Numerical Analysis · Mathematics 2022-05-11 Yulong Pan , Per-Olof Persson

This work investigates a fully discrete mixed finite element method for the stochastic Boussinesq system driven by multiplicative noise. The spatial discretization is performed using a standard mixed finite element method, while the…

Numerical Analysis · Mathematics 2025-12-25 Liet Vo

In this work, we determine the full expression for the global truncation error of hyperbolic partial differential equations (PDEs). In particular, we use theoretical analysis and symbolic algebra to find exact expressions for the…

Numerical Analysis · Mathematics 2022-12-05 Siddhartha Bishnu , Mark Petersen , Bryan Quaife