English
Related papers

Related papers: An Efficient Parallel-in-Time Method for Optimizat…

200 papers

Stochastic computer simulations enable users to gain new insights into complex physical systems. Optimization is a common problem in this context: users seek to find model inputs that maximize the expected value of an objective function.…

Optimization and Control · Mathematics 2018-09-13 Atiye Alaeddini , Daniel J. Klein

We present a parallel version of the cut-pursuit algorithm for minimizing functionals involving the graph total variation. We show that the decomposition of the iterate into constant connected components, which is at the center of this…

Data Structures and Algorithms · Computer Science 2019-05-08 Hugo Raguet , Loic Landrieu

In this paper we accomplish the development of the fast rank-adaptive solver for tensor-structured symmetric positive definite linear systems in higher dimensions. In [arXiv:1301.6068] this problem is approached by alternating minimization…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

This paper proposes a general formulation for temporal parallelisation of dynamic programming for optimal control problems. We derive the elements and associative operators to be able to use parallel scans to solve these problems with…

Optimization and Control · Mathematics 2022-01-25 Simo Särkkä , Ángel F. García-Fernández

We design a randomised parallel version of Adaboost based on previous studies on parallel coordinate descent. The algorithm uses the fact that the logarithm of the exponential loss is a function with coordinate-wise Lipschitz continuous…

Machine Learning · Computer Science 2017-04-14 Olivier Fercoq

It is common practice to apply gradient-based optimization algorithms to numerically solve large-scale ODE constrained optimal control problems. Gradients of the objective function are most efficiently computed by approximate adjoint…

Optimization and Control · Mathematics 2024-07-03 Jens Lang , Bernhard A. Schmitt

We propose a new multistep deep learning-based algorithm for the resolution of moderate to high dimensional nonlinear backward stochastic differential equations (BSDEs) and their corresponding parabolic partial differential equations (PDE).…

Numerical Analysis · Mathematics 2023-08-29 Daniel Bussell , Camilo Andrés García-Trillos

We present a novel approach to the parallelization of the parabolic fast multipole method for a space-time boundary element method for the heat equation. We exploit the special temporal structure of the involved operators to provide an…

Numerical Analysis · Mathematics 2023-01-31 Raphael Watschinger , Michal Merta , Günther Of , Jan Zapletal

We consider a wide range of regularized stochastic minimization problems with two regularization terms, one of which is composed with a linear function. This optimization model abstracts a number of important applications in artificial…

Machine Learning · Computer Science 2018-02-02 Tianyi Lin , Linbo Qiao , Teng Zhang , Jiashi Feng , Bofeng Zhang

We propose a variant of the classical conditional gradient method for sparse inverse problems with differentiable measurement models. Such models arise in many practical problems including superresolution, time-series modeling, and matrix…

Optimization and Control · Mathematics 2015-07-07 Nicholas Boyd , Geoffrey Schiebinger , Benjamin Recht

This paper proposes a parallelizable algorithm for linear-quadratic model predictive control (MPC) problems with state and input constraints. The algorithm itself is based on a parallel MPC scheme that has originally been designed for…

Optimization and Control · Mathematics 2022-07-04 Jiahe Shi , Yuning Jiang , Juraj Oravec , Boris Houska

Probabilistic numerical solvers for ordinary differential equations (ODEs) treat the numerical simulation of dynamical systems as problems of Bayesian state estimation. Aside from producing posterior distributions over ODE solutions and…

Numerical Analysis · Mathematics 2024-09-12 Nathanael Bosch , Adrien Corenflos , Fatemeh Yaghoobi , Filip Tronarp , Philipp Hennig , Simo Särkkä

We present original time-parallel algorithms for the solution of the implicit Euler discretization of general linear parabolic evolution equations with time-dependent self-adjoint spatial operators. Motivated by the inf-sup theory of…

Numerical Analysis · Mathematics 2021-03-24 Martin Neumuller , Iain Smears

We present a novel multiscale numerical approach that combines parallel-in-time computation with hybrid domain adaptation for linear collisional kinetic equations in the diffusive regime. The method addresses the computational challenges of…

Numerical Analysis · Mathematics 2025-11-18 Tino Laidin

A large-scale complex system comprising many, often spatially distributed, dynamical subsystems with partial autonomy and complex interactions are called system of systems. This paper describes an efficient algorithm for model predictive…

Optimization and Control · Mathematics 2019-04-25 Branimir Novoselnik , Vedrana Spudić , Mato Baotić

Machine learning frameworks adopt iterative optimizers to train neural networks. Conventional eager execution separates the updating of trainable parameters from forward and backward computations. However, this approach introduces…

Machine Learning · Computer Science 2021-04-02 Zixuan Jiang , Jiaqi Gu , Mingjie Liu , Keren Zhu , David Z. Pan

This paper presents a novel parallel splitting algorithm for solving quasi-static multiple-network poroelasticity (MPET) equations. By introducing a total pressure variable, the MPET system can be reformulated into a coupled…

Numerical Analysis · Mathematics 2025-07-29 Jijing Zhao , Huangxin Chen , Mingchao Cai , Shuyu Sun

Sequential robot manipulation tasks require finding collision-free trajectories that satisfy geometric constraints across multiple object interactions in potentially high-dimensional configuration spaces. Solving these problems in real-time…

Robotics · Computer Science 2025-10-14 Lucas Chen , Shrutheesh Raman Iyer , Zachary Kingston

Asynchronous distributed algorithms are a popular way to reduce synchronization costs in large-scale optimization, and in particular for neural network training. However, for nonsmooth and nonconvex objectives, few convergence guarantees…

Optimization and Control · Mathematics 2020-07-14 Vyacheslav Kungurtsev , Malcolm Egan , Bapi Chatterjee , Dan Alistarh

We interpret the 4D-var data assimilation problem for a parabolic partial differential equation (PDE) in the context of optimal control and revisit the process of deriving optimality conditions for an initial control problem. This is…

Optimization and Control · Mathematics 2025-07-29 Carmen Gräßle , Jannis Marquardt