English
Related papers

Related papers: An Efficient Parallel-in-Time Method for Optimizat…

200 papers

Motivated by the idea of imposing paralleling computing on solving stochastic differential equations (SDEs), we introduce a new Domain Decomposition Scheme to solve forward-backward stochastic differential equations (FBSDEs) parallely. We…

Numerical Analysis · Mathematics 2010-08-03 Minh-Binh Tran

The equivalence of time-optimal and distance-optimal control problems is shown for a class of parabolic control systems. Based on this equivalence, an approach for the efficient algorithmic solution of time-optimal control problems is…

Optimization and Control · Mathematics 2019-04-17 Lucas Bonifacius , Karl Kunisch

High dimensional and/or nonconvex optimization remains a challenging and important problem across a wide range of fields, such as machine learning, data assimilation, and partial differential equation (PDE) constrained optimization. Here we…

Optimization and Control · Mathematics 2025-08-29 Brian K. Tran , Ben S. Southworth , David B. Cavender , Sam Olivier , Syed A. Shah , Tommaso Buvoli

Parallel-in-time algorithms have been successfully employed for reducing time-to-solution of a variety of partial differential equations, especially for diffusive (parabolic-type) equations. A major failing of parallel-in-time approaches to…

Numerical Analysis · Mathematics 2019-08-28 Hans De Sterck , Stephanie Friedhoff , Alexander J. M. Howse , Scott P. MacLachlan

We study linear-quadratic stochastic optimal control problems with bilinear state dependence for which the underlying stochastic differential equation (SDE) consists of slow and fast degrees of freedom. We show that, in the same way in…

Dynamical Systems · Mathematics 2018-03-21 Omar Kebiri , Lara Neureither , Carsten Hartmann

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

The Parareal algorithm is used to solve time-dependent problems considering multiple solvers that may work in parallel. The key feature is a initial rough approximation of the solution that is iteratively refined by the parallel solvers. We…

Systems and Control · Computer Science 2014-02-18 Loïc Michel

Parallel machine scheduling has been extensively studied in the past decades, with applications ranging from production planning to job processing in large computing clusters. In this work we study some of these fundamental optimization…

Data Structures and Algorithms · Computer Science 2015-09-08 Yael Mordechai

In this contribution we develop an efficient reduced order model for solving parametrized linear-quadratic optimal control problems with linear time-varying state system. The fully reduced model combines reduced basis approximations of the…

Numerical Analysis · Mathematics 2024-08-29 Hendrik Kleikamp , Lukas Renelt

We target time-dependent partial differential equations (PDEs) with heterogeneous coefficients in space and time. To tackle these problems, we construct reduced basis/ multiscale ansatz functions defined in space that can be combined with…

Numerical Analysis · Mathematics 2022-10-04 Julia Schleuß , Kathrin Smetana , Lukas ter Maat

We consider the projected gradient algorithm for the nonconvex best subset selection problem that minimizes a given empirical loss function under an $\ell_0$-norm constraint. Through decomposing the feasible set of the given sparsity…

Optimization and Control · Mathematics 2026-02-13 Jan Harold Alcantara , Ching-pei Lee

To construct a parallel approach for solving optimization problems with orthogonality constraints is usually regarded as an extremely difficult mission, due to the low scalability of the orthonormalization procedure. However, such demand is…

Optimization and Control · Mathematics 2021-11-16 Bin Gao , Xin Liu , Ya-xiang Yuan

The high cost of sequential time integration is one major constraint that limits the speedup of a time-parallel algorithm like the Parareal algorithm due to the difficulty of coarsening time steps in a stiff numerical problem. To address…

Computational Physics · Physics 2025-03-06 Weifan Liu

We construct a space-time parallel method for solving parabolic partial differential equations by coupling the Parareal algorithm in time with overlapping domain decomposition in space. The goal is to obtain a discretization consisting of…

Numerical Analysis · Mathematics 2022-01-17 Jehanzeb Chaudhry , Donald Estep , Simon Tavener

Stochastic Gradient Descent is used for large datasets to train models to reduce the training time. On top of that data parallelism is widely used as a method to efficiently train neural networks using multiple worker nodes in parallel.…

Machine Learning · Computer Science 2024-07-02 Aakash Sudhirbhai Vora , Dhrumil Chetankumar Joshi , Aksh Kantibhai Patel

Parallel parameterized complexity theory studies how fixed-parameter tractable (fpt) problems can be solved in parallel. Previous theoretical work focused on parallel algorithms that are very fast in principle, but did not take into account…

Data Structures and Algorithms · Computer Science 2019-02-21 Max Bannach , Malte Skambath , Till Tantau

With the advent of supercomputers, multi-processor environments and parallel-in-time (PinT) algorithms offer ways to solve initial value problems for ordinary and partial differential equations (ODEs and PDEs) over long time intervals, a…

Computation · Statistics 2025-07-21 Guglielmo Gattiglio , Lyudmila Grigoryeva , Massimiliano Tamborrino

Parallel search algorithms harness the multithreading capability of modern processors to achieve faster planning. One such algorithm is PA*SE (Parallel A* for Slow Expansions), which parallelizes state expansions to achieve faster planning…

Robotics · Computer Science 2023-01-11 Shohin Mukherjee , Sandip Aine , Maxim Likhachev

Solving parabolic optimal control problems can be inherently challenging in the field of science and engineering, especially with constraints on the nonsmooth distributed control. Motivated by the extensive applicability of the alternating…

Optimization and Control · Mathematics 2026-03-03 Haiming Song , Jinda Yang , Yuran Yang , Jianhua Yuan

We derive a new parallel-in-time approach for solving large-scale optimization problems constrained by time-dependent partial differential equations arising from fluid dynamics. The solver involves the use of a block circulant approximation…

Numerical Analysis · Mathematics 2024-05-30 Bernhard Heinzelreiter , John W. Pearson