English
Related papers

Related papers: Optimizing Coarse Propagators in Parareal Algorith…

200 papers

Solving different types of optimization models (including parameters fitting) for support vector machines on large-scale training data is often an expensive computational task. This paper proposes a multilevel algorithmic framework that…

Machine Learning · Statistics 2014-10-14 Talayeh Razzaghi , Ilya Safro

We present a space-time multiscale method for a parabolic model problem with an underlying coefficient that may be highly oscillatory with respect to both the spatial and the temporal variables. The method is based on the framework of the…

Numerical Analysis · Mathematics 2021-12-13 Per Ljung , Roland Maier , Axel Målqvist

This article proposes modifications of the Parareal algorithm for its application to higher index differential algebraic equations (DAEs). It is based on the idea of applying the algorithm to only the differential components of the equation…

Numerical Analysis · Mathematics 2022-10-05 Idoia Cortes Garcia , Iryna Kulchytska-Ruchka , Sebastian Schöps

Modern applied optimization problems become more and more complex every day. Due to this fact, distributed algorithms that can speed up the process of solving an optimization problem through parallelization are of great importance. The main…

Optimization and Control · Mathematics 2023-12-14 Svetlana Tkachenko , Artem Andreev , Aleksandr Beznosikov , Alexander Gasnikov

We numerically investigate an adaptive version of the parareal algorithm in the context of molecular dynamics. This adaptive variant has been originally introduced in [F. Legoll, T. Lelievre and U. Sharma, SISC 2022]. We focus here on test…

Numerical Analysis · Mathematics 2022-12-21 Olga Gorynina , Frederic Legoll , Tony Lelievre , Danny Perez

Global optimization heuristics are popular to optimize hard non-convex problems. Despite their irrefutably large cost-to-solution, in the lack of other working greedy or convex approaches, global optimization algorithms remain the…

Optimization and Control · Mathematics 2025-02-24 Kayo Gonçalves-e-Silva , Samuel Xavier-de-Souza

In order to find the outcome probabilities of quantum mechanical systems like the optical networks underlying Boson sampling, it is necessary to be able to compute the permanents of unitary matrices, a computationally hard task. Here we…

Quantum Physics · Physics 2022-02-10 P. H. Lundow , K. Markström

Fast matrix multiplication algorithms may be useful, provided that their running time is good in practice. Particularly, the leading coefficient of their arithmetic complexity needs to be small. Many sub-cubic algorithms have large leading…

Data Structures and Algorithms · Computer Science 2020-08-11 Gal Beniamini , Nathan Cheng , Olga Holtz , Elaye Karstadt , Oded Schwartz

We consider the problem of solving a large-scale system of linear equations in a distributed or federated manner by a taskmaster and a set of machines, each possessing a subset of the equations. We provide a comprehensive comparison of two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Boris Velasevic , Rohit Parasnis , Christopher G. Brinton , Navid Azizan

This paper presents a particle swarm optimization algorithm that leverages surrogate modeling to replace the conventional global best solution with the minimum of an n-dimensional quadratic form, providing a better-conditioned dynamic…

Neural and Evolutionary Computing · Computer Science 2026-03-19 Maurizio Clemente , Marcello Canova

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

Asynchronous iterations are more and more investigated for both scaling and fault-resilience purpose on high performance computing platforms. While so far, they have been exclusively applied within space domain decomposition frameworks,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-22 Frederic Magoules , Guillaume Gbikpi-Benissan

We study the scalability of consensus-based distributed optimization algorithms by considering two questions: How many processors should we use for a given problem, and how often should they communicate when communication is not free?…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-06 Konstantinos I. Tsianos , Sean Lawlor , Michael G. Rabbat

In this paper, we design an algorithm to accelerate the diffusion process on the $SO(3)$ manifold. The inherently sequential nature of diffusion models necessitates substantial time for denoising perturbed data. To overcome this limitation,…

Machine Learning · Computer Science 2025-07-15 Yan-Ting Chen , Hao-Wei Chen , Tsu-Ching Hsiao , Chun-Yi Lee

This paper investigates co-scheduling algorithms for processing a set of parallel applications. Instead of executing each application one by one, using a maximum degree of parallelism for each of them, we aim at scheduling several…

Data Structures and Algorithms · Computer Science 2013-05-01 Guillaume Aupy , Manu Shantharam , Anne Benoit , Yves Robert , Padma Raghavan

In this paper, we consider a network of processors aiming at cooperatively solving mixed-integer convex programs subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2022-07-19 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Francesco Sasso , Roland Bouffanais

In this paper we devise an extremely efficient fully dynamic distributed algorithm for maintaining sparse spanners. Our resuls also include the first fully dynamic centralized algorithm for the problem with non-trivial bounds for both…

Data Structures and Algorithms · Computer Science 2009-09-29 Michael Elkin

A micro-macro variant of the parallel-in-time algorithm Parareal has been applied to the ocean-circulation and sea-ice model model FESOM2. The state-of-the-art software in climate research has been developed by the Alfred-Wegener-Institut…

Numerical Analysis · Mathematics 2024-01-23 B. Philippi , T. Slawig

Sparsity-based methods are widely used in machine learning, statistics, and signal processing. There is now a rich class of structured sparsity approaches that expand the modeling power of the sparsity paradigm and incorporate constraints…

Data Structures and Algorithms · Computer Science 2017-12-22 Aleksander Mądry , Slobodan Mitrović , Ludwig Schmidt

We present a highly scalable algorithm for multiplying sparse multivariate polynomials represented in a distributed format. This algo- rithm targets not only the shared memory multicore computers, but also computers clusters or specialized…

Symbolic Computation · Computer Science 2013-04-01 Mickael Gastineau , Jacques Laskar