English
Related papers

Related papers: A unified analysis framework for iterative paralle…

200 papers

In this paper, we propose a direct parallel-in-time (PinT) algorithm for time-dependent problems with first- or second-order derivative. We use a second-order boundary value method as the time integrator that leads to a tridiagonal time…

Numerical Analysis · Mathematics 2022-02-22 Jun Liu , Xiang-Sheng Wang , Shu-Lin Wu , Tao Zhou

We introduce a micro-macro parareal algorithm for the time-parallel integration of multiscale-in-time systems. The algorithm first computes a cheap, but inaccurate, solution using a coarse propagator (simulating an approximate slow…

Numerical Analysis · Mathematics 2013-02-11 Frederic Legoll , Tony Lelievre , Giovanni Samaey

This paper presents a framework that supports the implementation of parallel solutions for the widespread parametric maximum flow computational routines used in image segmentation algorithms. The framework is based on supergraphs, a special…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Vlad Olaru , Mihai Florea , Cristian Sminchisescu

We construct a space-time parallel method for solving parabolic partial differential equations by coupling the Parareal algorithm in time with overlapping domain decomposition in space. The goal is to obtain a discretization consisting of…

Numerical Analysis · Mathematics 2022-01-17 Jehanzeb Chaudhry , Donald Estep , Simon Tavener

In this paper we show that many sequential randomized incremental algorithms are in fact parallel. We consider algorithms for several problems including Delaunay triangulation, linear programming, closest pair, smallest enclosing disk,…

Data Structures and Algorithms · Computer Science 2018-10-15 Guy E. Blelloch , Yan Gu , Julian Shun , Yihan Sun

We develop and analyze new scheduling algorithms for solving sparse triangular linear systems (SpTRSV) in parallel. Our approach produces highly efficient synchronous schedules for the forward- and backward-substitution algorithm. Compared…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-06 Toni Böhnlein , Pál András Papp , Raphael S. Steiner , Christos K. Matzoros , A. N. Yzelman

In this paper, we propose a parallel shooting algorithm for solving nonlinear model predictive control problems using sequential quadratic programming. This algorithm is built on a two-phase approach where we first test and assess…

Systems and Control · Electrical Eng. & Systems 2023-07-21 P. C. N. Verheijen , M. Haghi , M. Lazar , D. Goswami

Nowadays, parallel computing is ubiquitous in several application fields, both in engineering and science. The computations rely on the floating-point arithmetic specified by the IEEE754 Standard. In this context, an elementary brick of…

Computation and Language · Computer Science 2022-05-12 Farah Benmouhoub , Pierre-Loïc Garoche , Matthieu Martel

To speed up the training process, many existing systems use parallel technology for online learning algorithms. However, most research mainly focus on stochastic gradient descent (SGD) instead of other algorithms. We propose a generic…

Computation and Language · Computer Science 2017-03-03 Shuming Ma , Xu Sun

More and more large data collections are gathered worldwide in various IT systems. Many of them possess the networked nature and need to be processed and analysed as graph structures. Due to their size they require very often usage of…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-04 Tomasz Kajdanowicz , Przemyslaw Kazienko , Wojciech Indyk

Stochastic gradient methods (SGMs) are the predominant approaches to train deep learning models. The adaptive versions (e.g., Adam and AMSGrad) have been extensively used in practice, partly because they achieve faster convergence than the…

Optimization and Control · Mathematics 2022-04-14 Yangyang Xu , Yibo Xu , Yonggui Yan , Colin Sutcher-Shepard , Leopold Grinberg , Jie Chen

We introduce a scalable approach to Gaussian process inference that combines spatio-temporal filtering with natural gradient variational inference, resulting in a non-conjugate GP method for multivariate data that scales linearly with…

Machine Learning · Computer Science 2021-11-03 Oliver Hamelijnck , William J. Wilkinson , Niki A. Loppi , Arno Solin , Theodoros Damoulas

Many iterative parallel-in-time algorithms have been shown to be highly efficient for diffusion-dominated partial differential equations (PDEs), but are inefficient or even divergent when applied to advection-dominated PDEs. We consider the…

Numerical Analysis · Mathematics 2022-04-26 H. De Sterck , R. D. Falgout , O. A. Krzysik

In this paper we investigate the parallelization of dual-primal isogeometric tearing and interconnecting (IETI-DP) type methods for solving large-scale continuous and discontinuous Galerkin systems of equations arising from Isogeometric…

Numerical Analysis · Mathematics 2016-11-28 Christoph Hofer

In the constrained planarity setting, we ask whether a graph admits a planar drawing that additionally satisfies a given set of constraints. These constraints are often derived from very natural problems; prominent examples are Level…

Data Structures and Algorithms · Computer Science 2023-11-01 Simon D. Fink , Ignaz Rutter

We present a real-time method for robust estimation of multiple instances of geometric models from noisy data. Geometric models such as vanishing points, planar homographies or fundamental matrices are essential for 3D scene analysis.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Florian Kluger , Bodo Rosenhahn

Determining the degree of inherent parallelism in classical sequential algorithms and leveraging it for fast parallel execution is a key topic in parallel computing, and detailed analyses are known for a wide range of classical algorithms.…

Data Structures and Algorithms · Computer Science 2023-04-24 Alexander Fedorov , Diba Hashemi , Giorgi Nadiradze , Dan Alistarh

We explore how the big-three computing paradigms -- symmetric multi-processor (SMC), graphical processing units (GPUs), and cluster computing -- can together be brought to bare on large-data Gaussian processes (GP) regression problems via a…

Computation · Statistics 2014-06-05 Robert B. Gramacy , Jarad Niemi , Robin M. Weiss

This work introduces an innovative parallel, fully-distributed finite element framework for growing geometries and its application to metal additive manufacturing. It is well-known that virtual part design and qualification in additive…

Computational Engineering, Finance, and Science · Computer Science 2019-04-30 Eric Neiva , Santiago Badia , Alberto F. Martín , Michele Chiumenti

RockIt is a maximum a-posteriori (MAP) query engine for statistical relational models. MAP inference in graphical models is an optimization problem which can be compiled to integer linear programs (ILPs). We describe several advances in…

Artificial Intelligence · Computer Science 2013-05-01 Jan Noessner , Mathias Niepert , Heiner Stuckenschmidt