English
Related papers

Related papers: Reproducibility of Parallel Preconditioned Conjuga…

200 papers

We develop a stochastic algorithm for independent component analysis that incorporates multi-trial supervision, which is available in many scientific contexts. The method blends a proximal gradient-type algorithm in the space of invertible…

Machine Learning · Computer Science 2025-08-29 Ronak Mehta , Mateus Piovezan Otto , Noah Stanis , Azadeh Yazdan-Shahmorad , Zaid Harchaoui

To reproduce eScience, several challenges need to be solved: scientific workflows need to be automated; the involved software versions need to be provided in an unambiguous way; input data needs to be easily accessible; High-Performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Kessy Abarenkov , Anne Fouilloux , Helmut Neukirchen , Abdulrahman Azab

We revisit the problem of large-scale bundle adjustment and propose a technique called Multidirectional Conjugate Gradients that accelerates the solution of the normal equation by up to 61%. The key idea is that we enlarge the search space…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Simon Weber , Nikolaus Demmel , Daniel Cremers

In this paper, an adjoint solver for the multigrid in time software library XBraid is presented. XBraid provides a non-intrusive approach for simulating unsteady dynamics on multiple processors while parallelizing not only in space but also…

Optimization and Control · Mathematics 2018-01-22 Stefanie Günther , Nicolas R. Gauger , Jacob B. Schroder

In this paper, we propose a Bi-layer Predictionbased Reduction Branch (BP-RB) framework to speed up the process of finding a high-quality feasible solution for Mixed Integer Programming (MIP) problems. A graph convolutional network (GCN) is…

Optimization and Control · Mathematics 2022-09-28 Lingying Huang , Xiaomeng Chen , Wei Huo , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

In this paper, we focus on solving a sequence of linear systems with an identical (or similar) coefficient matrix. For this type of problems, we investigate the subspace correction and deflation methods, which use an auxiliary matrix…

Numerical Analysis · Mathematics 2022-03-17 Takeshi Iwashita , Kota Ikehara , Takeshi Fukaya , Takeshi Mifune

In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers,…

Numerical Analysis · Mathematics 2021-01-18 Luca Bergamaschi , Jacek Gondzio , Ángeles Martínez , John W. Pearson , Spyridon Pougkakiotis

In this paper, we introduce two parallel extragradient-proximal methods for solving split equilibrium problems. The algorithms combine the extragradient method, the proximal method and the hybrid (outer approximation) method. The weak and…

Optimization and Control · Mathematics 2015-11-10 Dang Van Hieu

We consider three mathematically equivalent variants of the conjugate gradient (CG) algorithm and how they perform in finite precision arithmetic. It was shown in [{\em Behavior of slightly perturbed Lanczos and conjugate-gradient…

Numerical Analysis · Computer Science 2021-07-19 Anne Greenbaum , Hexuan Liu , Tyler Chen

Improving the predictive accuracy of a dynamics model is crucial to obtaining good control performance and safety from Model Predictive Controllers (MPC). One approach involves learning unmodelled (residual) dynamics, in addition to nominal…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Leroy D'Souza , Yash Vardhan Pant , Sebastian Fischmeister

Algorithmic reproducibility measures the deviation in outputs of machine learning algorithms upon minor changes in the training process. Previous work suggests that first-order methods would need to trade-off convergence rate (gradient…

Machine Learning · Computer Science 2024-01-11 Liang Zhang , Junchi Yang , Amin Karbasi , Niao He

Matrix multiplication is fundamental in the backpropagation algorithm used to train deep neural network models. Libraries like Intel's MKL or NVIDIA's cuBLAS implemented new and optimized matrix multiplication techniques that increase…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-28 L. A. Torres , Carlos J. Barrios H , Yves Denneulin

This paper proposes to decouple performance optimization and enforcement of asymptotic convergence in Model Predictive Control (MPC) so that convergence to a given terminal set is achieved independently of how much performance is optimized…

Systems and Control · Computer Science 2015-03-02 Alberto Bemporad , Daniele Bernardini , Panagiotis Patrinos

We consider the preconditioned conjugate gradient method (PCG) with optimal preconditioner in the frame of the boundary element method (BEM) for elliptic first-kind integral equations. Our adaptive algorithm steers the termination of PCG as…

Numerical Analysis · Mathematics 2019-03-21 Thomas Führer , Alexander Haberl , Dirk Praetorius , Stefan Schimanko

Nonlinear model predictive control has been widely adopted to manipulate bilinear systems with dynamics that include products of the inputs and the states. These systems are ubiquitous in chemical processes, mechanical systems, and quantum…

Systems and Control · Electrical Eng. & Systems 2023-07-06 Yingzhao Lian , Yuning Jiang , Daniel F. Opila , Colin N. Jones

Complex computer codes or models can often be run in a hierarchy of different levels of complexity ranging from the very basic to the sophisticated. The top levels in this hierarchy are typically expensive to run, which limits the number of…

Methodology · Statistics 2023-07-19 Louise Kimpton , James Salter , Tim Dodwell , Hossein Mohammadi , Peter Challenor

Exascale computing will feature novel and potentially disruptive hardware architectures. Exploiting these to their full potential is non-trivial. Numerical modelling frameworks involving finite difference methods are currently limited by…

Mathematical Software · Computer Science 2016-12-06 Christian T. Jacobs , Satya P. Jammy , Neil D. Sandham

A scalable algorithm for solving compact banded linear systems on distributed memory architectures is presented. The proposed method factorizes the original system into two levels of memory hierarchies, and solves it using parallel cyclic…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-05 Hang Song , Kristen V. Matsuno , Jacob R. West , Akshay Subramaniam , Aditya S. Ghate , Sanjiva K. Lele

The increasing number of processing elements and decreas- ing memory to core ratio in modern high-performance platforms makes efficient strong scaling a key requirement for numerical algorithms. In order to achieve efficient scalability on…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-14 Michael Lange , Gerard Gorman , Michele Weiland , Lawrence Mitchell , James Southern

Scientific and data science applications are becoming increasingly complex, with growing computational and memory demands. Modern high performance computing (HPC) systems provide high parallelism and heterogeneity across nodes, devices, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-29 Jonas H. Müller Korndörfer , Ali Mohammed , Ahmed Eleliemy , Quentin Guilloteau , Reto Krummenacher , Florina M. Ciorba