English
Related papers

Related papers: Improving the performance of classical linear alge…

200 papers

Introducing parallelism and exploring its use is still a fundamental challenge for the computer algebra community. In high performance numerical simulation, on the other hand, transparent environments for distributed computing which follow…

Algebraic Geometry · Mathematics 2018-08-30 Janko Boehm , Wolfram Decker , Anne Frühbis-Krüger , Franz-Josef Pfreundt , Mirko Rahn , Lukas Ristau

Currently, many machine learning algorithms contain lots of iterations. When it comes to existing large-scale distributed systems, some slave nodes may break down or have lower efficiency. Therefore traditional machine learning algorithm…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-22 Junxiong Wang , Hongzhi Wang , Chenxu Zhao

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

Shared training approaches, such as multi-task learning (MTL) and gradient-based meta-learning, are widely used in various machine learning applications, but they often suffer from negative transfer, leading to performance degradation in…

Machine Learning · Computer Science 2024-12-10 Anshul Thakur , Yichen Huang , Soheila Molaei , Yujiang Wang , David A. Clifton

Computations over the rational numbers often encounter the problem of intermediate coefficient growth. A solution to this is provided by modular methods, which apply the algorithm under consideration modulo a number of primes and then lift…

Algebraic Geometry · Mathematics 2024-01-23 Dirk Basson , Janko Boehm , Magdaleen S. Marais , Mirko Rahn , Hobihasina P. Rakotoarisoa

Iterative decoding was not originally introduced as the solution to an optimization problem rendering the analysis of its convergence very difficult. In this paper, we investigate the link between iterative decoding and classical…

Information Theory · Computer Science 2010-01-13 Florence Alberge , Ziad Naja , P. Duhamel

In view of the existing limitations of sequential computing, parallelization has emerged as an alternative in order to improve the speedup of numerical simulations. In the framework of evolutionary problems, space-time parallel methods…

Numerical Analysis · Mathematics 2025-02-13 Andrés Arrarás , Francisco J. Gaspar , Iñigo Jimenez-Ciga , Laura Portero

Iterative methods for solving large sparse systems of linear equations are widely used in many HPC applications. Extreme scaling of these methods can be difficult, however, since global communication to form dot products is typically…

Mathematical Software · Computer Science 2020-09-29 Nick Brown , J. Mark Bull , Iain Bethune

The research in parallel machine scheduling in combinatorial optimization suggests that the desirable parallel efficiency could be achieved when the jobs are sorted in the non-increasing order of processing times. In this paper, we find…

Numerical Analysis · Mathematics 2012-02-15 Lei Wang , Heng Liang , Fengshan Bai , Yan Huo

Convergence problems in coupled-cluster iterations are discussed, and a new iteration scheme is proposed. Whereas the Jacobi method inverts only the diagonal part of the large matrix of equation coefficients, we invert a matrix which also…

Chemical Physics · Physics 2009-11-06 N. Mosyagin , E. Eliav , U. Kaldor

We introduce a new strategy for coupling the parallel in time (parareal) iterative methodology with multiscale integrators. Following the parareal framework, the algorithm computes a low-cost approximation of all slow variables in the…

Numerical Analysis · Mathematics 2015-11-19 Gil Ariel , Seong Jun Kim , Richard Tsai

The paper presents a novel modular hybrid parallel robot for pancreatic surgery and its higher-order kinematics derived based on various formalisms. The classical vector, homogeneous transformation matrices and dual quaternion approaches…

Robotics · Computer Science 2025-03-31 Calin Vaida , Iosif Birlescu , Bogdan Gherman , Daniel Condurache , Damien Chablat , Doina Pisla

This note proposes an efficient preconditioner for solving linear and semi-linear parabolic equations. With the Crank-Nicholson time stepping method, the algebraic system of equations at each time step is solved with the conjugate gradient…

Numerical Analysis · Mathematics 2021-05-11 Jordi Feliu-Fabà , Lexing Ying

In this work, we show that for linearly constrained optimization problems the primal-dual hybrid gradient algorithm, analyzed by Chambolle and Pock [3], can be written as an entirely primal algorithm. This allows us to prove convergence of…

Optimization and Control · Mathematics 2019-05-27 Yura Malitsky

Parallel-in-time methods are developed to accelerate the direct-adjoint looping procedure. Particularly, we utilize the Paraexp algorithm, previously developed to integrate equations forward in time, to accelerate the direct-adjoint looping…

Optimization and Control · Mathematics 2021-03-17 Calum S. Skene , Maximilian F. Eggl , Peter J. Schmid

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

In this paper we present computational experiments with the Markov Chain Monte Carlo Matrix Inversion ($(\text{MC})^2\text{MI}$) on several accelerator architectures and investigate their impact on performance and scalability of the method.…

Numerical Analysis · Mathematics 2024-09-06 Anton Lebedev , Vassil Alexandrov

High-order Discontinuous Galerkin (DG) methods promise to be an excellent discretisation paradigm for partial differential equation solvers by combining high arithmetic intensity with localised data access. They also facilitate dynamic…

Mathematical Software · Computer Science 2020-06-02 Dominic E. Charrier , Benjamin Hazelwood , Tobias Weinzierl

We describe two main classes of one-sided trigonometric and hyperbolic Jacobi-type algorithms for computing eigenvalues and eigenvectors of Hermitian matrices. These types of algorithms exhibit significant advantages over many other…

Numerical Analysis · Computer Science 2020-03-18 Sanja Singer , Sasa Singer , Vedran Novakovic , Aleksandar Uscumlic , Vedran Dunjko

The design and implementation of parallel algorithms is a fundamental task in computer algebra. Combining the computer algebra system Singular and the workflow management system GPI-Space, we have developed an infrastructure for massively…

Algebraic Geometry · Mathematics 2020-10-16 Janko Boehm , Anne Frühbis-Krüger , Mirko Rahn