English
Related papers

Related papers: Parallel algorithms for normalization

200 papers

A definition for a class of asynchronous cellular arrays is proposed. An example of such asynchrony would be independent Poisson arrivals of cell iterations. The Ising model in the continuous time formulation of Glauber falls into this…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Boris D. Lubachevsky

Computations over the rational numbers often encounter the problem of intermediate coefficient growth. A solution to this is provided by modular methods, which apply the algorithm under consideration modulo a number of primes and then lift…

Algebraic Geometry · Mathematics 2024-01-23 Dirk Basson , Janko Boehm , Magdaleen S. Marais , Mirko Rahn , Hobihasina P. Rakotoarisoa

This paper proposes a variant of the normalized cut algorithm for spectral clustering. Although the normalized cut algorithm applies the K-means algorithm to the eigenvectors of a normalized graph Laplacian for finding clusters, our…

Computer Vision and Pattern Recognition · Computer Science 2015-03-06 Tomohiko Mizutani

Based on the joint bidiagonalization process of a large matrix pair $\{A,L\}$, we propose and develop an iterative regularization algorithm for the large scale linear discrete ill-posed problems in general-form regularization: $\min\|Lx\| \…

Numerical Analysis · Mathematics 2020-07-21 Zhongxiao Jia , Yanfei Yang

From the optimization point of view, a difficulty with parallel MRI with simultaneous coil sensitivity estimation is the multiplicative nature of the non-linear forward operator: the image being reconstructed and the coil sensitivities…

Numerical Analysis · Mathematics 2018-02-06 Yonggui Zhu , Tuomo Valkonen

Active automata learning infers automaton models of systems from behavioral observations, a technique successfully applied to a wide range of domains. Compositional approaches have recently emerged to address scalability to concurrent…

Machine Learning · Computer Science 2026-04-02 Leo Henry , Thomas Neele , Mohammad Reza Mousavi , Matteo Sammartino

As renewable energy integration, sector coupling, and spatiotemporal detail increase, energy system optimization models grow in size and complexity, often pushing solvers to their performance limits. This systematic review explores…

Separable, or Kronecker product, dictionaries provide natural decompositions for 2D signals, such as images. In this paper, we describe a highly parallelizable algorithm that learns such dictionaries which reaches sparse representations…

Machine Learning · Computer Science 2021-12-03 Cristian Rusu , Paul Irofti

For the problem of maximizing a monotone, submodular function with respect to a cardinality constraint $k$ on a ground set of size $n$, we provide an algorithm that achieves the state-of-the-art in both its empirical performance and its…

Data Structures and Algorithms · Computer Science 2024-08-20 Yixin Chen , Tonmoy Dey , Alan Kuhnle

In this paper, we consider the problem of $\ell_{p}$ norm linear regression, which has several applications such as in sparse recovery, data clustering, and semi-supervised learning. The problem, even though convex, does not enjoy a…

Machine Learning · Computer Science 2021-10-26 R. Jyothi , P. Babu

This paper extends and analyzes the high-order kernel regularization framework of Beale & Tlupova (arXiv:2510.13639) to all four on-surface boundary integral operators of the Helmholtz Calderon calculus in three dimensions: the…

Numerical Analysis · Mathematics 2026-04-29 Luiz M. Faria , Carlos Perez-Arancibia , Svetlana Tlupova

Self-stabilizing algorithms are an important because of their robustness and guaranteed convergence. Starting from any arbitrary state, a self-stabilizing algorithm is guaranteed to converge to a legitimate state.Those algorithms are not…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-20 Thejaka Kanewala , Marcin Zalewski , Martina Barnas , Andrew Lumsdaine

Several Lebesgue-type decomposition theorems in analysis have a strong relation to the operation called: parallel sum. The aim of this paper is to investigate this relation from a new point of view. Namely, using a natural generalization of…

Functional Analysis · Mathematics 2016-09-13 Tamás Titkos

The Lov\'{a}sz Local Lemma (LLL) is a cornerstone principle in the probabilistic method of combinatorics, and a seminal algorithm of Moser & Tardos (2010) provides an efficient randomized algorithm to implement it. This can be parallelized…

Discrete Mathematics · Computer Science 2023-10-13 Bernhard Haeupler , David G. Harris

Graph clustering has many important applications in computing, but due to growing sizes of graphs, even traditionally fast clustering methods such as spectral partitioning can be computationally expensive for real-world graphs of interest.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-11 Julian Shun , Farbod Roosta-Khorasani , Kimon Fountoulakis , Michael W. Mahoney

We propose automatic optimisation methods considering the geometry of matrix manifold for the normalised parameters of neural networks. Layerwise weight normalisation with respect to Frobenius norm is utilised to bound the Lipschitz…

Machine Learning · Computer Science 2023-12-19 Namhoon Cho , Hyo-Sang Shin

Inspired by recent successes with parallel optimization techniques for solving Boolean satisfiability, we investigate a set of strategies and heuristics that aim to leverage parallel computing to improve the scalability of neural network…

Logic in Computer Science · Computer Science 2020-08-24 Haoze Wu , Alex Ozdemir , Aleksandar Zeljić , Ahmed Irfan , Kyle Julian , Divya Gopinath , Sadjad Fouladi , Guy Katz , Corina Pasareanu , Clark Barrett

A syntax-directed formal system for the development of totally correct programs with respect to an unfair shared-state parallel while-language is proposed. The system can be understood as a compositional reformulation of the Owicki/Gries…

Formal Languages and Automata Theory · Computer Science 2024-04-26 Ketil Stølen

This paper presents a general method for applying hierarchical matrix skeletonization factorizations to the numerical solution of boundary integral equations with possibly rank-deficient integral operators. Rank-deficient operators arise in…

Numerical Analysis · Mathematics 2021-04-08 John Paul Ryan , Anil Damle

K-FAC is a successful tractable implementation of Natural Gradient for Deep Learning, which nevertheless suffers from the requirement to compute the inverse of the Kronecker factors (through an eigen-decomposition). This can be very…

Machine Learning · Computer Science 2022-11-28 Constantin Octavian Puiu