English
Related papers

Related papers: Efficiency of Matrix Multiplication on the Cross-W…

200 papers

Cross-validation is a useful and generally applicable technique often employed in machine learning, including decision tree induction. An important disadvantage of straightforward implementation of the technique is its computational…

Machine Learning · Computer Science 2007-05-23 Hendrik Blockeel , Jan Struyf

We investigate effects of ordering in blocked matrix--matrix multiplication. We find that submatrices do not have to be stored contiguously in memory to achieve near optimal performance. Instead it is the choice of execution order of the…

Data Structures and Algorithms · Computer Science 2008-08-15 Nicolas Bock , Emanuel H. Rubensson , Paweł Sałek , Anders M. N. Niklasson , Matt Challacombe

Nonnegative Matrix Factorization (NMF) is the problem of approximating a nonnegative matrix with the product of two low-rank nonnegative matrices and has been shown to be particularly useful in many applications, e.g., in text mining, image…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

We consider the problem of private distributed matrix multiplication under limited resources. Coded computation has been shown to be an effective solution in distributed matrix multiplication, both providing privacy against the workers and…

Information Theory · Computer Science 2021-07-14 Burak Hasircioglu , Jesus Gomez-Vilardebo , Deniz Gunduz

The new barrier mode in Apache Spark allows embedding distributed deep learning training as a Spark stage to simplify the distributed training workflow. In Spark, a task in a stage does not depend on any other tasks in the same stage, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-21 Tamas Foldi , Chris von Csefalvay , Nicolas A. Perez

We propose a non-commutative algorithm for multiplying 2x2 matrices using 7 coefficient products. This algorithm reaches simultaneously a better accuracy in practice compared to previously known such fast algorithms, and a time complexity…

Numerical Analysis · Mathematics 2024-07-01 Jean-Guillaume Dumas , Clément Pernet , Alexandre Sedoglavic

The mathematical framework of multiplex networks has been increasingly realized as a more suitable framework for modelling real-world complex systems. In this work, we investigate the optimization of synchronizability in multiplex networks…

Adaptation and Self-Organizing Systems · Physics 2017-05-24 Sanjiv K. Dwivedi , Murilo S. Baptista , Sarika Jalan

Sparse Matrix-Matrix multiplication is a key kernel that has applications in several domains such as scientific computing and graph analysis. Several algorithms have been studied in the past for this foundational kernel. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-10 Mehmet Deveci , Christian Trott , Sivasankaran Rajamanickam

There are increasing number of works addressing the design challenges of fast, scalable solutions for the growing number of new type of applications. Recently, many of the solutions aimed at improving processing element capabilities to…

Hardware Architecture · Computer Science 2019-12-16 Somnath Mazumdar , Alberto Scionti

Matrix double splitting iterations are simple in implementation while solving real non-singular (rectangular) linear systems. In this paper, we present two Alternating Double Splitting (ADS) schemes formulated by two double splittings and…

Numerical Analysis · Mathematics 2025-03-25 Ashish Kumar Nandi , Nachiketa Mishra , Debasisha Mishra

We show that assuming the availability of the processor with variable precision arithmetic, we can compute matrix-by-matrix multiplications in $O(N^2log_2N)$ computational complexity. We replace the standard matrix-by-matrix multiplications…

Data Structures and Algorithms · Computer Science 2025-08-19 Maciej Paszyński

Fast algorithms for matrix multiplication, namely those that perform asymptotically fewer scalar operations than the classical algorithm, have been considered primarily of theoretical interest. Apart from Strassen's original algorithm, few…

Numerical Analysis · Computer Science 2016-07-26 Grey Ballard , Austin R. Benson , Alex Druinsky , Benjamin Lipshitz , Oded Schwartz

A large fraction of the arithmetic operations required to evaluate deep neural networks (DNNs) consists of matrix multiplications, in both convolution and fully connected layers. We perform end-to-end learning of low-cost approximations of…

Machine Learning · Computer Science 2018-06-11 Michael Tschannen , Aran Khanna , Anima Anandkumar

Big array analytics is becoming indispensable in answering important scientific and business questions. Most analysis tasks consist of multiple steps, each making one or multiple passes over the arrays to be analyzed and generating…

Databases · Computer Science 2012-04-30 Yi Zhang , Jun Yang

Systolic arrays have proven to be highly efficient for parallelized matrix-matrix multiplication (MMM), utilizing synchronized, heartbeat-like data flows across an array of processing elements. While optical structures such as waveguide…

Optics · Physics 2025-11-27 Jungmin Kim , Qingyi Zhou , Zongfu Yu

The use of a wire mesh facilitates creation of multiple optical traps for manipulation of small micron or sub-micron particles. Such an array of optical traps can be easily controlled. The trap that is formed in this manner is a continuous…

Optics · Physics 2007-05-23 J. A. Dharmadhikari , A. K. Dharmadhikari , D. Mathur

Matrix completion is one of the key problems in signal processing and machine learning, with applications ranging from image pro- cessing and data gathering to classification and recommender sys- tems. Recently, deep neural networks have…

Machine Learning · Statistics 2018-05-15 Duc Minh Nguyen , Evaggelia Tsiligianni , Nikos Deligiannis

Data processing systems impose multiple views on data as it is processed by the system. These views include spreadsheets, databases, matrices, and graphs. The common theme amongst these views is the need to store and operate on data as…

Databases · Computer Science 2015-01-26 Jeremy Kepner , Julian Chaidez , Vijay Gadepally , Hayden Jansen

We present new algorithms to detect and correct errors in the product of two matrices, or the inverse of a matrix, over an arbitrary field. Our algorithms do not require any additional information or encoding other than the original inputs…

Symbolic Computation · Computer Science 2018-02-08 Daniel S. Roche

In this paper, we present several improvements in the parallelization of the in-place merge algorithm, which merges two contiguous sorted arrays into one with an O(T) space complexity (where T is the number of threads). The approach divides…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-27 Berenger Bramas , Quentin Bramas