English
Related papers

Related papers: A fast vectorised implementation of Wallace's norm…

200 papers

An effective neural network algorithm of the perceptron type is proposed. The algorithm allows us to identify strongly distorted input vector reliably. It is shown that its reliability and processing speed are orders of magnitude higher…

Neural and Evolutionary Computing · Computer Science 2007-05-23 D. I. Alieva , B. V. Kryzhanovsky , V. M. Kryzhanovsky , A. B. Fonarev

Standard rank-revealing factorizations such as the singular value decomposition and column pivoted QR factorization are challenging to implement efficiently on a GPU. A major difficulty in this regard is the inability of standard algorithms…

Numerical Analysis · Mathematics 2023-05-23 Nathan Heavner , Chao Chen , Abinand Gopal , Per-Gunnar Martinsson

This work considers the deployment of pseudo-random number generators (PRNGs) on graphics processing units (GPUs), developing an approach based on the xorgens generator to rapidly produce pseudo-random numbers of high statistical quality.…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-13 Nimalan Nandapalan , Richard P. Brent , Lawrence M. Murray , Alistair Rendell

The quantum machine learning model is emerging as a new model that merges quantum computing and machine learning. Simulating very deep quantum machine learning models requires a lot of resources, increasing exponentially based on the number…

Quantum Physics · Physics 2025-02-18 Vu Tuan Hai , Le Vu Trung Duong , Pham Hoai Luan , Yasuhiko Nakashima

Markov-chain Monte Carlo algorithms rely on trial moves that are either rejected or accepted based on certain criteria. Here, we provide an efficient algorithm to generate random rotation matrices in four dimensions (4D) covering an…

Computational Physics · Physics 2023-02-14 Jakob Tómas Bullerjahn , Balázs Fábián , Gerhard Hummer

A bias-free source-independent quantum random number generator scheme based on the measurement of vacuum fluctuation is proposed to realize the effective elimination of system bias and common mode noise introduced by the local oscillator.…

Quantum Physics · Physics 2020-07-17 Ziyong Zheng , Yi-Chen Zhang , Min Huang , Ziyang Chen , Song Yu , Hong Guo

Random hashing can provide guarantees regarding the performance of data structures such as hash tables---even in an adversarial setting. Many existing families of hash functions are universal: given two data objects, the probability that…

Data Structures and Algorithms · Computer Science 2018-10-16 Dmytro Ivanchykhin , Sergey Ignatchenko , Daniel Lemire

Quantum computing is on the cusp of reality with Noisy Intermediate-Scale Quantum (NISQ) machines currently under development and testing. Some of the most promising algorithms for these machines are variational algorithms that employ…

The paper describes an improved parallel MPI-based implementation of VBARMS, a variable block variant of the pARMS preconditioner proposed by Li,~Saad and Sosonkina [NLAA, 2003] for solving general nonsymmetric linear systems. The parallel…

Numerical Analysis · Mathematics 2015-08-11 Bruno Carpentieri , Jia Liao , Masha Sosonkina , Aldo Bonfiglioli

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

The techniques used to generate pseudo-random numbers for Monte Carlo (MC) applications bear many implications on the quality and speed of that programs work. As a random number generator (RNG) slows, the production of random numbers begins…

Computational Physics · Physics 2024-03-12 Braxton S. Cuneo , Ilham Variansyah

Recent works demonstrated the promise of using resistive random access memory (ReRAM) as an emerging technology to perform inherently parallel analog domain in-situ matrix-vector multiplication -- the intensive and key computation in DNNs.…

Hardware Architecture · Computer Science 2021-06-18 Geng Yuan , Payman Behnam , Zhengang Li , Ali Shafiee , Sheng Lin , Xiaolong Ma , Hang Liu , Xuehai Qian , Mahdi Nazm Bojnordi , Yanzhi Wang , Caiwen Ding

Generalized singular values (GSVs) play an essential role in the comparative analysis. In the real world data for comparative analysis, both data matrices are usually numerically low-rank. This paper proposes a randomized algorithm to first…

Numerical Analysis · Mathematics 2024-04-16 Weiwei Xu , Weijie Shen , Wen Li , Weiguo Gao , Yingzhou Li

This work proposes RaNNC (Rapid Neural Network Connector) as middleware for automatic hybrid parallelism. In recent deep learning research, as exemplified by T5 and GPT-3, the size of neural network models continues to grow. Since such…

Machine Learning · Computer Science 2021-03-31 Masahiro Tanaka , Kenjiro Taura , Toshihiro Hanawa , Kentaro Torisawa

GAN vocoders are currently one of the state-of-the-art methods for building high-quality neural waveform generative models. However, most of their architectures require dozens of billion floating-point operations per second (GFLOPS) to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Ahmed Mustafa , Jean-Marc Valin , Jan Büthe , Paris Smaragdis , Mike Goodwin

Sparse Matrix-Vector multiplication (SpMV) is an essential computational kernel in many application scenarios. Tens of sparse matrix formats and implementations have been proposed to compress the memory storage and speed up SpMV…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-22 Zhen Du , Jiajia Li , Yinshan Wang , Xueqi Li , Guangming Tan , Ninghui Sun

Large scale, inverse problem solving deep learning algorithms have become an essential part of modern research and industrial applications. The complexity of the underlying inverse problem often poses challenges to the algorithm and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Daniel Lersch , Malachi Schram , Zhenyu Dai , Kishansingh Rajput , Xingfu Wu , N. Sato , J. Taylor Childers

We develop the first stochastic incremental method for calculating the Moore-Penrose pseudoinverse of a real matrix. By leveraging three alternative characterizations of pseudoinverse matrices, we design three methods for calculating the…

Numerical Analysis · Mathematics 2019-05-02 Robert M. Gower , Peter Richtárik

Analog arrays are a promising upcoming hardware technology with the potential to drastically speed up deep learning. Their main advantage is that they compute matrix-vector products in constant time, irrespective of the size of the matrix.…

Emerging Technologies · Computer Science 2023-02-17 Malte J. Rasch , Tayfun Gokmen , Mattia Rigotti , Wilfried Haensch

We present a systematic analysis how one can improve performance of probabilistic programmable quantum processors. We generalize a simple Vidal-Masanes-Cirac processor that realizes U(1) rotations on a qubit with the phase of the rotation…

Quantum Physics · Physics 2009-11-10 Mark Hillery , Mario Ziman , Vladimir Buzek