English
Related papers

Related papers: Computation- and Space-Efficient Implementation of…

200 papers

Matrix multiplication is a cornerstone operation in a wide array of scientific fields, including machine learning and computer graphics. The standard algorithm for matrix multiplication has a complexity of $\mathcal{O}(n^3)$ for $n\times n$…

Hardware Architecture · Computer Science 2024-06-05 Afzal Ahmad , Linfeng Du , Wei Zhang

With the increase in the computation intensity of the chip, the mismatch between computation layer shapes and the available computation resource significantly limits the utilization of the chip. Driven by this observation, prior works…

Hardware Architecture · Computer Science 2024-02-20 Jinming Zhuang , Zhuoping Yang , Shixin Ji , Heng Huang , Alex K. Jones , Jingtong Hu , Yiyu Shi , Peipei Zhou

Given its widespread application in machine learning and optimization, the Kronecker product emerges as a pivotal linear algebra operator. However, its computational demands render it an expensive operation, leading to heightened costs in…

Data Structures and Algorithms · Computer Science 2024-02-14 Yeqi Gao , Zhao Song , Ruizhe Zhang

Rapid development in quantum computing leads to the appearance of several quantum applications. Quantum Fourier Transformation (QFT) sits at the heart of many of these applications. Existing work leverages SAT solver or heuristics to…

Quantum Physics · Physics 2024-08-22 Yuwei Jin , Xiangyu Gao , Minghao Guo , Henry Chen , Fei Hua , Chi Zhang , Eddy Z. Zhang

We present an efficient algorithm for the application of sequences of planar rotations to a matrix. Applying such sequences efficiently is important in many numerical linear algebra algorithms for eigenvalues. Our algorithm is novel in…

Performance · Computer Science 2024-12-04 Thijs Steel , Julien Langou

Reactive trajectory optimization for robotics presents formidable challenges, demanding the rapid generation of purposeful robot motion in complex and swiftly changing dynamic environments. While much existing research predominantly…

Robotics · Computer Science 2023-10-04 Apan Dastider , Hao Fang , Mingjie Lin

Kernel matrices, as well as weighted graphs represented by them, are ubiquitous objects in machine learning, statistics and other related fields. The main drawback of using kernel methods (learning and inference using kernel matrices) is…

Machine Learning · Computer Science 2022-12-02 Ainesh Bakshi , Piotr Indyk , Praneeth Kacham , Sandeep Silwal , Samson Zhou

Free-space trajectory similarity calculation, e.g., DTW, Hausdorff, and Frechet, often incur quadratic time complexity, thus learning-based methods have been proposed to accelerate the computation. The core idea is to train an encoder to…

Machine Learning · Computer Science 2024-10-21 Chuang Yang , Renhe Jiang , Xiaohang Xu , Chuan Xiao , Kaoru Sezaki

We propose a divide-and-conquer algorithm to find recursively the Scattering matrix of general tight-binding structures. The Scattering matrix allows a direct calculation of transport properties in mesoscopic systems by using the Landauer…

Mesoscale and Nanoscale Physics · Physics 2023-12-08 Mauricio J. Rodríguez , Carlos Ramírez

Aerospace production volumes have increased over time and robotic solutions have been progressively introduced in the aeronautic assembly lines to achieve high-quality standards, high production rates, flexibility and cost reduction.…

Robotics · Computer Science 2021-07-12 Federica Storiale , Enrico Ferrentino , Pasquale Chiacchio

The Lanczos algorithm has proven itself to be a valuable matrix eigensolver for problems with large dimensions, up to hundreds of millions or even tens of billions. The computational cost of using any Lanczos algorithm is dominated by the…

Computational Physics · Physics 2023-08-09 Ryan M. Zbikowski , Calvin W. Johnson

We present a fast direct solver for structured linear systems based on multilevel matrix compression. Using the recently developed interpolative decomposition of a low-rank matrix in a recursive manner, we embed an approximation of the…

Numerical Analysis · Mathematics 2014-04-10 Kenneth L. Ho , Leslie Greengard

We investigate different aspects of area convexity [Sherman '17], a mysterious tool introduced to tackle optimization problems under the challenging $\ell_\infty$ geometry. We develop a deeper understanding of its relationship with more…

Optimization and Control · Mathematics 2023-10-31 Arun Jambulapati , Kevin Tian

Sinkhorn algorithm has been used pervasively to approximate the solution to optimal transport (OT) and unbalanced optimal transport (UOT) problems. However, its practical application is limited due to the high computational complexity. To…

Machine Learning · Statistics 2026-04-07 Mengyu Li , Jun Yu , Tao Li , Cheng Meng

Short-and-sparse deconvolution (SaSD) aims to recover a short kernel and a long and sparse signal from their convolution. In the literature, formulations of blind deconvolution is either a convex programming via a matrix lifting of…

Signal Processing · Electrical Eng. & Systems 2021-11-23 Cheng Cheng , Wei Dai

Memory is a key computational bottleneck when solving large-scale convex optimization problems such as semidefinite programs (SDPs). In this paper, we focus on the regime in which storing an $n\times n$ matrix decision variable is…

Optimization and Control · Mathematics 2021-08-25 Nimita Shinde , Vishnu Narayanan , James Saunderson

Matrix decompositions are ubiquitous in machine learning, including applications in dimensionality reduction, data compression and deep learning algorithms. Typical solutions for matrix decompositions have polynomial complexity which…

Machine Learning · Computer Science 2024-03-13 Łukasz Struski , Paweł Morkisz , Przemysław Spurek , Samuel Rodriguez Bernabeu , Tomasz Trzciński

We describe an efficient algorithm for computing the matrix vector products that appear in the numerical resolution of boundary integral equations in 2 space dimension. This work is an extension of the so-called Sparse Cardinal Sine…

Numerical Analysis · Mathematics 2017-11-22 Martin Averseng

The growth of big data in domains such as Earth Sciences, Social Networks, Physical Sciences, etc. has lead to an immense need for efficient and scalable linear algebra operations, e.g. Matrix inversion. Existing methods for efficient and…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Chandan Misra , Sourangshu Bhattacharya , Soumya K. Ghosh

Compared to overlay-based tensor architectures like VTA or Gemmini, compilers that directly translate machine learning models into a dataflow architecture as HLS code, such as HLS4ML and FINN, generally can achieve lower latency by…

Hardware Architecture · Computer Science 2025-04-08 Suyash Vardhan Singh , Iftakhar Ahmad , David Andrews , Miaoqing Huang , Austin R. J. Downey , Jason D. Bakos