English
Related papers

Related papers: Tensor Algebra on an Optoelectronic Microchip

200 papers

High-dimensional data arise naturally in many areas of science and engineering, including machine learning, signal processing, computational physics, and statistics. Such data are often represented as tensors, multi-dimensional…

Machine Learning · Computer Science 2026-05-19 Beheshteh T. Rakhshan , Guillaume Rabusseau

This paper is contributed to a fast algorithm for Hankel tensor-vector products. For this purpose, we first discuss a special class of Hankel tensors that can be diagonalized by the Fourier matrix, which is called \emph{anti-circulant}…

Numerical Analysis · Mathematics 2014-01-27 Weiyang Ding , Liqun Qi , Yimin Wei

We propose a sparse algebra for samplet compressed kernel matrices, to enable efficient scattered data analysis. We show the compression of kernel matrices by means of samplets produces optimally sparse matrices in a certain S-format. It…

Numerical Analysis · Mathematics 2023-05-05 H. Harbrecht , M. Multerer , O. Schenk , Ch. Schwab

In recent years, the application of tensors has become more widespread in fields that involve data analytics and numerical computation. Due to the explosive growth of data, low-rank tensor decompositions have become a powerful tool to…

Numerical Analysis · Mathematics 2020-11-03 Lingjie Li , Wenjian Yu , Kim Batselier

Tuning tensor program generation involves searching for various possible program transformation combinations for a given program on target hardware to optimize the tensor program execution. It is already a complex process because of the…

Programming Languages · Computer Science 2023-12-29 Gaurav Verma , Siddhisanket Raskar , Zhen Xie , Abid M Malik , Murali Emani , Barbara Chapman

We introduce Stardust, a compiler that compiles sparse tensor algebra to reconfigurable dataflow architectures (RDAs). Stardust introduces new user-provided data representation and scheduling language constructs for mapping to…

Programming Languages · Computer Science 2022-11-08 Olivia Hsu , Alexander Rucker , Tian Zhao , Kunle Olukotun , Fredrik Kjolstad

With the advent of more powerful Quantum Computers, the need for larger Quantum Simulations has boosted. As the amount of resources grows exponentially with size of the target system Tensor Networks emerge as an optimal framework with which…

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

Tensor contractions constitute a key computational ingredient of numerical multi-linear algebra. However, as the order and dimension of tensors grow, the time and space complexities of tensor-based computations grow quickly. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-15 Yang Shi , U. N. Niranjan , Animashree Anandkumar , Cris Cecka

Current architectures are now equipped with matrix computation units designed to enhance AI and high-performance computing applications. Within these architectures, two fundamental instruction types are matrix multiplication and vector…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-04 Wenxuan Zhao , Liang Yuan , Baicheng Yan , Penghao Ma , Yunquan Zhang , Long Wang , Zhe Wang

This paper introduces a new mathematical framework for analysis and optimization of tensor expressions within an enclosing loop. Tensors are multi-dimensional arrays of values. They are common in high performance computing (HPC) and machine…

Programming Languages · Computer Science 2025-02-10 Javed Absar , Samarth Narang , Muthu Baskaran

Most regularized tensor regression research focuses on tensors predictors with scalars responses or vectors predictors to tensors responses. We consider the sparse low rank tensor on tensor regression where predictors $\mathcal{X}$ and…

Machine Learning · Computer Science 2022-12-16 Haiyi Mao , Jason Xiaotian Dou

Sparse tensors are prevalent in real-world applications, often characterized by their large-scale, high-order, and high-dimensional nature. Directly handling raw tensors is impractical due to the significant memory and computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Zixuan Li , Mingxing Duan , Huizhang Luo , Wangdong Yang , Kenli Li , Keqin Li

This work proposes a GPU tensor core approach that encodes the arithmetic reduction of $n$ numbers as a set of chained $m \times m$ matrix multiply accumulate (MMA) operations executed in parallel by GPU tensor cores. The asymptotic running…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-17 Cristóbal A. Navarro , Roberto Carrasco , Ricardo J. Barrientos , Javier A. Riquelme , Raimundo Vega

Many research works have been performed on implementation of Vitrerbi decoding algorithm on GPU instead of FPGA because this platform provides considerable flexibility in addition to great performance. Recently, the recently-introduced…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-30 Alireza Mohammadidoost , Matin Hashemi

To address the absence of a universal standard interface for tensor operations, we introduce the Tensor Algebra Processing Primitives (TAPP), a C-based interface designed to decouple the application layer from hardware-specific…

Mathematical Software · Computer Science 2026-01-13 Jan Brandejs , Niklas Hörnblad , Edward F. Valeev , Alexander Heinecke , Jeff Hammond , Devin Matthews , Paolo Bientinesi

In this paper, we develop software for decomposing sparse tensors that is portable to and performant on a variety of multicore, manycore, and GPU computing architectures. The result is a single code whose performance matches optimized…

Mathematical Software · Computer Science 2019-07-30 Eric Phipps , Tamara G. Kolda

Robust tensor CP decomposition involves decomposing a tensor into low rank and sparse components. We propose a novel non-convex iterative algorithm with guaranteed recovery. It alternates between low-rank CP decomposition through gradient…

Machine Learning · Computer Science 2016-04-28 Animashree Anandkumar , Prateek Jain , Yang Shi , U. N. Niranjan

Recently, introducing Tensor Decomposition (TD) techniques into unsupervised feature selection (UFS) has been an emerging research topic. A tensor structure is beneficial for mining the relations between different modes and helps relieve…

Machine Learning · Computer Science 2025-07-04 Junjing Zheng , Xinyu Zhang , Weidong Jiang , Xiangfeng Qiu , Mingjian Ren

While FPGAs have been used extensively as hardware accelerators in industrial computation, no theoretical model of computation has been devised for the study of FPGA-based accelerators. In this paper, we present a theoretical model of…

Data Structures and Algorithms · Computer Science 2018-11-19 Martin Hora , Václav Končický , Jakub Tětek