English
Related papers

Related papers: How many integrals should be evaluated at least in…

200 papers

Decomposition is a proven way to shrink deep networks without changing input-output dimensionality or interface semantics. We bring this idea to hyperdimensional computing (HDC), where footprint cuts usually shrink the feature axis and…

Machine Learning · Computer Science 2026-02-04 Sanggeon Yun , Hyunwoo Oh , Ryozo Masukawa , Mohsen Imani

The computation of accurate low-rank matrix approximations is central to improving the scalability of various techniques in machine learning, uncertainty quantification, and control. Traditionally, low-rank approximations are constructed…

Numerical Analysis · Mathematics 2025-09-29 Nathaniel Pritchard , Taejun Park , Yuji Nakatsukasa , Per-Gunnar Martinsson

We investigate the task of retrieving information from compositional distributed representations formed by Hyperdimensional Computing/Vector Symbolic Architectures and present novel techniques which achieve new information rate bounds.…

Neural and Evolutionary Computing · Computer Science 2023-05-29 Denis Kleyko , Connor Bybee , Ping-Chen Huang , Christopher J. Kymn , Bruno A. Olshausen , E. Paxon Frady , Friedrich T. Sommer

Coupled tensor approximation has recently emerged as a promising approach for the fusion of hyperspectral and multispectral images, reconciling state of the art performance with strong theoretical guarantees. However, tensor-based…

Signal Processing · Electrical Eng. & Systems 2021-04-21 Ricardo Augusto Borsoi , Clémence Prévost , Konstantin Usevich , David Brie , José Carlos Moreira Bermudez , Cédric Richard

Based on tensor neural network, we propose an interpolation method for high dimensional non-tensor-product-type functions. This interpolation scheme is designed by using the tensor neural network based machine learning method. This means…

Numerical Analysis · Mathematics 2024-04-12 Yongxin Li , Zhongshuo Lin , Yifan Wang , Hehu Xie

A common problem in large-scale data analysis is to approximate a matrix using a combination of specifically sampled rows and columns, known as CUR decomposition. Unfortunately, in many real-world environments, the ability to sample…

Machine Learning · Statistics 2018-07-10 Urvashi Oswal , Swayambhoo Jain , Kevin S. Xu , Brian Eriksson

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis

This paper surveys randomized algorithms in numerical linear algebra for low-rank decompositions of matrices and tensors. The survey begins with a review of classical matrix algorithms that can be accelerated by randomized dimensionality…

Numerical Analysis · Mathematics 2026-01-01 Katherine J. Pearce , Per-Gunnar Martinsson

The CUR matrix decomposition and the Nystr\"{o}m approximation are two important low-rank matrix approximation techniques. The Nystr\"{o}m method approximates a symmetric positive semidefinite matrix in terms of a small number of its…

Machine Learning · Computer Science 2013-10-02 Shusen Wang , Zhihua Zhang

In this paper we prove an optimal error estimate for the H(curl)-conforming projection based p-interpolation operator introduced in [L. Demkowicz and I. Babuska, p interpolation error estimates for edge finite elements of variable order in…

Numerical Analysis · Mathematics 2009-03-27 Alexei Bespalov , Norbert Heuer

Matrices resulting from the discretization of a kernel function, e.g., in the context of integral equations or sampling probability distributions, can frequently be approximated by interpolation. In order to improve the efficiency, a…

Numerical Analysis · Mathematics 2021-12-10 Steffen Börm

We propose a generalized CUR (GCUR) decomposition for matrix pairs $(A, B)$. Given matrices $A$ and $B$ with the same number of columns, such a decomposition provides low-rank approximations of both matrices simultaneously, in terms of some…

Numerical Analysis · Mathematics 2021-11-04 Perfect Y. Gidisu , Michiel E. Hochstenbach

In many applications such as data compression, imaging or genomic data analysis, it is important to approximate a given tensor by a tensor that is sparsely representable. For matrices, i.e. 2-tensors, such a representation can be obtained…

Numerical Analysis · Mathematics 2014-12-12 Shmuel Friedland , Venu Tammali

Large models and enormous data are essential driving forces of the unprecedented successes achieved by modern algorithms, especially in scientific computing and machine learning. Nevertheless, the growing dimensionality and model…

Machine Learning · Computer Science 2023-10-04 Yijun Dong

Designing and implementing systems as an interconnection of smaller subsystems is a common practice for modularity and standardization of components and design algorithms. Although not typically cast in this framework, many of these…

Systems and Control · Computer Science 2016-06-29 Sefa Demirtas , Alan V. Oppenheim

This paper introduces the hierarchical interpolative factorization for integral equations (HIF-IE) associated with elliptic problems in two and three dimensions. This factorization takes the form of an approximate generalized LU…

Numerical Analysis · Mathematics 2015-04-21 Kenneth L. Ho , Lexing Ying

After training complex deep learning models, a common task is to compress the model to reduce compute and storage demands. When compressing, it is desirable to preserve the original model's per-example decisions (e.g., to go beyond top-1…

Machine Learning · Computer Science 2022-10-18 Jerry Chee , Megan Renz , Anil Damle , Christopher De Sa

In general, matrix or tensor-valued functions are approximated using the method developed for vector-valued functions by transforming the matrix-valued function into vector form. This paper proposes a tensor-based interpolation method to…

Numerical Analysis · Mathematics 2026-05-08 Brij Nandan Tripathi , Hanumant Singh Shekhawat , Seip Weiland

This paper proposes a scalable binary CUR low-rank approximation algorithm that leverages parallel selection of representative rows and columns within a deterministic framework. By employing a blockwise adaptive cross approximation…

Numerical Analysis · Mathematics 2025-03-05 Bowen Su

In the last decades, tensors have emerged as the right tool to represent multidimensional data in a compact yet informative manner. Moreover, it is well-known that by performing low-rank factorizations of such tensors one is often able to…

Numerical Analysis · Mathematics 2026-03-31 Martina Iannacito , Sascha Portaro , Davide Palitta , Claudio Arlandini , Domitilla Brandoni