English
Related papers

Related papers: ATENSOR - REDUCE program for tensor simplification

200 papers

The tubal tensor framework provides a clean and effective algebraic setting for tensor computations, supporting matrix-mimetic features like Singular Value Decomposition and Eckart-Young-like optimality results. Underlying the tubal tensor…

Numerical Analysis · Mathematics 2025-04-25 Uria Mor , Haim Avron

Multiway data often naturally occurs in a tensorial format which can be approximately represented by a low-rank tensor decomposition. This is useful because complexity can be significantly reduced and the treatment of large-scale data sets…

Machine Learning · Computer Science 2021-08-10 Clara Menzen , Manon Kok , Kim Batselier

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

An elimination problem in semidefinite programming is solved by means of tensor algebra. It concerns families of matrix cube problems whose constraints are the minimum and maximum eigenvalue function on an affine space of symmetric…

Optimization and Control · Mathematics 2008-04-29 Jiawang Nie , Bernd Sturmfels

In this paper, we propose a dimension reduction method specifically designed for tensor-structured feature data in deep neural networks. The method is implemented as a hidden layer, called the TensorProjection layer, which transforms input…

Machine Learning · Statistics 2024-10-23 Toshinari Morimoto , Su-Yun Huang

Tensor algebra lies at the core of computational science and machine learning. Due to its high usage, entire libraries exist dedicated to improving its performance. Conventional tensor algebra performance boosts focus on algorithmic…

Programming Languages · Computer Science 2022-08-16 Sathvik Redrouthu , Rishi Athavale

A lattice reduction is an algorithm that transforms the given basis of the lattice to another lattice basis such that problems like finding a shortest vector and closest vector become easier to solve. Some of the famous lattice reduction…

Data Structures and Algorithms · Computer Science 2019-12-05 Mithilesh Kumar

Many real-world datasets are represented as tensors, i.e., multi-dimensional arrays of numerical values. Storing them without compression often requires substantial space, which grows exponentially with the order. While many tensor…

Machine Learning · Computer Science 2023-09-21 Taehyung Kwon , Jihoon Ko , Jinhong Jung , Kijung Shin

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Sequential data such as time series, video, or text can be challenging to analyse as the ordered structure gives rise to complex dependencies. At the heart of this is non-commutativity, in the sense that reordering the elements of a…

Machine Learning · Computer Science 2021-08-02 Csaba Toth , Patric Bonnier , Harald Oberhauser

A symmetric tensor of small rank decomposes into a configuration of only few vectors. We study the variety of tensors for which this configuration is a unit norm tight frame.

Algebraic Geometry · Mathematics 2015-11-18 Luke Oeding , Elina Robeva , Bernd Sturmfels

Tensor decomposition methods allow us to learn the parameters of latent variable models through decomposition of low-order moments of data. A significant limitation of these algorithms is that there exists no general method to regularize…

Machine Learning · Statistics 2019-05-28 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

Numerical Analysis · Mathematics 2016-05-18 Kookjin Lee , Howard C. Elman

Tensor algebra is a crucial component for data-intensive workloads such as machine learning and scientific computing. As the complexity of data grows, scientists often encounter a dilemma between the highly specialized dense tensor algebra…

Programming Languages · Computer Science 2024-07-19 Mahdi Ghorbani , Emilien Bauer , Tobias Grosser , Amir Shaikhha

Tensor completion is a technique of filling missing elements of the incomplete data tensors. It being actively studied based on the convex optimization scheme such as nuclear-norm minimization. When given data tensors include some noises,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Tatsuya Yokota , Hidekata Hontani

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

Statistical Mechanics · Physics 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

We present a novel feature selection technique, Sparse Linear Centroid-Encoder (SLCE). The algorithm uses a linear transformation to reconstruct a point as its class centroid and, at the same time, uses the $\ell_1$-norm penalty to filter…

Machine Learning · Computer Science 2023-06-12 Tomojit Ghosh , Michael Kirby , Karim Karimov

We introduce a new theoretical framework for deriving lower bounds on data movement in bilinear algorithms. Bilinear algorithms are a general representation of fast algorithms for bilinear functions, which include computation of matrix…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-23 Edgar Solomonik , James Demmel , Torsten Hoefler

Dynamic latent space models are widely used for characterizing changes in networks and relational data over time. These models assign to each node latent attributes that characterize connectivity with other nodes, with these latent…

Methodology · Statistics 2024-12-13 Jennifer Noelle Kampe , Luca Alessandro Silva , Tomas Roslin , David Brian Dunson