English
Related papers

Related papers: Generative modeling via tensor train sketching

200 papers

Accurately modeling time-continuous stochastic processes from irregular observations remains a significant challenge. In this paper, we leverage ideas from generative modeling of image data to push the boundary of time series generation.…

Numerical Analysis · Mathematics 2025-05-30 T. Jahn , J. Chemseddine , P. Hagemann , C. Wald , G. Steidl

We provide guarantees for learning latent variable models emphasizing on the overcomplete regime, where the dimensionality of the latent space can exceed the observed dimensionality. In particular, we consider multiview mixtures, spherical…

Machine Learning · Computer Science 2014-12-18 Animashree Anandkumar , Rong Ge , Majid Janzamin

Because of the huge number of graphs possible even with a small number of nodes, inference on network structure is known to be a challenging problem. Generating large random directed graphs with prescribed probabilities of occurrences of…

Quantitative Methods · Quantitative Biology 2017-05-03 Frederic Y. Bois , Ghislaine Gayraud

The tensor-train (TT) decomposition is widely used to compress large tensors into a more compact form by exploiting their inherent data structures. A fundamental approach for constructing the TT format is the well-known TT-SVD method, which…

Numerical Analysis · Mathematics 2026-05-26 Yuchao Wang , Maolin Che , Yimin Wei

In recent years, the application of tensors has become more widespread in fields that involve data analytics and numerical computation. Due to the explosive growth of data, low-rank tensor decompositions have become a powerful tool to…

Numerical Analysis · Mathematics 2020-11-03 Lingjie Li , Wenjian Yu , Kim Batselier

The Neural Tangent Kernel (NTK) characterizes the behavior of infinitely-wide neural networks trained under least squares loss by gradient descent. Recent works also report that NTK regression can outperform finitely-wide neural networks…

Machine Learning · Computer Science 2021-12-09 Amir Zandieh , Insu Han , Haim Avron , Neta Shoham , Chaewon Kim , Jinwoo Shin

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

The goal of compressed sensing is to estimate a vector from an underdetermined system of noisy linear measurements, by making use of prior knowledge on the structure of vectors in the relevant domain. For almost all results in this…

Machine Learning · Statistics 2017-03-10 Ashish Bora , Ajil Jalal , Eric Price , Alexandros G. Dimakis

Matrix sketching is a recently developed data compression technique. An input matrix A is efficiently approximated with a smaller matrix B, so that B preserves most of the properties of A up to some guaranteed approximation ratio. In so…

Machine Learning · Statistics 2019-12-03 Roberta Falcone , Angela Montanari , Laura Anderlucci

Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised…

Machine Learning · Statistics 2017-05-22 E. Miles Stoudenmire , David J. Schwab

Real networks exhibit nontrivial topological features such as heavy-tailed degree distribution, high clustering, and small-worldness. Researchers have developed several generative models for synthesizing artificial networks that are…

Social and Information Networks · Computer Science 2014-02-04 Sadegh Motallebi , Sadegh Aliakbary , Jafar Habibi

Tensor networks establish an adaptable framework for the emulation of quantum circuits. By partitioning exponentially large registers and gates into smaller tensors, this unlocks fast transformations through tensor algebra, and grants fine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-13 Jakub Adamski , Oliver Thomson Brown

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

Machine Learning · Statistics 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Tensor networks have found a wide use in a variety of applications in physics and computer science, recently leading to both theoretical insights as well as practical algorithms in machine learning. In this work we explore the connection…

Quantum Physics · Physics 2019-12-04 Ivan Glasser , Nicola Pancotti , J. Ignacio Cirac

Sketching and stochastic gradient methods are arguably the most common techniques to derive efficient large scale learning algorithms. In this paper, we investigate their application in the context of nonparametric statistical learning.…

Machine Learning · Statistics 2019-01-25 Luigi Carratino , Alessandro Rudi , Lorenzo Rosasco

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

Low-rank tensor approximation approaches have become an important tool in the scientific computing community. The aim is to enable the simulation and analysis of high-dimensional problems which cannot be solved using conventional methods…

Numerical Analysis · Mathematics 2019-02-26 Patrick Gelß , Stefan Klus , Sebastian Matera , Christof Schütte

We propose an algorithm for solution of high-dimensional evolutionary equations (ODEs and discretized time-dependent PDEs) in the Tensor Train (TT) decomposition, assuming that the solution and the right-hand side of the ODE admit such a…

Numerical Analysis · Mathematics 2017-10-05 Sergey V. Dolgov

Leveraging the kernel trick in both the input and output spaces, surrogate kernel methods are a flexible and theoretically grounded solution to structured output prediction. If they provide state-of-the-art performance on complex data sets…

Machine Learning · Statistics 2024-05-07 Tamim El Ahmad , Luc Brogat-Motte , Pierre Laforgue , Florence d'Alché-Buc