English
Related papers

Related papers: Optimization on the Hierarchical Tucker manifold -…

200 papers

We study the low-rank phase retrieval problem, where the objective is to recover a sequence of signals (typically images) given the magnitude of linear measurements of those signals. Existing solutions involve recovering a matrix…

Image and Video Processing · Electrical Eng. & Systems 2022-02-18 Soo Min Kwon , Xin Li , Anand D. Sarwate

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

In this paper we propose efficient randomized fixed-precision techniques for low tubal rank approximation of tensors. The proposed methods are faster and more efficient than the existing fixed-precision algorithms for approximating the…

Numerical Analysis · Mathematics 2025-05-22 Salman Ahmadi-Asl , Naeim Rezaeian , Cesar F. Caiafa , Andre L. F. de Almeidad

We propose a novel framework for fast integral operations by uncovering hidden geometries in the row and column structures of the underlying operators. This is accomplished through the \texttt{Questionnaire} algorithm, an iterative…

Numerical Analysis · Mathematics 2026-02-27 Pei-Chun Su , Ronald R. Coifman

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is…

Machine Learning · Statistics 2015-03-17 Ryota Tomioka , Kohei Hayashi , Hisashi Kashima

We investigate the fundamental conditions on the sampling pattern, i.e., locations of the sampled entries, for finite completability of a low-rank tensor given some components of its Tucker rank. In order to find the deterministic necessary…

Numerical Analysis · Computer Science 2019-05-13 Morteza Ashraphijuo , Vaneet Aggarwal , Xiaodong Wang

This paper proposes an efficient algorithm (HOLRR) to handle regression tasks where the outputs have a tensor structure. We formulate the regression problem as the minimization of a least square criterion under a multilinear rank…

Machine Learning · Computer Science 2016-02-23 Guillaume Rabusseau , Hachem Kadri

We solve tensor balancing, rescaling an Nth order nonnegative tensor by multiplying N tensors of order N - 1 so that every fiber sums to one. This generalizes a fundamental process of matrix balancing used to compare matrices in a wide…

Methodology · Statistics 2018-10-30 Mahito Sugiyama , Hiroyuki Nakahara , Koji Tsuda

The tensor train (TT) rank has received increasing attention in tensor completion due to its ability to capture the global correlation of high-order tensors ($\textrm{order} >3$). For third order visual data, direct TT rank minimization has…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Meng Ding , Ting-Zhu Huang , Xi-Le Zhao , Michael K. Ng , Tian-Hui Ma

Currently, the size of scientific data is growing at an unprecedented rate. Data in the form of tensors exhibit high-order, high-dimensional, and highly sparse features. Although tensor-based analysis methods are very effective, the large…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-13 Zixuan Li

Trust-region (TR) and adaptive regularization using cubics (ARC) have proven to have some very appealing theoretical properties for non-convex optimization by concurrently computing function value, gradient, and Hessian matrix to obtain the…

Machine Learning · Computer Science 2023-10-19 Liu Liu , Xuanqing Liu , Cho-Jui Hsieh , Dacheng Tao

The Tucker decomposition generalizes the notion of Singular Value Decomposition (SVD) to tensors, the higher dimensional analogues of matrices. We study the problem of constructing the Tucker decomposition of sparse tensors on distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-22 Venkatesan T. Chakaravarthy , Jee W. Choi , Douglas J. Joseph , Prakash Murali , Shivmaran S. Pandian , Yogish Sabharwal , Dheeraj Sreedhar

We introduce the tensor numerical method for solution of the $d$-dimensional optimal control problems with fractional Laplacian type operators in constraints discretized on large $n^{\otimes d}$ tensor-product Cartesian grids. The approach…

Numerical Analysis · Mathematics 2020-05-27 Gennadij Heidel , Venera Khoromskaia , Boris N. Khoromskij , Volker Schulz

This paper proposes a novel paradigm for machine learning that moves beyond traditional parameter optimization. Unlike conventional approaches that search for optimal parameters within a fixed geometric space, our core idea is to treat the…

Machine Learning · Computer Science 2025-10-31 Di Zhang

Higher-order low-rank tensors naturally arise in many applications including hyperspectral data recovery, video inpainting, seismic data recon- struction, and so on. We propose a new model to recover a low-rank tensor by simultaneously…

Numerical Analysis · Computer Science 2015-07-07 Yangyang Xu , Ruru Hao , Wotao Yin , Zhixun Su

In this paper, we present a new adaptive rank approximation technique for computing solutions to the high-dimensional linear kinetic transport equation. The approach we propose is based on a macro-micro decomposition of the kinetic model in…

Numerical Analysis · Mathematics 2025-09-09 William A. Sands , Wei Guo , Jing-Mei Qiu , Tao Xiong

This paper is concerned with the development and analysis of an iterative solver for high-dimensional second-order elliptic problems based on subspace-based low-rank tensor formats. Both the subspaces giving rise to low-rank approximations…

Numerical Analysis · Mathematics 2014-07-21 Markus Bachmayr , Wolfgang Dahmen

This paper tackles the problem of recovering a low-rank signal tensor with possibly correlated components from a random noisy tensor, or so-called spiked tensor model. When the underlying components are orthogonal, they can be recovered…

Machine Learning · Statistics 2023-03-20 Mohamed El Amine Seddik , Mohammed Mahfoud , Merouane Debbah

High-order tensor decomposition has been widely adopted to obtain compact deep neural networks for edge deployment. However, existing studies focus primarily on its algorithmic advantages such as accuracy and compression ratio-while…

Hardware Architecture · Computer Science 2025-11-26 Jinsong Zhang , Minghe Li , Jiayi Tian , Jinming Lu , Zheng Zhang

Tensor networks represent the state-of-the-art in computational methods across many disciplines, including the classical simulation of quantum many-body systems and quantum circuits. Several applications of current interest give rise to…

Quantum Physics · Physics 2021-03-17 Johnnie Gray , Stefanos Kourtis