English
Related papers

Related papers: A tensor approximation method based on ideal minim…

200 papers

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Low-rank approximation is a technique to approximate a tensor or a matrix with a reduced rank to reduce the memory required and computational cost for simulation. Its broad applications include dimension reduction, signal processing,…

Computational Physics · Physics 2019-06-25 Zhuogang Peng , Ryan G. McClarren , Martin Frank

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

We introduce tensor numerical techniques for solving optimal control problems constrained by elliptic operators in $\mathbb{R}^d$, $d=2,3$, with variable coefficients, which can be represented in a low rank separable form. We construct a…

Numerical Analysis · Mathematics 2021-05-28 Boris N. Khoromskij , Britta Schmitt , Volker Schulz

Low-rank tensor methods for the approximate solution of second-order elliptic partial differential equations in high dimensions have recently attracted significant attention. A critical issue is to rigorously bound the error of such…

Numerical Analysis · Mathematics 2014-12-15 Markus Bachmayr , Wolfgang Dahmen

Recent advances in IoT and biometric sensing technologies have led to the generation of massive and high-dimensional tensor data, yet achieving accurate and efficient low-rank approximation remains a major challenge. Most existing tensor…

Machine Learning · Computer Science 2025-11-03 Hiroki Hasegawa , Yukihiko Okada

We propose a fast and scalable optimization method to solve chance or probabilistic constrained optimization problems governed by partial differential equations (PDEs) with high-dimensional random parameters. To address the critical…

Optimization and Control · Mathematics 2020-11-20 Peng Chen , Omar Ghattas

We present a new approach to using neural networks to approximate the solutions of variational equations, based on the adaptive construction of a sequence of finite-dimensional subspaces whose basis functions are realizations of a sequence…

Machine Learning · Computer Science 2021-06-01 Mark Ainsworth , Justin Dong

In this paper, we propose a novel model to recover a low-rank tensor by simultaneously performing double nuclear norm regularized low-rank matrix factorizations to the all-mode matricizations of the underlying tensor. An block successive…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

Many problems can be formulated as recovering a low-rank tensor. Although an increasingly common task, tensor recovery remains a challenging problem because of the delicacy associated with the decomposition of higher order tensors. To…

Machine Learning · Statistics 2014-05-09 Ming Yuan , Cun-Hui Zhang

In this paper, we propose a tensor type of discretization and optimization process for solving high dimensional partial differential equations. First, we design the tensor type of trial function for the high dimensional partial differential…

Numerical Analysis · Mathematics 2022-12-01 Yangfei Liao , Yifan Wang , Hehu Xie

Recently, there has been a growing interest in efficient numerical algorithms based on tensor networks and low-rank techniques to approximate high-dimensional functions and solutions to high-dimensional PDEs. In this paper, we propose a new…

Numerical Analysis · Mathematics 2023-08-16 Alec Dektor , Daniele Venturi

Low-rank approximation in data streams is a fundamental and significant task in computing science, machine learning and statistics. Multiple streaming algorithms have emerged over years and most of them are inspired by randomized…

Data Structures and Algorithms · Computer Science 2022-09-30 Cuiyu Liu , Chuanfu Xiao , Mingshuo Ding , Chao Yang

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke

We propose a probabilistic way for reducing the cost of classical projection-based model order reduction methods for parameter-dependent linear equations. A reduced order model is here approximated from its random sketch, which is a set of…

Numerical Analysis · Mathematics 2020-05-19 Oleg Balabanov , Anthony Nouy

We develop computational methods for approximating the solution of a linear multi-term matrix equation in low rank. We follow an alternating minimization framework, where the solution is represented as a product of two matrices, and…

Numerical Analysis · Mathematics 2020-06-16 Kookjin Lee , Howard C. Elman , Catherine E. Powell , Dongeun Lee

An optimization-based approach for the Tucker tensor approximation of parameter-dependent data tensors and solutions of tensor differential equations with low Tucker rank is presented. The problem of updating the tensor decomposition is…

Optimization and Control · Mathematics 2019-05-31 Lukas Exl

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

We construct a soft thresholding operation for rank reduction of hierarchical tensors and subsequently consider its use in iterative thresholding methods, in particular for the solution of discretized high-dimensional elliptic problems. The…

Numerical Analysis · Mathematics 2015-02-02 Markus Bachmayr , Reinhold Schneider

The goal of tensor completion is to recover a tensor from a subset of its entries, often by exploiting its low-rank property. Among several useful definitions of tensor rank, the low-tubal-rank was shown to give a valuable characterization…

Machine Learning · Computer Science 2022-10-18 Yicong He , George K. Atia