English
Related papers

Related papers: Rank adaptive tensor recovery based model reductio…

200 papers

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

Randomized numerical linear algebra is proved to bridge theoretical advancements to offer scalable solutions for approximating tensor decomposition. This paper introduces fast randomized algorithms for solving the fixed Tucker-rank problem…

Numerical Analysis · Mathematics 2025-06-06 Maolin Che , Yimin Wei , Chong Wu , Hong Yan

We study the problem of high-dimensional robust mean estimation in the presence of a constant fraction of adversarial outliers. A recent line of work has provided sophisticated polynomial-time algorithms for this problem with…

Machine Learning · Computer Science 2020-05-05 Yu Cheng , Ilias Diakonikolas , Rong Ge , Mahdi Soltanolkotabi

This paper presents a numerical framework for the low-rank approximation of the solution to three-dimensional parabolic problems. The key contribution of this work is the tensorization process based on a tensor-train reformulation of the…

Numerical Analysis · Mathematics 2025-09-15 Gianmarco Manzini , Tommaso Sorgente

This paper presents a novel adaptive-sparse polynomial dimensional decomposition (PDD) method for stochastic design optimization of complex systems. The method entails an adaptive-sparse PDD approximation of a high-dimensional stochastic…

Numerical Analysis · Mathematics 2016-01-13 Sharif Rahman , Xuchun Ren , Vaibhav Yadav

The low-rank approximation is a complexity reduction technique to approximate a tensor or a matrix with a reduced rank, which has been applied to the simulation of high dimensional problems to reduce the memory required and computational…

Computational Physics · Physics 2020-08-26 Zhuogang Peng , Ryan McClarren , Martin Frank

This paper proposes a new methodology to predict and update the residual useful lifetime of a system using a sequence of degradation images. The methodology integrates tensor linear algebra with traditional location-scale regression widely…

Applications · Statistics 2017-06-13 Xiaolei Fang , Kamran Paynabar , Nagi Gebraeel

We introduce an adaptive sampling method for the Deep Ritz method aimed at solving partial differential equations (PDEs). Two deep neural networks are used. One network is employed to approximate the solution of PDEs, while the other one is…

Machine Learning · Computer Science 2023-10-31 Xiaoliang Wan , Tao Zhou , Yuancheng Zhou

Principal Component Analysis is a novel way of of dimensionality reduction. This problem essentially boils down to finding the top k eigen vectors of the data covariance matrix. A considerable amount of literature is found on algorithms…

Machine Learning · Computer Science 2019-01-08 Jian Vora

Tensor numerical methods, based on the rank-structured tensor representation of $d$-variate functions and operators, are designed to provide $O(dn)$ complexity of numerical calculations on $n^{\otimes d }$ grids contrary to $O(n^d)$ scaling…

Numerical Analysis · Mathematics 2022-02-01 Venera Khoromskaia , Boris N. Khoromskij

This paper studies a recovery task of finding a low multilinear-rank tensor that fulfills some linear constraints in the general settings, which has many applications in computer vision and graphics. This problem is named as the low…

Optimization and Control · Mathematics 2013-10-08 Lei Yang , Zheng-Hai Huang , Yufan Li

Randomized neural networks (RaNNs) are attractive for partial differential equations (PDEs) because they replace expensive end-to-end training with a linear least-squares solve over randomized hidden features. Their practical performance,…

Numerical Analysis · Mathematics 2026-04-28 You Yang , Fei Wang

In this manuscript, we analyze the sparse signal recovery (compressive sensing) problem from the perspective of convex optimization by stochastic proximal gradient descent. This view allows us to significantly simplify the recovery analysis…

Data Structures and Algorithms · Computer Science 2013-04-19 Rong Jin , Tianbao Yang , Shenghuo Zhu

The majority of methods used to compute approximations to the Hamilton-Jacobi-Isaacs partial differential equation (HJI PDE) rely on the discretization of the state space to perform dynamic programming updates. This type of approach is…

Machine Learning · Computer Science 2019-04-15 Vicenç Rubies-Royo , Claire Tomlin

This work proposes and analyzes a generalized acceleration technique for decreasing the computational complexity of using stochastic collocation (SC) methods to solve partial differential equations (PDEs) with random input data. The SC…

Numerical Analysis · Mathematics 2015-05-05 Diego Galindo , Peter Jantsch , Clayton G. Webster , Guannan Zhang

Dynamic discrete choice models are widely employed to answer substantive and policy questions in settings where individuals' current choices have future implications. However, estimation of these models is often computationally intensive…

Methodology · Statistics 2025-04-11 Ebrahim Barzegary , Hema Yoganarasimhan

We develop a domain-decomposition model reduction method for linear steady-state convection-diffusion equations with random coefficients. Of particular interest to this effort are the diffusion equations with random diffusivities, and the…

Numerical Analysis · Mathematics 2018-02-13 Lin Mu , Guannan Zhang

We derive rank bounds on the quantized tensor train (QTT) compressed approximation of singularly perturbed reaction diffusion partial differential equations (PDEs) in one dimension. Specifically, we show that, independently of the scale of…

Numerical Analysis · Mathematics 2020-10-15 Carlo Marcati , Maxim Rakhuba , Johan E. M. Ulander

We study extensions of compressive sensing and low rank matrix recovery to the recovery of low rank tensors from incomplete linear information. While the reconstruction of low rank matrices via nuclear norm minimization is rather…

Information Theory · Computer Science 2017-02-16 Holger Rauhut , Željka Stojanac

Estimation of probability density function from samples is one of the central problems in statistics and machine learning. Modern neural network-based models can learn high dimensional distributions but have problems with hyperparameter…

Machine Learning · Computer Science 2022-02-28 Georgii S. Novikov , Maxim E. Panov , Ivan V. Oseledets