English
Related papers

Related papers: Alternating proximal gradient method for sparse no…

200 papers

The proximal gradient method is a generic technique introduced to tackle the non-smoothness in optimization problems, wherein the objective function is expressed as the sum of a differentiable convex part and a non-differentiable…

Numerical Analysis · Mathematics 2024-01-19 Abdeslem Hafid Bentbib , Khalide Jbilou , Ridwane Tahiri

Multiway data often naturally occurs in a tensorial format which can be approximately represented by a low-rank tensor decomposition. This is useful because complexity can be significantly reduced and the treatment of large-scale data sets…

Machine Learning · Computer Science 2021-08-10 Clara Menzen , Manon Kok , Kim Batselier

Tensor networks have in recent years emerged as the powerful tools for solving the large-scale optimization problems. One of the most popular tensor network is tensor train (TT) decomposition that acts as the building blocks for the…

Numerical Analysis · Computer Science 2016-06-20 Qibin Zhao , Guoxu Zhou , Shengli Xie , Liqing Zhang , Andrzej Cichocki

Low-rank tensor completion aims to recover a tensor from partially observed entries, and it is widely applicable in fields such as quantum computing and image processing. Due to the significant advantages of the tensor train (TT) format in…

Machine Learning · Computer Science 2025-01-24 Fengmiao Bian , Jian-Feng Cai , Xiaoqun Zhang , Yuanwei Zhang

Structural Health Monitoring (SHM) provides an economic approach which aims to enhance understanding the behavior of structures by continuously collects data through multiple networked sensors attached to the structure. This data is then…

Machine Learning · Computer Science 2021-11-05 Ali Anaissi , Basem Suleiman , Seid Miad Zandavi

In recent research, Tensor Product Representation (TPR) is applied for the systematic generalization task of deep neural networks by learning the compositional structure of data. However, such prior works show limited performance in…

Machine Learning · Computer Science 2024-06-04 Taewon Park , Inchul Choi , Minho Lee

There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that…

Numerical Analysis · Mathematics 2021-09-09 Ilya Kisil , Giuseppe G. Calvi , Kriton Konstantinidis , Yao Lei Xu , Danilo P. Mandic

Many applications in data science and scientific computing involve large-scale datasets that are expensive to store and compute with, but can be efficiently compressed and stored in an appropriate tensor format. In recent years, randomized…

Numerical Analysis · Mathematics 2019-05-20 Rachel Minster , Arvind K. Saibaba , Misha E. Kilmer

The era of exascale computing opens new venues for innovations and discoveries in many scientific, engineering, and commercial fields. However, with the exaflops also come the extra-large high-dimensional data generated by high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-05 Manish Bhattarai , Gopinath Chennupati , Erik Skau , Raviteja Vangara , Hirsto Djidjev , Boian Alexandrov

Chandrasekaran, Parrilo and Willsky (2010) proposed a convex optimization problem to characterize graphical model selection in the presence of unobserved variables. This convex optimization problem aims to estimate an inverse covariance…

Optimization and Control · Mathematics 2012-09-27 Shiqian Ma , Lingzhou Xue , Hui Zou

We consider the noisy matrix sensing problem in the over-parameterization setting, where the estimated rank $r$ is larger than the true rank $r_\star$ of the target matrix $X_\star$. Specifically, our main objective is to recover a matrix $…

Machine Learning · Computer Science 2025-06-03 Zhiyu Liu , Zhi Han , Yandong Tang , Shaojie Tang , Yao Wang

Low-rank Tucker and CP tensor decompositions are powerful tools in data analytics. The widely used alternating least squares (ALS) method, which solves a sequence of over-determined least squares subproblems, is costly for large and sparse…

Numerical Analysis · Mathematics 2021-08-26 Linjian Ma , Edgar Solomonik

Tensors decompositions are a class of tools for analysing datasets of high dimensionality and variety in a natural manner, with the Canonical Polyadic Decomposition (CPD) being a main pillar. While the notion of CPD is closely intertwined…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Giuseppe G. Calvi , Bruno Scalzo Dees , Danilo P. Mandic

In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive…

Statistics Theory · Mathematics 2020-01-09 Anru Zhang , Dong Xia

Multilinear systems play an important role in scientific calculations of practical problems. In this paper, we consider a tensor splitting method with a relaxed Anderson acceleration for solving multilinear systems. The new method preserves…

Numerical Analysis · Mathematics 2024-10-18 Dongdong Liu Ting Hua nd Xifu Liu

Many differentially private and classical non-private graph algorithms rely crucially on determining whether some property of each vertex meets a threshold. For example, for the $k$-core decomposition problem, the classic peeling algorithm…

Data Structures and Algorithms · Computer Science 2025-08-05 Laxman Dhulipala , Monika Henzinger , George Z. Li , Quanquan C. Liu , A. R. Sricharan , Leqi Zhu

We propose personalized Tucker decomposition (perTucker) to address the limitations of traditional tensor decomposition methods in capturing heterogeneity across different datasets. perTucker decomposes tensor data into shared global…

Machine Learning · Computer Science 2025-08-25 Jiuyun Hu , Naichen Shi , Raed Al Kontar , Hao Yan

In this paper, we develop a new alternating projection method to compute nonnegative low rank matrix approximation for nonnegative matrices. In the nonnegative low rank matrix approximation method, the projection onto the manifold of fixed…

Machine Learning · Computer Science 2020-09-10 Guangjing Song , Michael K. Ng , Tai-Xiang Jiang

We introduce the tubal tensor train (TTT) decomposition, a tensor-network model that combines the t-product algebra of the tensor singular value decomposition (T-SVD) with the low-order core structure of the tensor train (TT) format. For an…

Numerical Analysis · Mathematics 2026-03-12 Salman Ahmadi-Asl , Valentin Leplat , Anh-Huy Phan , Andrzej Cichocki

Tensor decomposition, a collection of factorization techniques for multidimensional arrays, are among the most general and powerful tools for scientific analysis. However, because of their increasing size, today's data sets require more…

Machine Learning · Computer Science 2020-03-11 Jeremy Charlier , Vladimir Makarenkov