English
Related papers

Related papers: Tensor denoising with trend filtering

200 papers

This paper tackles the problem of recovering a low-rank signal tensor with possibly correlated components from a random noisy tensor, or so-called spiked tensor model. When the underlying components are orthogonal, they can be recovered…

Machine Learning · Statistics 2023-03-20 Mohamed El Amine Seddik , Mohammed Mahfoud , Merouane Debbah

This work studies the denoising of piecewise smooth graph signals that exhibit inhomogeneous levels of smoothness over a graph, where the value at each node can be vector-valued. We extend the graph trend filtering framework to denoising…

Signal Processing · Electrical Eng. & Systems 2020-01-16 Rohan Varma , Harlin Lee , Jelena Kovačević , Yuejie Chi

Because of the attractiveness of the canonical polyadic (CP) tensor decomposition in various applications, several algorithms have been designed to compute it, but efficient ones are still lacking. Iterative deflation algorithms based on…

Numerical Analysis · Computer Science 2015-08-24 Alex Pereira da Silva , Pierre Comon , Andre Lima Ferrer de Almeida

We show that finding rank-$R$ decompositions of a 3D tensor, for $R\le 4$, over a fixed finite field can be done in polynomial time. However, if some cells in the tensor are allowed to have arbitrary values, then rank-2 is NP-hard over the…

Computational Complexity · Computer Science 2024-04-18 Jason Yang

The problem of low-tubal-rank tensor estimation is a fundamental task with wide applications across high-dimensional signal processing, machine learning, and image science. Traditional approaches tackle such a problem by performing tensor…

Machine Learning · Computer Science 2025-12-24 Zhiyu Liu , Zhi Han , Yandong Tang , Jun Fan , Yao Wang

This paper investigates risk bounds for quantile additive trend filtering, a method gaining increasing significance in the realms of additive trend filtering and quantile regression. We investigate the constrained version of quantile trend…

Statistics Theory · Mathematics 2025-05-19 Zhi Zhang , Kyle Ritscher , Oscar Hernan Madrid Padilla

The first order derivative of a data density can be estimated efficiently by denoising score matching, and has become an important component in many applications, such as image generation and audio synthesis. Higher order derivatives…

Machine Learning · Computer Science 2021-11-09 Chenlin Meng , Yang Song , Wenzhe Li , Stefano Ermon

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

We study the optimization problem for decomposing $d$ dimensional fourth-order Tensors with $k$ non-orthogonal components. We derive \textit{deterministic} conditions under which such a problem does not have spurious local minima. In…

Machine Learning · Computer Science 2019-11-25 Maziar Sanjabi , Sina Baharlouei , Meisam Razaviyayn , Jason D. Lee

In this paper we propose novel methods for completion (from limited samples) and de-noising of multilinear (tensor) data and as an application consider 3-D and 4- D (color) video data completion and de-noising. We exploit the recently…

Computer Vision and Pattern Recognition · Computer Science 2014-10-31 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

Tensor decomposition is a fundamental method used in various areas to deal with high-dimensional data. \emph{Tensor power method} (TPM) is one of the widely-used techniques in the decomposition of tensors. This paper presents a novel tensor…

Machine Learning · Computer Science 2023-06-02 Yichuan Deng , Zhao Song , Junze Yin

Inspired by holographic codes and tensor-network decoders, we introduce tensor-network stabilizer codes which come with a natural tensor-network decoder. These codes can correspond to any geometry, but, as a special case, we generalize…

Quantum Physics · Physics 2021-07-28 Terry Farrelly , Robert J. Harris , Nathan A. McMahon , Thomas M. Stace

This research focuses on the estimation of a non-parametric regression function designed for data with simultaneous time and space dependencies. In such a context, we study the Trend Filtering, a nonparametric estimator introduced by…

Methodology · Statistics 2023-09-14 Carlos Misael Madrid Padilla , Oscar Hernan Madrid Padilla , Daren Wang

We consider the problem of decomposing a higher-order tensor with binary entries. Such data problems arise frequently in applications such as neuroimaging, recommendation system, topic modeling, and sensor network localization. We propose a…

Machine Learning · Statistics 2020-09-22 Miaoyan Wang , Lexin Li

Multivariate polynomials arise in many different disciplines. Representing such a polynomial as a vector of univariate polynomials can offer useful insight, as well as more intuitive understanding. For this, techniques based on tensor…

Optimization and Control · Mathematics 2016-01-29 Gabriel Hollander , Philippe Dreesen , Mariya Ishteva , Johan Schoukens

The tensor train decomposition decomposes a tensor into a "train" of 3-way tensors that are interconnected through the summation of auxiliary indices. The decomposition is stable, has a well-defined notion of rank and enables the user to…

Numerical Analysis · Computer Science 2018-11-12 Kim Batselier

The results of Strassen and Raz show that good enough tensor rank lower bounds have implications for algebraic circuit/formula lower bounds. We explore tensor rank lower and upper bounds, focusing on explicit tensors. For odd d, we…

Computational Complexity · Computer Science 2012-03-05 Boris Alexeev , Michael Forbes , Jacob Tsimerman

We propose a novel approach for density estimation called histogram trend filtering. Our estimator arises from looking at surrogate Poisson model for counts of observations in a partition of the support of the data. We begin by showing…

Methodology · Statistics 2016-02-09 Oscar Hernan Madrid Padilla , James G. Scott

In low-rank tensor completion tasks, due to the underlying multiple large-scale singular value decomposition (SVD) operations and rank selection problem of the traditional methods, they suffer from high computational cost and high…

Numerical Analysis · Computer Science 2018-05-23 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

We consider one-dimensional variants of the classical first order total variation denoising model introduced by Rudin, Osher and Fatemi. This study is based on our previous work on various denoising and inpainting problems in image…

Analysis of PDEs · Mathematics 2018-03-29 Martin Fuchs , Jan Mueller , Christian Tietz