English
Related papers

Related papers: Combined Reduced-Rank Transform

200 papers

This letter proposes a novel adaptive reduced-rank filtering scheme based on joint iterative optimization of adaptive filters. The novel scheme consists of a joint iterative optimization of a bank of full-rank adaptive filters that forms…

Information Theory · Computer Science 2012-05-22 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

This paper proposes fast randomized algorithms for computing the Kronecker Tensor Decomposition (KTD). The proposed algorithms can decompose a given tensor into the KTD format much faster than the existing state-of-the-art algorithms. Our…

Numerical Analysis · Mathematics 2025-05-22 Salman Ahmadi-Asl , Naeim Rezaeian , Andre L. F. de Almeida , Yipeng Liu

We study a non-convex low-rank promoting penalty function, the transformed Schatten-1 (TS1), and its applications in matrix completion. The TS1 penalty, as a matrix quasi-norm defined on its singular values, interpolates the rank and the…

Information Theory · Computer Science 2016-10-19 Shuai Zhang , Penghang Yin , Jack Xin

We present a novel method to approximate optimal feedback laws for nonlinear optimal control based on low-rank tensor train (TT) decompositions. The approach is based on the Dirac-Frenkel variational principle with the modification that the…

Optimization and Control · Mathematics 2021-11-30 Martin Eigel , Reinhold Schneider , David Sommer

We present a new method for the constraint-based synthesis of termination arguments for linear loop programs based on linear ranking templates. Linear ranking templates are parametrized, well-founded relations such that an assignment to the…

Logic in Computer Science · Computer Science 2014-01-22 Jan Leike , Matthias Heizmann

Many applications in data science and scientific computing involve large-scale datasets that are expensive to store and compute with, but can be efficiently compressed and stored in an appropriate tensor format. In recent years, randomized…

Numerical Analysis · Mathematics 2019-05-20 Rachel Minster , Arvind K. Saibaba , Misha E. Kilmer

This work proposes a low complexity nonlinearity model and develops adaptive algorithms over it. The model is based on the decomposable---or rank-one, in tensor language---Volterra kernels. It may also be described as a product of FIR…

Systems and Control · Computer Science 2016-10-25 Felipe C. Pinheiro , Cassio G. Lopes

This paper proposes a robust reduced-rank scheme for adaptive beamforming based on joint iterative optimization (JIO) of adaptive filters. The novel scheme is designed according to the constant modulus (CM) criterion subject to different…

Information Theory · Computer Science 2013-01-30 Lei Wang , Rodrigo C. de Lamare

In this paper, we study the problem of image recovery from given partial (corrupted) observations. Recovering an image using a low-rank model has been an active research area in data analysis and machine learning. But often, images are not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Pawan Goyal , Hussam Al Daas , Peter Benner

The reduced-rank method exploits the distortion-variance tradeoff to yield superior solutions for classic problems in statistical signal processing such as parameter estimation and filtering. The central idea is to reduce the variance of…

Information Theory · Computer Science 2019-03-06 K. G. Nagananda , Pramod Khargonekar

We comment on two randomized algorithms for constructing low-rank matrix decompositions. Both algorithms employ the Subsampled Randomized Hadamard Transform [14]. The first algorithm appeared recently in [9]; here, we provide a novel…

Data Structures and Algorithms · Computer Science 2012-04-04 Christos Boutsidis

Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Bo-Shiuan Chu , Che-Rung Lee

Reinforcement learning (RL) in episodic, factored Markov decision processes (FMDPs) is studied. We propose an algorithm called FMDP-BF, which leverages the factorization structure of FMDP. The regret of FMDP-BF is shown to be exponentially…

Machine Learning · Computer Science 2021-03-11 Xiaoyu Chen , Jiachen Hu , Lihong Li , Liwei Wang

In numerous substitution models for the $\l_{0}$-norm minimization problem $(P_{0})$, the $\l_{p}$-norm minimization $(P_{p})$ with $0<p<1$ have been considered as the most natural choice. However, the non-convex optimization problem…

Optimization and Control · Mathematics 2018-04-27 Angang Cui , Jigen Peng , Haiyang Li

This paper presents a new method to determine the susceptances of a reduced transmission network representation by using nonlinear optimization. We use Power Transfer Distribution Factors (PTDFs) to convert the original grid into a reduced…

Systems and Control · Computer Science 2018-09-05 Philipp Fortenbacher , Turhan Demiray , Christian Schaffner

An algorithm for unconstrained non-convex optimization is described, which does not evaluate the objective function and in which minimization is carried out, at each iteration, within a randomly selected subspace. It is shown that this…

Optimization and Control · Mathematics 2025-01-31 S. Bellavia , S. Gratton , B. Morini , Ph. L. Toint

Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized…

Optimization and Control · Mathematics 2024-05-21 Wenjing Li , Wei Bian , Kim-Chuan Toh

This paper considers the problem of finding a low rank matrix from observations of linear combinations of its elements. It is well known that if the problem fulfills a restricted isometry property (RIP), convex relaxations using the nuclear…

Optimization and Control · Mathematics 2017-11-13 Carl Olsson , Marcus Carlsson , Erik Bylow

Nonnegative matrix factorization is the following problem: given a nonnegative input matrix $V$ and a factorization rank $K$, compute two nonnegative matrices, $W$ with $K$ columns and $H$ with $K$ rows, such that $WH$ approximates $V$ as…

Optimization and Control · Mathematics 2025-01-10 Valentin Leplat , Yurii Nesterov , Nicolas Gillis , François Glineur

Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective…

Optimization and Control · Mathematics 2021-03-30 April Sagan , John E. Mitchell