English
Related papers

Related papers: CUR Matrix Approximation through Convex Optimizati…

200 papers

Large deep learning models have achieved remarkable success but are resource-intensive, posing challenges such as memory usage. We introduce CURing, a novel model compression method based on CUR matrix decomposition, which approximates…

Machine Learning · Computer Science 2025-01-13 Sanghyeon Park , Soo-Mook Moon

We propose a generalized CUR (GCUR) decomposition for matrix pairs $(A, B)$. Given matrices $A$ and $B$ with the same number of columns, such a decomposition provides low-rank approximations of both matrices simultaneously, in terms of some…

Numerical Analysis · Mathematics 2021-11-04 Perfect Y. Gidisu , Michiel E. Hochstenbach

Distributions measured in high energy physics experiments are usually distorted and/or transformed by various detector effects. A regularization method for unfolding these distributions is re-formulated in terms of the Singular Value…

High Energy Physics - Phenomenology · Physics 2008-11-26 Andreas Hoecker , Vakhtang Kartvelishvili

Cross-validation (CV) is widely used for tuning a model with respect to user-selected parameters and for selecting a "best" model. For example, the method of $k$-nearest neighbors requires the user to choose $k$, the number of neighbors,…

Applications · Statistics 2012-03-01 Hui Shen , William J. Welch , Jacqueline M. Hughes-Oliver

In this paper, we propose a method for image-set classification based on convex cone models, focusing on the effectiveness of convolutional neural network (CNN) features as inputs. CNN features have non-negative values when using the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Naoya Sogi , Taku Nakayama , Kazuhiro Fukui

Recently, Stewart gave an algorithm for computing a rank revealing URV decomposition of a rectangular matrix. His method makes use of a refinement iteration to achieve an improved estimate of the smallest singular value and its…

Numerical Analysis · Mathematics 2018-03-28 Limin Wu

This paper aims at a better understanding of matrix factorization (MF), factorization machines (FM), and their combination with deep algorithms' application in recommendation systems. Specifically, this paper will focus on Singular Value…

Information Retrieval · Computer Science 2022-03-22 Yuefeng Zhang

In this article, we consider the sparse tensor singular value decomposition, which aims for dimension reduction on high-dimensional high-order data with certain sparsity structure. A method named Sparse Tensor Alternating Thresholding for…

Statistics Theory · Mathematics 2024-07-09 Anru Zhang , Rungang Han

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

Most recently, tensor-SVD is implemented on multi-view self-representation clustering and has achieved the promising results in many real-world applications such as face clustering, scene clustering and generic object clustering. However,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-18 Yanyun Qu , Jinyan Liu , Yuan Xie , Wensheng Zhang

SVD serves as an exploratory tool in identifying the dominant features in the form of top rank-r singular factors corresponding to the largest singular values. For Big Data applications it is well known that Singular Value Decomposition…

Machine Learning · Computer Science 2021-04-30 Gurpreet Singh , Soumyajit Gupta

Sparse linear prediction methods suffer from decreased prediction accuracy when the predictor variables have cluster structure (e.g. there are highly correlated groups of variables). To improve prediction accuracy, various methods have been…

Machine Learning · Statistics 2022-02-03 Rebecca Marion , Johannes Lederer , Bernadette Govaerts , Rainer von Sachs

The randomized singular value decomposition (R-SVD) is a popular sketching-based algorithm for efficiently computing the partial SVD of a large matrix. When the matrix is low-rank, the R-SVD produces its partial SVD exactly; but when the…

Information Theory · Computer Science 2023-07-07 Elad Romanov

A rank-$r$ matrix $X \in \mathbb{R}^{m \times n}$ can be written as a product $U V^\top$, where $U \in \mathbb{R}^{m \times r}$ and $V \in \mathbb{R}^{n \times r}$. One could exploit this observation in optimization: e.g., consider the…

Optimization and Control · Mathematics 2016-11-01 Dohyung Park , Anastasios Kyrillidis , Constantine Caramanis , Sujay Sanghavi

Large-scale sparse precision matrix estimation has attracted wide interest from the statistics community. The convex partial correlation selection method (CONCORD) developed by Khare et al. (2015) has recently been credited with some…

Computation · Statistics 2021-06-18 Young-Geun Choi , Seunghwan Lee , Donghyeon Yu

Classical radar detection techniques rely on adaptive detectors that estimate the noise covariance matrix from target-free secondary data. While effective in Gaussian environments, these methods degrade in the presence of clutter, which is…

Machine Learning · Computer Science 2026-02-24 Jean Pinsolle , Yadang Alexis Rouzoumka , Chengfang Ren , Chistèle Morisseau , Jean-Philippe Ovarlez

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

The tensor Singular Value Decomposition (t-SVD) for third order tensors that was proposed by Kilmer and Martin~\cite{2011kilmer} has been applied successfully in many fields, such as computed tomography, facial recognition, and video…

Numerical Analysis · Mathematics 2016-09-23 Jiani Zhang , Arvind K. Saibaba , Misha Kilmer , Shuchin Aeron

Synthetic aperture radar (SAR) is widely used for ground surface classification since it utilizes information on vegetation and soil unavailable in optical observation. Image classification often employs convolutional neural networks.…

Signal Processing · Electrical Eng. & Systems 2021-08-31 Bungo Konishi , Akira Hirose , Ryo Natsuaki

The paper provides a parametrization of Vector Autoregression (VAR) that enables one to look at the parameters associated with unit root dynamics and those associated with stable dynamics separately. The task is achieved via a novel…

Methodology · Statistics 2021-04-07 Anindya Roy , Tucker S. McElroy