English
Related papers

Related papers: Nuclear Norm Subspace Identification (N2SID) for s…

200 papers

Weighted nuclear norm minimization has been recently recognized as a technique for reconstruction of a low-rank matrix from compressively sampled measurements when some prior information about the column and row subspaces of the matrix is…

Information Theory · Computer Science 2022-04-27 Hamideh Sadat Fazael Ardakani , Sajad Daei , Farzan Haddadi

Matrix form data sets arise in many areas, so there are lots of works about the matrix regression models. One special model of these models is the adaptive nuclear norm regularized trace regression, which has been proven have good…

Methodology · Statistics 2024-04-16 Pan Shang , Lingchen Kong

A low-rank transformation learning framework for subspace clustering and classification is here proposed. Many high-dimensional data, such as face images and motion sequences, approximately lie in a union of low-dimensional subspaces. The…

Computer Vision and Pattern Recognition · Computer Science 2014-03-11 Qiang Qiu , Guillermo Sapiro

Gray-box identification is prevalent in modeling physical and networked systems. However, due to the non-convex nature of the gray-box identification problem, good initial parameter estimates are crucial for a successful application. In…

Systems and Control · Computer Science 2016-11-15 Chengpu Yu , Lennart Ljung , Michel Verhaegen

The ability to identify interesting and repetitive substructures is an essential component to discovering knowledge in structural data. We describe a new version of our SUBDUE substructure discovery system based on the minimum description…

Artificial Intelligence · Computer Science 2008-02-03 D. J. Cook , L. B. Holder

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

Due to the domain discrepancy in visual domain adaptation, the performance of source model degrades when bumping into the high data density near decision boundary in target domain. A common solution is to minimize the Shannon Entropy to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Shuhao Cui , Shuhui Wang , Junbao Zhuo , Liang Li , Qingming Huang , Qi Tian

Subspace identification methods (SIMs) have proven to be very useful and numerically robust for building state-space models. While most SIMs are consistent, few if any can achieve the efficiency of the maximum likelihood estimate (MLE).…

Methodology · Statistics 2025-10-06 Jiabao He , S. Joe Qin , Håkan Hjalmarsson

The Nystr\"om method is a popular choice for finding a low-rank approximation to a symmetric positive semi-definite matrix. The method can fail when applied to symmetric indefinite matrices, for which the error can be unboundedly large. In…

Numerical Analysis · Mathematics 2023-10-10 Taejun Park , Yuji Nakatsukasa

Growing number of network devices and services have led to increasing demand for protective measures as hackers launch attacks to paralyze or steal information from victim systems. Intrusion Detection System (IDS) is one of the essential…

Machine Learning · Computer Science 2019-11-27 Hyeokmin Gwon , Chungjun Lee , Rakun Keum , Heeyoul Choi

We study the problem of finding structured low-rank matrices using nuclear norm regularization where the structure is encoded by a linear map. In contrast to most known approaches for linearly structured rank minimization, we do not (a) use…

Systems and Control · Computer Science 2015-09-09 Adams Wei Yu , Wanli Ma , Yaoliang Yu , Jaime G. Carbonell , Suvrit Sra

In a direct data-driven approach, this paper studies the {\em property identification(ID)} problem to analyze whether an unknown linear system has a property of interest, e.g., stabilizability and structural properties. In sharp contrast to…

Systems and Control · Electrical Eng. & Systems 2022-08-30 Shubo Kang , Keyou You

Second-order optimizers hold intriguing potential for deep learning, but suffer from increased cost and sensitivity to the non-convexity of the loss surface as compared to gradient-based approaches. We introduce a coordinate descent method…

Machine Learning · Computer Science 2020-06-19 Ravi G. Patel , Nathaniel A. Trask , Mamikon A. Gulian , Eric C. Cyr

The affine rank minimization problem consists of finding a matrix of minimum rank that satisfies a given system of linear equality constraints. Such problems have appeared in the literature of a diverse set of fields including system…

Optimization and Control · Mathematics 2010-08-09 Benjamin Recht , Maryam Fazel , Pablo A. Parrilo

The prevalence of data collected on the same set of samples from multiple sources (i.e., multi-view data) has prompted significant development of data integration methods based on low-rank matrix factorizations. These methods decompose…

Methodology · Statistics 2022-06-28 Sangyoon Yi , Raymond K. W. Wong , Irina Gaynanova

In this paper, we utilize stochastic optimization to reduce the space complexity of convex composite optimization with a nuclear norm regularizer, where the variable is a matrix of size $m \times n$. By constructing a low-rank estimate of…

Machine Learning · Computer Science 2015-12-08 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

The identification of structured state-space model has been intensively studied for a long time but still has not been adequately addressed. The main challenge is that the involved estimation problem is a non-convex (or bilinear)…

Optimization and Control · Mathematics 2016-11-15 Chengpu Yu , Michel Verhaegen , Shahar Kovalsky , Ronen Basri

Low-rank matrix regression is a fundamental problem in data science with various applications in systems and control. Nuclear norm regularization has been widely applied to solve this problem due to its convexity. However, it suffers from…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Mingzhou Yin , Matthias A. Müller

We prove new results about the robustness of well-known convex noise-blind optimization formulations for the reconstruction of low-rank matrices from underdetermined linear measurements. Our results are applicable for symmetric rank-one…

Information Theory · Computer Science 2020-10-26 Felix Krahmer , Christian Kümmerle , Oleh Melnyk

Analyzing large volumes of high-dimensional data is an issue of fundamental importance in data science, molecular simulations and beyond. Several approaches work on the assumption that the important content of a dataset belongs to a…

Machine Learning · Statistics 2018-03-20 Elena Facco , Maria d'Errico , Alex Rodriguez , Alessandro Laio