English
Related papers

Related papers: Constrained Least Squares for Extended Complex Fac…

200 papers

In this work, inspired by the study of semidefinite programming for block-diagonalizing matrix *-algebras, we propose an algorithm that can find the algebraic structure of decoherence-free subspaces (DFS's) for a given noisy quantum…

Quantum Physics · Physics 2013-02-19 Xiaoting Wang , Mark Byrd , Kurt Jacobs

Tensor decomposition is a fundamental framework to analyze data that can be represented by multi-dimensional arrays. In practice, tensor data is often accompanied by temporal information, namely the time points when the entry values were…

Machine Learning · Computer Science 2022-07-07 Zheng Wang , Shandian Zhe

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

In this paper, we study the problem of a batch of linearly correlated image alignment, where the observed images are deformed by some unknown domain transformations, and corrupted by additive Gaussian noise and sparse noise simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Sijia Xia , Duo Qiu , Xiongjun Zhang

In this paper we provide the quantum version of the Convex Non-negative Matrix Factorization algorithm (Convex-NMF) by using the D-wave quantum annealer. More precisely, we use D-wave 2000Q to find the low rank approximation of a fixed…

Machine Learning · Statistics 2022-03-30 Ahmed Zaiou , Basarab Matei , Younès Bennani , Mohamed Hibti

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi

Non-negative matrix factorization is a basic tool for decomposing data into the feature and weight matrices under non-negativity constraints, and in practice is often solved in the alternating minimization framework. However, it is unclear…

Machine Learning · Computer Science 2017-06-14 Yuanzhi Li , Yingyu Liang

Laplace approximation (LA) and its linearized variant (LLA) enable effortless adaptation of pretrained deep neural networks to Bayesian neural networks. The generalized Gauss-Newton (GGN) approximation is typically introduced to improve…

Machine Learning · Computer Science 2022-10-25 Zhijie Deng , Feng Zhou , Jun Zhu

This paper investigates system identification problems with Gaussian inputs and quantized observations under fixed thresholds. By reinterpreting the nonlinear effects induced by quantization as the product of the unknown parameter and an…

Optimization and Control · Mathematics 2025-10-20 Xingrui Liu , Ying Wang , Yanlong Zhao

This note considers the spectral estimation problems of sparse spectral measures under unknown noise levels. The main technical tool is the eigenmatrix method for solving unstructured sparse recovery problems. When the noise level is…

Numerical Analysis · Mathematics 2025-01-09 Lexing Ying

We explore the usage of the Levenberg-Marquardt (LM) algorithm for regression (non-linear least squares) and classification (generalized Gauss-Newton methods) tasks in neural networks. We compare the performance of the LM method with other…

Machine Learning · Computer Science 2022-12-20 Omead Pooladzandi , Yiming Zhou

We present a converged algorithm for Tikhonov regularized nonnegative matrix factorization (NMF). We specially choose this regularization because it is known that Tikhonov regularized least square (LS) is the more preferable form in solving…

Machine Learning · Computer Science 2015-03-20 Andri Mirzal

This work presents a novel version of recently developed Gauss-Newton method for solving systems of nonlinear equations, based on upper bound of solution residual and quadratic regularization ideas. We obtained for such method global…

Optimization and Control · Mathematics 2021-05-04 Nikita Yudin , Alexander Gasnikov

In this paper, we consider a new variant for principal component analysis (PCA), aiming to capture the grouping and/or sparse structures of factor loadings simultaneously. To achieve these goals, we employ a non-convex truncated…

Methodology · Statistics 2022-09-14 Haiyan Jiang , Shanshan Qin , Oscar Hernan Madrid Padilla

Since their first discovery, quasars have been essential probes of the distant Universe. However, due to our limited knowledge of its nature, predicting the intrinsic quasar continua has bottlenecked their usage. Existing methods of quasar…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-24 Zechang Sun , Yuan-Sen Ting , Zheng Cai

We present a new approach for nonlocal image denoising, based around the application of an unnormalized extended Gaussian ANOVA kernel within a bilevel optimization algorithm. A critical bottleneck when solving such problems for…

Numerical Analysis · Mathematics 2025-05-14 Andrés Miniguano-Trujillo , John W. Pearson , Benjamin D. Goddard

This paper considers the problem of closed-loop identification of linear scalar systems with Gaussian process noise, where the system input is determined by a deterministic state feedback policy. The regularized least-square estimate (LSE)…

Systems and Control · Electrical Eng. & Systems 2020-03-30 Ali Reza Pedram , Takashi Tanaka

Convex optimization is the powerhouse behind the theory and practice of optimization. We introduce a quantum analogue of unconstrained convex optimization: computing the minimum eigenvalue of a Schr\"odinger operator $h = -\Delta + V $ with…

Quantum Physics · Physics 2025-11-10 Eunou Lee

We develop a factor analysis for mixed continuous and binary observed variables. To this end, we utilized a recently developed multivariate probability distribution for mixed-type random variables, the Gaussian-Grassmann distribution. In…

Methodology · Statistics 2025-12-12 Takashi Arai

The susceptibility of deep neural networks to untrustworthy predictions, including out-of-distribution (OOD) data and adversarial examples, still prevent their widespread use in safety-critical applications. Most existing methods either…

Machine Learning · Computer Science 2021-02-25 Leo Schwinn , An Nguyen , René Raab , Leon Bungert , Daniel Tenbrinck , Dario Zanca , Martin Burger , Bjoern Eskofier