English
Related papers

Related papers: Systematic Review of Newton-Schulz Iterations with…

200 papers

Fast convergent, accurate, computationally efficient, parallelizable, and robust matrix inversion and parameter estimation algorithms are required in many time-critical and accuracy-critical applications such as system identification,…

Optimization and Control · Mathematics 2020-08-27 Alexander Stotsky

Most existing work uses dual decomposition and subgradient methods to solve Network Utility Maximization (NUM) problems in a distributed manner, which suffer from slow rate of convergence properties. This work develops an alternative…

Optimization and Control · Mathematics 2015-03-17 Ermin Wei , Asuman Ozdaglar , Ali Jadbabaie

Power flow (PF) calculations are fundamental to power system analysis to ensure stable and reliable grid operation. The Newton-Raphson (NR) method is commonly used for PF analysis due to its rapid convergence when initialized properly.…

The Newton-Schulz (NS) iteration has become a key technique for orthogonalization in optimizers such as Muon and for optimization on the Stiefel manifold. Despite its effectiveness, the conventional NS iteration incurs significant…

Machine Learning · Computer Science 2026-03-23 Chen Hu , Qianxi Zhao , Xiaochen Yuan , Hong Zhang , Ding Yuan , Yanbin Wu , Xiying Li

This paper considers the problem of simultaneous sensor fault detection, isolation, and networked estimation of linear full-rank dynamical systems. The proposed networked estimation is a variant of single time-scale protocol and is based on…

Systems and Control · Electrical Eng. & Systems 2020-09-28 Mohammadreza Doostmohammadian , Nader Meskin

In this paper, two new efficient algorithms for calculating the sign function of the large-scale sparse matrix are proposed by combining filtering algorithm with Newton method and Newton Schultz method respectively. Through the theoretical…

Numerical Analysis · Mathematics 2022-10-10 Feng Wu , Keqi Ye , Li Zhu , Yueling Zhao , Jiqiang Hu , Wanxie Zhong

LU and Cholesky matrix factorization algorithms are core subroutines used to solve systems of linear equations (SLEs) encountered while solving an optimization problem. Standard factorization algorithms are highly efficient but remain…

Numerical Analysis · Mathematics 2022-07-25 Adolfo R. Escobedo

Nowadays, the availability of large-scale data in disparate application domains urges the deployment of sophisticated tools for extracting valuable knowledge out of this huge bulk of information. In that vein, low-rank representations…

Machine Learning · Computer Science 2017-10-06 Paris V. Giampouras , Athanasios A. Rontogiannis , Konstantinos D. Koutroumbas

This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the…

Optimization and Control · Mathematics 2024-06-27 Hao Wang , Ye Wang , Xiangyu Yang

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

In this paper, we introduce and formalize a rank-one partitioning learning paradigm that unifies partitioning methods that proceed by summarizing a data set using a single vector that is further used to derive the final clustering…

Machine Learning · Computer Science 2020-09-02 Charlotte Laclau , Franck Iutzeler , Ievgen Redko

A new variant of Newton's method for empirical risk minimization is studied, where at each iteration of the optimization algorithm, the gradient and Hessian of the objective function are replaced by robust estimators taken from existing…

Machine Learning · Statistics 2023-07-18 Eirini Ioannou , Muni Sreenivas Pydi , Po-Ling Loh

Low-rank representation learning has emerged as a powerful tool for recovering missing values in power load data due to its ability to exploit the inherent low-dimensional structures of spatiotemporal measurements. Among various techniques,…

Machine Learning · Computer Science 2025-06-24 Yan Xia , Hao Feng , Hongwei Sun , Junjie Wang , Qicong Hu

Matrix factor model is drawing growing attention for simultaneous two-way dimension reduction of well-structured matrix-valued observations. This paper focuses on robust statistical inference for matrix factor model in the ``diverging…

Methodology · Statistics 2023-06-07 Yong He , Xin-Bing Kong , Dong Liu , Ran Zhao

The problem of missing data has been persistent for a long time and poses a major obstacle in machine learning and statistical data analysis. Past works in this field have tried using various data imputation techniques to fill in the…

Machine Learning · Computer Science 2020-11-20 Rishab Khincha , Utkarsh Sarawgi , Wazeer Zulfikar , Pattie Maes

Diffusion on complex networks is a convenient framework to simulate a great variety of transport systems. The effects of failures in the network links may be used to cascade phenomena or the congestion formation in the system. A real time…

Physics and Society · Physics 2026-05-26 Edoardo Rolando , Armando Bazzani

This paper addresses the challenges of fault prediction and delayed response in distributed systems by proposing an intelligent prediction method based on temporal feature learning. The method takes multi-dimensional performance metric…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Yang Wang , Wenxuan Zhu , Xuehui Quan , Heyi Wang , Chang Liu , Qiyuan Wu

Data assisted reconstruction algorithms, incorporating trained neural networks, are a novel paradigm for solving inverse problems. One approach is to first apply a classical reconstruction method and then apply a neural network to improve…

Numerical Analysis · Mathematics 2020-03-26 Yoeri E. Boink , Markus Haltmeier , Sean Holman , Johannes Schwab

To enhance the intelligence degree in operation and maintenance, a novel method for fault detection in power grids is proposed. The proposed GNN-based approach first identifies fault nodes through a specialized feature extraction method…

Machine Learning · Computer Science 2024-01-30 Hao Pei , Si Lin , Chuanfu Li , Che Wang , Haoming Chen , Sizhe Li

Factor Analysis is an effective way of dimensionality reduction achieved by revealing the low-rank plus sparse structure of the data covariance matrix. The corresponding model identification task is often formulated as an optimization…

Optimization and Control · Mathematics 2025-04-03 Linyang Wang , Wanquan Liu , Bin Zhu
‹ Prev 1 2 3 10 Next ›