English
Related papers

Related papers: Noda Iteration for Computing Generalized Tensor Ei…

200 papers

With the increased penetrations of distributed energy resources (DERs), the need for integrated transmission and distribution system analysis (T&D) is imperative. This paper presents an integrated unbalanced T&D analysis framework using an…

Systems and Control · Electrical Eng. & Systems 2020-07-15 Gayathri Krishnamoorthy , Anamika Dubey

A tensor network is a diagram that specifies a way to "multiply" a collection of tensors together to produce another tensor (or matrix). Many existing algorithms for tensor problems (such as tensor decomposition and tensor PCA), although…

Data Structures and Algorithms · Computer Science 2018-11-05 Ankur Moitra , Alexander S. Wein

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

The aim of this paper is to develop an algebraic multigrid method to solve eigenvalue problems based on the combination of the multilevel correction scheme and the algebraic multigrid method for linear equations. Our approach uses the…

Numerical Analysis · Mathematics 2020-03-02 Ning Zhang , Xiaole Han , Yunhui He , Hehu Xie , Chun'guang You

A novel method for approximating structured singular values (also known as mu-values) is proposed and investigated. These quantities constitute an important tool in the stability analysis of uncertain linear control systems as well as in…

Numerical Analysis · Mathematics 2016-05-16 Nicola Guglielmi , Mutti-Ur Rehman , Daniel Kressner

In this paper, we introduce a tensor neural network based machine learning method for solving the elliptic partial differential equations with random coefficients in a bounded physical domain. With the help of tensor product structure, we…

Numerical Analysis · Mathematics 2024-02-02 Hongtao Chen , Rui Fu , Yifan Wang , Hehu Xie

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 William Herzberg , Daniel B. Rowe , Andreas Hauptmann , Sarah J. Hamilton

The textbook Newton's iteration is practically inapplicable on solutions of nonlinear systems with singular Jacobians. By a simple modification, a novel extension of Newton's iteration regains its local quadratic convergence toward…

Numerical Analysis · Mathematics 2024-04-22 Zhonggang Zeng

$\rm{SO}(3)$-equivariant networks are the dominant models for machine learning interatomic potentials (MLIPs). The key operation of such networks is the Clebsch-Gordan (CG) tensor product, which is computationally expensive. To accelerate…

Machine Learning · Computer Science 2026-01-14 Yuchao Lin , Cong Fu , Zachary Krueger , Haiyang Yu , Maho Nakata , Jianwen Xie , Emine Kucukbenli , Xiaofeng Qian , Shuiwang Ji

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

Statistical Mechanics · Physics 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

We consider the problem of learning mixtures of generalized linear models (GLM) which arise in classification and regression problems. Typical learning approaches such as expectation maximization (EM) or variational Bayes can get stuck in…

Machine Learning · Computer Science 2016-01-14 Hanie Sedghi , Majid Janzamin , Anima Anandkumar

In this letter, we introduce a new generalized linearizing transformation (GLT) for second order nonlinear ordinary differential equations (SNODEs). The well known invertible point (IPT) and non-point transformations (NPT) can be derived as…

Exactly Solvable and Integrable Systems · Physics 2009-11-11 V. K. Chandrasekar , M. Senthilvelan , M. Lakshmanan

In this paper, we first describe a matricial Newton-type algorithm designed to solve the multivariable spectrum approximation problem. We then prove its global convergence. Finally, we apply this approximation procedure to multivariate…

Optimization and Control · Mathematics 2008-09-30 Federico Ramponi , Augusto Ferrante , Michele Pavon

Recently Ahmadi et al. (2021) and Tagliaferro (2022) proposed some iterative methods for the numerical solution of linear systems which, under the classical hypothesis of strict diagonal dominance, typically converge faster than the Jacobi…

Numerical Analysis · Mathematics 2024-04-11 Paolo Novati , Fulvio Tagliaferro , Marino Zennaro

This paper aims at the efficient numerical solution of stochastic eigenvalue problems. Such problems often lead to prohibitively high dimensional systems with tensor product structure when discretized with the stochastic Galerkin method.…

Numerical Analysis · Mathematics 2018-09-28 Peter Benner , Akwum Onwunta , Martin Stoll

Tensor networks (TNs) have been gaining interest as multiway data analysis tools owing to their ability to tackle the curse of dimensionality and to represent tensors as smaller-scale interconnections of their intrinsic features. However,…

Signal Processing · Electrical Eng. & Systems 2017-11-03 Giuseppe G. Calvi , Ilia Kisil , Danilo P. Mandic

This paper proposes a Newton-type method to solve numerically the eigenproblem of several diagonalizable matrices, which pairwise commute. A classical result states that these matrices are simultaneously diagonalizable. From a suitable…

Numerical Analysis · Mathematics 2022-11-07 Rima Khouja , Bernard Mourrain , Jean-Claude Yakoubsohn

In this work, we explore the ability of NN (Neural Networks) to serve as a tool for finding eigen-pairs of ordinary differential equations. The question we aime to address is whether, given a self-adjoint operator, we can learn what are the…

Machine Learning · Computer Science 2020-07-21 Ido Ben-Shaul , Leah Bar , Nir Sochen

Low-rank recovery builds upon ideas from the theory of compressive sensing, which predicts that sparse signals can be accurately reconstructed from incomplete measurements. Iterative thresholding-type algorithms-particularly the normalized…

Machine Learning · Computer Science 2025-07-08 Li Li , Yuneng Liang , Kaijie Zheng , Jian Lu

We present two algorithms to initialize layers of tensorized neural networks and general tensor network algorithms using partial computations of their Frobenius norms and positive lineal entrywise sums, depending on the type of tensor…

Machine Learning · Computer Science 2026-05-04 Alejandro Mata Ali , Iñigo Perez Delgado , Marina Ristol Roura , Aitor Moreno Fdez. de Leceta