English
Related papers

Related papers: Pivoted Cholesky decomposition by Cross Approximat…

200 papers

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

Recent progress in deep learning has been driven by increasingly larger models. However, their computational and energy demands have grown proportionally, creating significant barriers to their deployment and to a wider adoption of deep…

Machine Learning · Computer Science 2025-09-16 Pedro Savarese

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

We propose a novel quantum algorithm for solving linear autonomous ordinary differential equations (ODEs) using the Pad\'e approximation. For linear autonomous ODEs, the discretized solution can be represented by a product of matrix…

Quantum Physics · Physics 2025-06-18 Dekuan Dong , Yingzhou Li , Jungong Xue

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

Optimization and Control · Mathematics 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

Motivated by the need for decentralized learning, this paper aims at designing a distributed algorithm for solving nonconvex problems with general linear constraints over a multi-agent network. In the considered problem, each agent owns…

Optimization and Control · Mathematics 2022-06-23 Jiawei Zhang , Songyang Ge , Tsung-Hui Chang , Zhi-Quan Luo

Partial differential equations (PDEs) are crucial for modeling various physical phenomena such as heat transfer, fluid flow, and electromagnetic waves. In computer-aided engineering (CAE), the ability to handle fine resolutions and large…

Quantum Physics · Physics 2025-01-31 Yuki Sato , Hiroyuki Tezuka , Ruho Kondo , Naoki Yamamoto

A novel implementation of the coupled-cluster singles and doubles (CCSD) approach is presented that is specifically tailored for the treatment of large, symmetric systems. It fully exploits Abelian point-group symmetry and the use of the…

Chemical Physics · Physics 2023-12-07 Tommaso Nottoli , Jürgen Gauss , Filippo Lipparini

While the coherent potential approximation (CPA) is the prevalent method for the study of disordered electronic systems, it fails to capture non-local correlations and Anderson localization. To incorporate such effects, we extend the dual…

Strongly Correlated Electrons · Physics 2013-05-08 H. Terletska , S. -X. Yang , Z. Y. Meng , J. Moreno , M. Jarrell

Randomized algorithms provide solutions to two ubiquitous problems: (1) the distributed calculation of a principal component analysis or singular value decomposition of a highly rectangular matrix, and (2) the distributed calculation of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-09 Huamin Li , Yuval Kluger , Mark Tygert

This paper introduces an efficient sparse recovery approach for Polynomial Chaos (PC) expansions, which promotes the sparsity by breaking the dimensionality of the problem. The proposed algorithm incrementally explores sub-dimensional…

Computation · Statistics 2017-04-05 Negin Alemazkoor , Hadi Meidani

In dual decomposition, the dual to an optimization problem with a specific structure is solved in distributed fashion using (sub)gradient and recently also fast gradient methods. The traditional dual decomposition suffers from two main…

Optimization and Control · Mathematics 2014-04-08 Pontus Giselsson

If a tensor with various symmetries is properly unfolded, then the resulting matrix inherits those symmetries. As tensor computations become increasingly important it is imperative that we develop efficient structure preserving methods for…

Numerical Analysis · Computer Science 2014-12-01 Charles Van Loan , Joseph Vokt

Many neural learning algorithms require to solve large least square systems in order to obtain synaptic weights. Moore-Penrose inverse matrices allow for solving such systems, even with rank deficiency, and they provide minimum-norm vectors…

Neural and Evolutionary Computing · Computer Science 2008-12-18 Pierre Courrieu

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

In this paper, we consider a class of generalized difference-of-convex functions (DC) programming, whose objective is the difference of two convex (not necessarily smooth) functions plus a decomposable (possibly nonconvex) function with…

Optimization and Control · Mathematics 2024-09-10 Chenjian Pan , Yingxin Zhou , Hongjin He , Chen Ling

This paper presents a randomized algorithm for computing the near-optimal low-rank dynamic mode decomposition (DMD). Randomized algorithms are emerging techniques to compute low-rank matrix approximations at a fraction of the cost of…

Numerical Analysis · Mathematics 2019-11-28 N. Benjamin Erichson , Lionel Mathelin , Steven L. Brunton , J. Nathan Kutz

In this paper we analyze approximate methods for undertaking a principal components analysis (PCA) on large data sets. PCA is a classical dimension reduction method that involves the projection of the data onto the subspace spanned by the…

Machine Learning · Statistics 2017-08-16 Darren Homrighausen , Daniel J. McDonald

In this article we extend the adaptive cross approximation (ACA) method known for the efficient approximation of discretisations of integral operators to a block-adaptive version. While ACA is usually employed to assemble hierarchical…

Numerical Analysis · Mathematics 2019-05-07 M. Bauer , M. Bebendorf

The Dynamical Cluster Approximation (DCA) is modified to include disorder. The DCA incorporates non-local corrections to local approximations such as the Coherent Potential Approximation (CPA) by mapping the lattice problem with disorder,…

Disordered Systems and Neural Networks · Physics 2009-10-31 M. Jarrell , H. R. Krishnamurthy