English
Related papers

Related papers: A universal preconditioner for simulating condense…

200 papers

We develop a parallel-in-time multigrid preconditioner for augmented systems. These saddle-point systems are foundational to numerical optimization. Our preconditioner, when paired with a suitable optimization method, accelerates the…

Optimization and Control · Mathematics 2025-12-08 Radoslav Vuchkov , Eric C. Cyr , Aurya Javeed , Denis Ridzal

Layer-wise preconditioning methods are a family of memory-efficient optimization algorithms that introduce preconditioners per axis of each layer's weight tensors. These methods have seen a recent resurgence, demonstrating impressive…

Machine Learning · Computer Science 2025-02-05 Thomas T. Zhang , Behrad Moniri , Ansh Nagwekar , Faraz Rahman , Anton Xue , Hamed Hassani , Nikolai Matni

We provide a noisy intermediate-scale quantum framework for simulating the dynamics of open quantum systems, generalized time evolution, non-linear differential equations and Gibbs state preparation. Our algorithm does not require any…

Quantum Physics · Physics 2023-01-31 Tobias Haug , Kishor Bharti

In recent years, many accelerators have been proposed to efficiently process sparse tensor algebra applications (e.g., sparse neural networks). However, these proposals are single points in a large and diverse design space. The lack of…

Hardware Architecture · Computer Science 2023-01-11 Yannan Nellie Wu , Po-An Tsai , Angshuman Parashar , Vivienne Sze , Joel S. Emer

This paper introduces a preconditioned method designed to comprehensively address the saddle point system with the aim of improving convergence efficiency. In the preprocessor construction phase, a technical approach for solving the…

Numerical Analysis · Mathematics 2024-04-10 Juan Zhang , Yiyi Luo

In this paper, a class of new preconditioners based on matrix splitting are presented for generalized saddle-point linear systems, which can be viewed as further modified improvements of some recently published preconditioners. Moreover, we…

Numerical Analysis · Mathematics 2018-10-02 Zhao-Zheng Liang , Guo-Feng Zhang

Atomistic simulations have become a powerful tool in materials research due to the extremely fine spatial and temporal resolution provided by such techniques. In order to understand the fundamental principles which govern material behavior…

Materials Science · Physics 2014-08-26 Jason F. Panzarino , Timothy J. Rupert

Numerical simulation of fracture contact poromechanics is essential for various applications, including CO2 sequestration, geothermal energy production and underground gas storage. Modeling this problem accurately presents significant…

Numerical Analysis · Mathematics 2025-01-14 Yury Zabegaev , Inga Berre , Eirik Keilegavlen , Kundan Kumar

We consider a class of mathematical models describing multiphysics phenomena interacting through interfaces. On such interfaces, the traces of the fields lie (approximately) in the range of a weighted sum of two fractional differential…

Numerical Analysis · Mathematics 2022-11-08 Ana Budisa , Xiaozhe Hu , Miroslav Kuchta , Kent-Andre Mardal , Ludmil Zikatanov

Suppose we want to construct some structure on a bounded-degree graph, e.g., an almost maximum matching, and we want to decide about each edge depending only on its constant-radius neighborhood. We examine and compare the strengths of…

Combinatorics · Mathematics 2023-11-03 Endre Csóka

We study preconditioned gradient-based optimization methods where the preconditioning matrix has block-diagonal form. Such a structural constraint comes with the advantage that the update computation is block-separable and can be…

Machine Learning · Computer Science 2020-12-08 Celestine Mendler-Dünner , Aurelien Lucchi

Preconditioning of a linear system obtained from spectral discretization of time-dependent PDEs often results in a full matrix which is expensive to compute and store specially when the problem size increases. A matrix-free implementation…

Statistics Theory · Mathematics 2016-06-09 A. Ghasemi , L. K. Taylor

A new domain decomposition preconditioner is introduced for efficiently solving linear systems Ax = b with a symmetric positive definite matrix A. The particularity of the new preconditioner is that it is not necessary to have access to the…

Numerical Analysis · Mathematics 2021-06-23 Nicole Spillane

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

This paper presents the sparsifying preconditioner for the time-harmonic Maxwell's equations in the integral formulation. Following the work on sparsifying preconditioner for the Lippmann-Schwinger equation, this paper generalizes that…

Numerical Analysis · Mathematics 2018-11-14 Fei Liu , Lexing Ying

Sparsity-based methods are widely used in machine learning, statistics, and signal processing. There is now a rich class of structured sparsity approaches that expand the modeling power of the sparsity paradigm and incorporate constraints…

Data Structures and Algorithms · Computer Science 2017-12-22 Aleksander Mądry , Slobodan Mitrović , Ludwig Schmidt

In this relation I present a technique of construction and fast evaluation of a family of cubic polynomials for analytic smoothing and graphical rendering of particles trajectories for flows in a generic geometry. The principal result of…

Numerical Analysis · Mathematics 2025-10-20 Gianluca Argentini

Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

We present \code{phaser}, an open-source Python package that provides a unified interface to both conventional and gradient descent-based ptychographic algorithms. Features such as mixed-state probe, probe position correction, and…

Computational Physics · Physics 2025-07-21 Colin Gilgenbach , Menglin Zhu , James M. LeBeau

PySensors is a Python package for selecting and placing a sparse set of sensors for reconstruction and classification tasks. In this major update to PySensors, we introduce spatially constrained sensor placement capabilities, allowing users…