English
Related papers

Related papers: Multithreaded Filtering Preconditioner for Diffusi…

200 papers

Topology optimization for large scale problems continues to be a computational challenge. Several works exist in the literature to address this topic, and all make use of iterative solvers to handle the linear system arising from the Finite…

Numerical Analysis · Mathematics 2020-10-21 Darin Peetz , Ahmed Elbanna

Recent advances in diffusion models have driven remarkable progress in image generation. However, the generation process remains computationally intensive, and users often need to iteratively refine prompts to achieve the desired results,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yi Wei , Shunpu Tang , Liang Zhao , Qiangian Yang

Neural networks have proven to be extremely powerful tools for modern artificial intelligence applications, but computational and storage complexity remain limiting factors. This paper presents two compatible contributions towards reducing…

Machine Learning · Computer Science 2024-10-30 Sourya Dey , Kuan-Wen Huang , Peter A. Beerel , Keith M. Chugg

We present a matrix-free GPU multigrid preconditioner with algebraically consistent coarsening for solving Poisson equations on adaptive octree grids with irregular domains. Within uniform-resolution regions, the coarsening satisfies the…

Numerical Analysis · Mathematics 2026-04-22 Mengdi Wang , Yuchen Sun , Bo Zhu

In this paper, we present a data-driven approach to iteratively solve the discrete heterogeneous Helmholtz equation at high wavenumbers. In our approach, we combine classical iterative solvers with convolutional neural networks (CNNs) to…

Numerical Analysis · Mathematics 2022-03-22 Yael Azulay , Eran Treister

Neural networks have achieved remarkable performance across a wide range of tasks, yet they remain susceptible to adversarial perturbations, which pose significant risks in safety-critical applications. With the rise of multimodality,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Xinxin Liu , Zhongliang Guo , Siyuan Huang , Chun Pong Lau

Preconditioning is at the core of modern many-fermion Monte Carlo algorithms, such as Hybrid Monte Carlo, where the repeated solution of a linear problem involving an ill-conditioned matrix is needed. We report on a performance comparison…

High Energy Physics - Lattice · Physics 2010-08-24 Timour Ten , Joaquín E. Drut , Timo A. Lähde

Diffusion Transformers have recently demonstrated unprecedented generative capabilities for various tasks. The encouraging results, however, come with the cost of slow inference, since each denoising step requires inference on a transformer…

Machine Learning · Computer Science 2024-11-19 Xinyin Ma , Gongfan Fang , Michael Bi Mi , Xinchao Wang

In this paper, we consider flow simulation in highly heterogeneous media that has many practical applications in industry. To enhance mass conservation, we write the elliptic problem in a mixed formulation and introduce a robust two-grid…

Numerical Analysis · Mathematics 2019-05-22 Yanfang Yang , Shubin Fu , Eric T. Chung

Graphics Processing Units (GPUs) are high performance co-processors originally intended to improve the use and quality of computer graphics applications. Once, researchers and practitioners noticed the potential of using GPU for general…

Numerical Analysis · Computer Science 2016-07-12 K. Parand , Saeed Zafarvahedian , Sayyed A. Hossayni

Despite hundreds of papers on preconditioned linear systems of equations, there remains a significant lack of comprehensive performance benchmarks comparing various preconditioners for solving symmetric positive definite (SPD) systems. In…

Numerical Analysis · Mathematics 2025-05-28 Marc A. Tunnell , David F. Gleich

The growing memory footprints of cloud and big data applications mean that data center CPUs can spend significant time waiting for memory. An attractive approach to improving performance in such centralized compute settings is to employ…

Hardware Architecture · Computer Science 2020-09-02 Karthik Sankaranarayanan , Chit-Kwan Lin , Gautham Chinya

Contraction Hierarchies is a successful speedup-technique to Dijkstra's seminal shortest path algorithm that has a convenient trade-off between preprocessing and query times. We investigate a shared-memory parallel implementation that uses…

Data Structures and Algorithms · Computer Science 2012-08-14 Dennis Luxen , Dennis Schieferdecker

We present an efficient preconditioner for linear problems $A x=y$. It guarantees monotonic convergence of the memory-efficient fixed-point iteration for all accretive systems of the form $A = L + V$, where $L$ is an approximation of $A$,…

Numerical Analysis · Mathematics 2023-10-02 Tom Vettenburg , Ivo M. Vellekoop

A scalable algorithm for solving compact banded linear systems on distributed memory architectures is presented. The proposed method factorizes the original system into two levels of memory hierarchies, and solves it using parallel cyclic…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-05 Hang Song , Kristen V. Matsuno , Jacob R. West , Akshay Subramaniam , Aditya S. Ghate , Sanjiva K. Lele

We consider a nonlinear mixed-dimensional model for simulating gas transport in shale formation. The mathematical model consists of a coupled system of nonlinear equations, where flow within fractures is represented using a…

Numerical Analysis · Mathematics 2025-08-19 Maria Vasilyeva , Ben S. Southworth , Shubin Fu

Mixed-dimensional partial differential equations (PDEs) are characterized by coupled operators defined on domains of varying dimensions and pose significant computational challenges due to their inherent ill-conditioning. Moreover, the…

Numerical Analysis · Mathematics 2025-05-14 Nunzio Dimola , Nicola Rares Franco , Paolo Zunino

Development of highly scalable and robust algorithms for large-scale CFD simulations has been identified as one of the key ingredients to achieve NASA's CFD Vision 2030 goals. In order to improve simulation capability and to effectively…

Numerical Analysis · Mathematics 2021-01-07 Zan Xu , Léopold Cambier , Juan J. Alonso , Eric Darve

We develop a matrix-free Full Approximation Storage (FAS) multigrid solver based on staggered finite differences and implemented on GPU in MATLAB. To enhance performance, intermediate variables are reused, and an X-shape Multi-Color…

Numerical Analysis · Mathematics 2025-10-14 Jiale Meng , Shuqi Tang , Steven M. Wise , Zhenlin Guo

Deep neural networks are capable of modelling highly non-linear functions by capturing different levels of abstraction of data hierarchically. While training deep networks, first the system is initialized near a good optimum by greedy…

Machine Learning · Computer Science 2016-03-10 Anirban Santara , Debapriya Maji , DP Tejas , Pabitra Mitra , Arobinda Gupta