English
Related papers

Related papers: Locality-Aware Automatic Differentiation on the GP…

200 papers

Energy-based finite-element formulations provide a unified framework for describing complex physical systems in computational mechanics. In these energy-based methods, the governing equations can be obtained directly by considering the…

Numerical Analysis · Mathematics 2026-02-16 Mohit Pundir , Flavio Lorez , David S. Kammer

Adaptive mesh refinement (AMR) reduces computational costs in CFD by concentrating resolution where needed, but efficiently embedding complex, non-aligned geometries on GPUs remains challenging. We present a GPU-native algorithm for…

Computational Engineering, Finance, and Science · Computer Science 2026-04-28 Khodr Jaber , Ebenezer E. Essel , Pierre E. Sullivan

Online synaptic plasticity rules derived from gradient descent achieve high accuracy on a wide range of practical tasks. However, their software implementation often requires tediously hand-derived gradients or using gradient…

Neural and Evolutionary Computing · Computer Science 2025-01-22 Jamie Lohoff , Anil Kaya , Florian Assmuth , Emre Neftci

Stochastic scientific models and machine learning optimization estimators have a large number of variables; hence computing large sparse Jacobians and Hessians is important. Algorithmic differentiation (AD) greatly reduces the programming…

Mathematical Software · Computer Science 2021-11-10 Bradley M. Bell , Kasper Kristensen

We present a technique for applying (forward and) reverse-mode automatic differentiation (AD) on a non-recursive second-order functional array language that supports nested parallelism and is primarily aimed at efficient GPU execution. The…

Programming Languages · Computer Science 2022-02-22 Robert Schenck , Ola Rønning , Troels Henriksen , Cosmin E. Oancea

Adaptive Mesh Refinement (AMR) enables efficient computation of flows by providing high resolution in critical regions while allowing for coarsening in areas where fine detail is unnecessary. While early AMR software packages relied solely…

Computational Physics · Physics 2025-02-26 Khodr Jaber , Ebenezer Essel , Pierre Sullivan

We demonstrate that automatic differentiation (AD), which has become commonly available in machine learning frameworks, is an efficient way to explore ideas that lead to algorithmic improvement in multi-scale affine image registration and…

Optimization and Control · Mathematics 2025-08-05 Warin Watson , Cash Cherry , Rachelle Lang

Modeling and rendering dynamic urban driving scenes is crucial for self-driving simulation. Current high-quality methods typically rely on costly manual object tracklet annotations, while self-supervised approaches fail to capture dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiawei Xu , Kai Deng , Zexin Fan , Shenlong Wang , Jin Xie , Jian Yang

Implicit time integration is key to robustly simulating stiff materials and large deformations, but its performance is often dominated by repeatedly solving large linear systems. Adaptive coarsening can reduce this cost by concentrating…

Graphics · Computer Science 2026-05-07 Xuan Wang , Zhaofeng Luo , Minchen Li , Taku Komura , Kemeng Huang

Algorithmic differentiation (AD) allows exact computation of derivatives given only an implementation of an objective function. Although many AD tools are available, a proper and efficient implementation of AD methods is not…

Mathematical Software · Computer Science 2018-07-27 Filip Šrajer , Zuzana Kukelova , Andrew Fitzgibbon

The Mat\'ern covariance function is ubiquitous in the application of Gaussian processes to spatial statistics and beyond. Perhaps the most important reason for this is that the smoothness parameter $\nu$ gives complete control over the…

Computation · Statistics 2022-05-11 Christopher J. Geoga , Oana Marin , Michel Schanen , Michael L. Stein

Automatic Differentiation (AD) is a powerful tool that allows calculating derivatives of implemented algorithms with respect to all of their parameters up to machine precision, without the need to explicitly add any additional functions.…

Chemical Physics · Physics 2020-06-23 Teresa Tamayo-Mendoza , Christoph Kreisbeck , Roland Lindh , Alán Aspuru-Guzik

We present a GPU-native mesh adaptation procedure that incorporates a complex geometry represented with a triangle mesh within a primary Cartesian computational grid organized as a forest of octrees. A C++/CUDA program implements the…

Computational Geometry · Computer Science 2025-02-25 Khodr Jaber , Ebenezer E. Essel , Pierre E. Sullivan

We present a set of rules to guide the design of GPU algorithms. These rules are grounded on the principle of reducing waste in GPU utility to achieve good speed up. In accordance to these rules, we propose GPU algorithms for 2D…

Graphics · Computer Science 2020-07-02 Zhenghai Chen , Tiow-Seng Tan , Hong-Yang Ong

Differentiable programming, enabled by automatic differentiation (AD), provides a robust framework for gradient-based optimization in computational plasma physics. While optimization is often only used towards design, we demonstrate that it…

Plasma Physics · Physics 2026-03-13 A. S. Joglekar , A. G. R. Thomas , A. L. Milder , K. G. Miller , J. P. Palastro , D. H. Froula

Algorithmic differentiation (AD) tools allow to obtain gradient information of a continuously differentiable objective function in a computationally cheap way using the so-called backward mode. It is common practice to use the same tools…

Optimization and Control · Mathematics 2024-12-02 Lukas Baumgärtner , Franz Bethke

We present a novel approach for enhancing the resolution and geometric fidelity of 3D Gaussian Splatting (3DGS) beyond native training resolution. Current 3DGS methods are fundamentally limited by their input resolution, producing…

Graphics · Computer Science 2025-06-10 Shuja Khalid , Mohamed Ibrahim , Yang Liu

Fast, gradient-based structural optimization has long been limited to a highly restricted subset of problems -- namely, density-based compliance minimization -- for which gradients can be analytically derived. For other objective functions,…

Computational Engineering, Finance, and Science · Computer Science 2024-09-17 Keith J. Lee , Yijiang Huang , Caitlin T. Mueller

Elliptic Partial Differential Equations (PDEs) play a central role in computing the equilibrium conditions of physical problems (heat, gravitation, electrostatics, etc.). Efficient solutions to elliptic PDEs are also relevant to computer…

Graphics · Computer Science 2026-02-13 Zhiyuan Zhang , Amir Vaxman , Stefanos-Aldo Papanicolopulos , Kartic Subr

We present ASH, a modern and high-performance framework for parallel spatial hashing on GPU. Compared to existing GPU hash map implementations, ASH achieves higher performance, supports richer functionality, and requires fewer lines of code…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Wei Dong , Yixing Lao , Michael Kaess , Vladlen Koltun