English
Related papers

Related papers: PyTorchDIA: A flexible, GPU-accelerated numerical …

200 papers

We introduce PyTorch Geometric, a library for deep learning on irregularly structured input data such as graphs, point clouds and manifolds, built upon PyTorch. In addition to general graph data structures and processing methods, it…

Machine Learning · Computer Science 2019-04-26 Matthias Fey , Jan Eric Lenssen

Differential Evolution (DE) is a highly successful population based global optimisation algorithm, commonly used for solving numerical optimisation problems. However, as the complexity of the objective function increases, the wall-clock…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Dylan Janssen , Wayne Pullan , Alan Wee-Chung Liew

The paper proposes FireANTs, a multi-scale Adaptive Riemannian Optimization algorithm for dense diffeomorphic image matching. Existing state-of-the-art methods for diffeomorphic image matching are slow due to inefficient implementations and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Rohit Jena , Pratik Chaudhari , James C. Gee

Training modern deep learning models is increasingly constrained by GPU memory and compute limits. While Randomized Numerical Linear Algebra (RandNLA) offers proven techniques to compress these models, the lack of a unified,…

Machine Learning · Computer Science 2026-01-23 Fahd Seddik , Abdulrahman Elbedewy , Gaser Sami , Mohamed Abdelmoniem , Yahia Zakaria

Machine learning has emerged as a powerful solution to the modern challenges in accelerator physics. However, the limited availability of beam time, the computational cost of simulations, and the high-dimensionality of optimisation problems…

Accelerator Physics · Physics 2024-05-30 Jan Kaiser , Chenran Xu , Annika Eichler , Andrea Santamaria Garcia

We introduce a general formulation for automatic differentiation through direct form filters, yielding a closed-form backpropagation that includes initial condition gradients. The result is a single expression that can represent both the…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Chin-Yun Yu , György Fazekas

Deep Neural Networks have now achieved state-of-the-art results in a wide range of tasks including image classification, object detection and so on. However, they are both computation consuming and memory intensive, making them difficult to…

Machine Learning · Computer Science 2019-11-13 Xianda Xu , Marco Pedersoli

With the increasing adoption of graph neural networks (GNNs) in the machine learning community, GPUs have become an essential tool to accelerate GNN training. However, training GNNs on very large graphs that do not fit in GPU memory is…

Machine Learning · Computer Science 2021-01-21 Seung Won Min , Kun Wu , Sitao Huang , Mert Hidayetoğlu , Jinjun Xiong , Eiman Ebrahimi , Deming Chen , Wen-mei Hwu

While there have been many studies on hardware acceleration for deep learning on images, there has been a rather limited focus on accelerating deep learning applications involving graphs. The unique characteristics of graphs, such as the…

Machine Learning · Computer Science 2021-11-12 Atefeh Sohrabizadeh , Yuze Chi , Jason Cong

Recent work on Renyi Differential Privacy has shown the feasibility of applying differential privacy to deep learning tasks. Despite their promise, however, differentially private deep networks often lag far behind their non-private…

Machine Learning · Computer Science 2020-09-08 Jaewoo Lee , Daniel Kifer

Heterogeneous graph neural networks (HGNNs) are essential for capturing the structure and semantic information in heterogeneous graphs. However, existing GPU-based solutions, such as PyTorch Geometric, suffer from low GPU utilization due to…

Hardware Architecture · Computer Science 2024-08-19 Meng Wu , Jingkai Qiu , Mingyu Yan , Wenming Li , Yang Zhang , Zhimin Zhang , Xiaochun Ye , Dongrui Fan

Spatial Branch and Bound (B&B) algorithms are widely used for solving nonconvex problems to global optimality, yet they remain computationally expensive. Though some works have been carried out to speed up B&B via CPU parallelization, GPU…

Optimization and Control · Mathematics 2025-07-29 Hongzhen Zhang , Tim Kerkenhoff , Neil Kichler , Manuel Dahmen , Alexander Mitsos , Uwe Naumann , Dominik Bongartz

FPGAs provide a flexible and efficient platform to accelerate rapidly-changing algorithms for computer vision. The majority of existing work focuses on accelerating image classification, while other fundamental vision problems, including…

Image and Video Processing · Electrical Eng. & Systems 2020-03-25 Qijing Huang , Dequan Wang , Yizhao Gao , Yaohui Cai , Zhen Dong , Bichen Wu , Kurt Keutzer , John Wawrzynek

We present a selection of methods for automatically constructing an optimal kernel model for difference image analysis which require very few external parameters to control the kernel design. Each method consists of two components; namely,…

Instrumentation and Methods for Astrophysics · Physics 2016-01-27 D. M. Bramich , Keith Horne , K. A. Alsubai , E. Bachelet , D. Mislis , N. Parley

Searching for sources of electromagnetic emission in spectral-line radio astronomy interferometric data is a computationally intensive process. Parallel programming techniques and High Performance Computing hardware may be used to improve…

Instrumentation and Methods for Astrophysics · Physics 2015-07-20 Stefan Westerlund , Christopher Harris

We discuss several strategies to implement Dykstra's projection algorithm on NVIDIA's compute unified device architecture (CUDA). Dykstra's algorithm is the central step in and the computationally most expensive part of statistical…

Computational Physics · Physics 2015-03-13 Jan Lebert , Lutz Künneke , Johannes Hagemann , Stephan C. Kramer

In this paper we present a review of the Kornia differentiable data augmentation (DDA) module for both for spatial (2D) and volumetric (3D) tensors. This module leverages differentiable computer vision solutions from Kornia, with an aim of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Jian Shi , Edgar Riba , Dmytro Mishkin , Francesc Moreno , Anguelos Nicolaou

Analyzing gigapixel images is recognized as computationally demanding. In this paper, we introduce PyramidAI, a technique for analyzing gigapixel images with reduced computational cost. The proposed approach adopts a gradual analysis of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Marie Reinbigler , Rishi Sharma , Rafael Pires , Elisabeth Brunet , Anne-Marie Kermarrec , Catalin Fetita

This research proposes a practical method for detecting featureless objects by using image alignment approach with a robust similarity measure in industrial applications. This similarity measure is robust against occlusion, illumination…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Trung-Son Le , Chyi-Yeu Lin

This work presents a GPU thread mapping approach that allows doing fast parallel stencil-like computations on discrete fractals using their compact representation. The intuition behind is to employ two GPU tensor-core accelerated thread…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Felipe A. Quezada , Cristóbal A. Navarro