English
Related papers

Related papers: Efficient Forward-Mode Algorithmic Derivatives of …

200 papers

Language-based agentic systems have shown great promise in recent years, transitioning from solving small-scale research problems to being deployed in challenging real-world tasks. However, optimizing these systems often requires…

Artificial Intelligence · Computer Science 2024-12-06 Wenyi Wang , Hisham A. Alyahya , Dylan R. Ashley , Oleg Serikov , Dmitrii Khizbullin , Francesco Faccio , Jürgen Schmidhuber

The HFBTHO code implements a nuclear energy density functional solver to model the structure of atomic nuclei. HFBTHO has previously been used to calibrate energy functionals and perform sensitivity analysis by using derivative-free…

This paper presents a linear dynamical operator described in terms of a rational transfer function, endowed with a well-defined and efficient back-propagation behavior for automatic derivatives computation. The operator enables end-to-end…

Machine Learning · Computer Science 2021-04-21 Dario Piga , Marco Forgione , Manas Mejari

Markov chain Monte Carlo (MCMC) methods are fundamental to Bayesian computation, but can be computationally intensive, especially in high-dimensional settings. Push-forward generative models, such as generative adversarial networks (GANs),…

Machine Learning · Computer Science 2026-02-25 Jonathan Spence , Tobías I. Liaudat , Konstantinos Zygalakis , Marcelo Pereyra

Score-based models have recently been introduced as a richer framework to model distributions in high dimensions and are generally more suitable for generative tasks. In score-based models, a generative task is formulated using a parametric…

Machine Learning · Computer Science 2023-02-07 Harsh Mishra , Jurijs Nazarovs , Manmohan Dogra , Sathya N. Ravi

The engineering design of a particle detector is usually performed in a Computer Aided Design (CAD) program, and simulation of the detector's performance can be done with a Geant4-based program. However, transferring the detector design…

Instrumentation and Detectors · Physics 2019-08-14 Carl Vuosalo , Duncan Carlsmith , Sridhara Dasu , Kimberly Palladino

Objective: To assess the accuracy and computational performance of a stochastic differential equation (SDE)--based model for proton beam dose calculation by benchmarking against Geant4 in simplified phantom geometries. Approach: Building on…

As machine learning inferences increasingly move to edge devices, adapting to diverse computational capabilities, hardware, and memory constraints becomes more critical. Instead of relying on a pre-trained model fixed for all future…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-01 Xiangchen Li , Saeid Ghafouri , Bo Ji , Hans Vandierendonck , Deepu John , Dimitrios S. Nikolopoulos

This paper introduces a new computational framework to derive electromagnetic field derivatives with respect to multiple design parameters up to any order with the Finite-Difference Time-Domain (FDTD) technique. Specifically, only one FDTD…

Signal Processing · Electrical Eng. & Systems 2019-10-23 Kae-An Liu , Costas D. Sarris

We introduce discriminator guidance in the setting of Autoregressive Diffusion Models. The use of a discriminator to guide a diffusion process has previously been used for continuous diffusion models, and in this work we derive ways of…

Machine Learning · Computer Science 2024-09-24 Filip Ekström Kelvinius , Fredrik Lindsten

Though generative adversarial networks (GANs) areprominent models to generate realistic and crisp images,they often encounter the mode collapse problems and arehard to train, which comes from approximating the intrinsicdiscontinuous…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Dongsheng An , Yang Guo , Min Zhang , Xin Qi , Na Lei , Shing-Tung Yau , Xianfeng Gu

This paper presents our work toward correct and efficient automatic differentiation of OpenMP parallel worksharing loops in forward and reverse mode. Automatic differentiation is a method to obtain gradients of numerical programs, which are…

Mathematical Software · Computer Science 2021-11-04 Jan Hückelheim , Laurent Hascoët

With the fast development of mobile edge computing (MEC), there is an increasing demand for running complex applications on the edge. These complex applications can be represented as workflows where task dependencies are explicitly…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-25 Xuejun Li , Tianxiang Chen , Dong Yuan , Jia Xu , Xiao Liu

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

Derivatives play a critical role in computational statistics, examples being Bayesian inference using Hamiltonian Monte Carlo sampling and the training of neural networks. Automatic differentiation is a powerful tool to automate the…

Mathematical Software · Computer Science 2019-03-27 Charles C. Margossian

Neural Ordinary Differential Equations (Neural ODEs) represent a significant breakthrough in deep learning, promising to bridge the gap between machine learning and the rich theoretical frameworks developed in various mathematical fields…

Machine Learning · Computer Science 2024-09-24 Jaouad Dabounou

Customized hardware accelerators have been developed to provide improved performance and efficiency for DNN inference and training. However, the existing hardware accelerators may not always be suitable for handling various DNN models as…

Hardware Architecture · Computer Science 2021-04-07 Xiaofan Zhang , Hanchen Ye , Deming Chen

Multi-access Edge Computing (MEC) is an enabling technology to leverage new network applications, such as virtual/augmented reality, by providing faster task processing at the network edge. This is done by deploying servers closer to the…

Networking and Internet Architecture · Computer Science 2023-11-28 Gabriel F. C. de Queiroz , José F. de Rezende , Valmir C. Barbosa

A computational procedure is developed for the efficient calculation of derivatives of integrals over non-separable Gaussian-type basis functions, used for the evaluation of gradients of the total energy in quantum-mechanical simulations.…

Materials Science · Physics 2023-05-03 Jacques K. Desmarais , Alessandro De Frenza , Alessandro Erba

Learning partial differential equations' (PDEs) solution operators is an essential problem in machine learning. However, there are several challenges for learning operators in practical applications like the irregular mesh, multiple input…

Machine Learning · Computer Science 2023-06-16 Zhongkai Hao , Zhengyi Wang , Hang Su , Chengyang Ying , Yinpeng Dong , Songming Liu , Ze Cheng , Jian Song , Jun Zhu