English
Related papers

Related papers: Computing Derivatives for PETSc Adjoint Solvers us…

200 papers

Mathematical models that couple partial differential equations (PDEs) and spatially distributed ordinary differential equations (ODEs) arise in biology, medicine, chemistry and many other fields. In this paper we discuss an extension to the…

Numerical Analysis · Mathematics 2017-08-28 Patrick E. Farrell , Johan E. Hake , Simon W. Funke , Marie E. Rognes

This paper proposes a new methodology for deriving a point-based dimensionally homogeneous Jacobian, intended for performance evaluation and optimization of parallel manipulators with mixed degrees of freedom. Optimal manipulator often rely…

Robotics · Computer Science 2023-10-30 Hassen Nigatu , Doik Kim

This contribution presents an improved low-order 3D finite element formulation with hourglass stabilization using automatic differentiation (AD). Here, the former Q1STc formulation is enhanced by an approximation-free computation of the…

Computational Engineering, Finance, and Science · Computer Science 2025-02-21 Njomza Pacolli , Ahmad Awad , Jannick Kehls , Bjorn Sauren , Sven Klinkel , Stefanie Reese , Hagen Holthusen

Semidefinite programming (SDP) is a fundamental convex optimization problem with wide-ranging applications. However, solving large-scale instances remains computationally challenging due to the high cost of solving linear systems and…

Optimization and Control · Mathematics 2025-12-22 Hantao Nie , Dong An , Zaiwen Wen

Variational inequalities represent a broad class of problems, including minimization and min-max problems, commonly found in machine learning. Existing second-order and high-order methods for variational inequalities require precise…

Discretization of non-linear Poisson-Boltzmann Equation equations results in a system of non-linear equations with symmetric Jacobian. The Newton algorithm is the most useful tool for solving non-linear equations. It consists of solving a…

Mathematical Physics · Physics 2007-05-23 Sanjay Kumar Khattri

A quantum algorithm for solving the advection equation by embedding the discrete time-marching operator into Hamiltonian simulations is presented. One-dimensional advection can be simulated directly since the central finite difference…

Quantum Physics · Physics 2024-07-17 Peter Brearley , Sylvain Laizet

To increase the predictive power of a model, one needs to estimate its unknown parameters. Almost all parameter estimation techniques in ordinary differential equation models suffer from either a small convergence region or enormous…

Optimization and Control · Mathematics 2020-06-30 Ozgur Aydogmus , Ali Hakan Tor

Partial differential equations (PDEs) are crucial for modeling various physical phenomena such as heat transfer, fluid flow, and electromagnetic waves. In computer-aided engineering (CAE), the ability to handle fine resolutions and large…

Quantum Physics · Physics 2025-01-31 Yuki Sato , Hiroyuki Tezuka , Ruho Kondo , Naoki Yamamoto

Differential Equations are among the most important Mathematical tools used in creating models in the science, engineering, economics, mathematics, physics, aeronautics, astronomy, dynamics, biology, chemistry, medicine, environmental…

History and Overview · Mathematics 2020-12-15 Byakatonda Denis

Partial Differential Equations (PDEs) are fundamental tools for modeling physical phenomena, yet most PDEs of practical interest cannot be solved analytically and require numerical approximations. The feasibility of such numerical methods,…

Numerical Analysis · Mathematics 2025-12-03 Juan Esteban Suarez Cardona , Holger Boche , Gitta Kutyniok

We introduce efficient differentially private (DP) algorithms for several linear algebraic tasks, including solving linear equalities over arbitrary fields, linear inequalities over the reals, and computing affine spans and convex hulls. As…

Data Structures and Algorithms · Computer Science 2024-11-06 Haim Kaplan , Yishay Mansour , Shay Moran , Uri Stemmer , Nitzan Tur

This paper introduces a sparse matrix discrete interpolation method to effectively compute matrix approximations in the reduced order modeling framework. The sparse algorithm developed herein relies on the discrete empirical interpolation…

Numerical Analysis · Mathematics 2015-06-16 Răzvan Ştefănescu , Adrian Sandu

Approximate Bayesian computation (ABC) using a sequential Monte Carlo method provides a comprehensive platform for parameter estimation, model selection and sensitivity analysis in differential equations. However, this method, like other…

Machine Learning · Statistics 2015-07-21 Sanmitra Ghosh , Srinandan Dasmahapatra , Koushik Maharatna

Computing the Jacobian of the solution of an optimization problem is a central problem in machine learning, with applications in hyperparameter optimization, meta-learning, optimization as a layer, and dataset distillation, to name a few.…

Optimization and Control · Mathematics 2023-08-28 Damien Scieur , Quentin Bertrand , Gauthier Gidel , Fabian Pedregosa

Considered herein is a modified Newton method for the numerical solution of nonlinear equations where the Jacobian is approximated using a complex-step derivative approximation. We show that this method converges for sufficiently small…

Numerical Analysis · Mathematics 2024-10-03 Dimitrios Mitsotakis

We consider a proximal operator given by a quadratic function subject to bound constraints and give an optimization algorithm using the alternating direction method of multipliers (ADMM). The algorithm is particularly efficient to solve a…

Optimization and Control · Mathematics 2014-12-31 Miguel Á. Carreira-Perpiñán

From implicit differentiation to probabilistic modeling, Jacobian and Hessian matrices have many potential use cases in Machine Learning (ML), but they are viewed as computationally prohibitive. Fortunately, these matrices often exhibit…

Machine Learning · Computer Science 2025-06-12 Adrian Hill , Guillaume Dalle

The efficient computation of Jacobians represents a fundamental challenge in computational science and engineering. Large-scale modular numerical simulation programs can be regarded as sequences of evaluations of in our case differentiable…

Machine Learning · Computer Science 2024-06-19 Uwe Naumann

Derivatives of differential equation solutions are commonly for parameter estimation, fitting neural differential equations, and as model diagnostics. However, with a litany of choices and a Cartesian product of potential methods, it can be…

Numerical Analysis · Computer Science 2021-07-21 Yingbo Ma , Vaibhav Dixit , Mike Innes , Xingjian Guo , Christopher Rackauckas