English
Related papers

Related papers: A research framework for writing differentiable PD…

200 papers

Fast, gradient-based structural optimization has long been limited to a highly restricted subset of problems -- namely, density-based compliance minimization -- for which gradients can be analytically derived. For other objective functions,…

Computational Engineering, Finance, and Science · Computer Science 2024-09-17 Keith J. Lee , Yijiang Huang , Caitlin T. Mueller

Learning solution operators for differential equations with neural networks has shown great potential in scientific computing, but ensuring their stability under input perturbations remains a critical challenge. This paper presents a robust…

Machine Learning · Computer Science 2026-01-13 Chutian Huang , Chang Ma , Kaibo Wang , Yang Xiang

Differentiable simulators continue to push the state of the art across a range of domains including computational physics, robotics, and machine learning. Their main value is the ability to compute gradients of physical processes, which…

Robotics · Computer Science 2024-07-09 Rhys Newbury , Jack Collins , Kerry He , Jiahe Pan , Ingmar Posner , David Howard , Akansel Cosgun

A kernel-based approach for the learning of the solution operator of general nonhomogeneous partial differential equations (PDEs) is proposed. The method incorporates physical priors, typically encoded through the PDE operator, into a…

Numerical Analysis · Mathematics 2026-05-12 Jianyu Hu , Juan-Pablo Ortega

Optimization of beamlines and lattices is a common problem in accelerator physics, which is usually solved with semi-analytical methods and numerical optimization routines. However, these are usually of the gradient-free or…

Accelerator Physics · Physics 2025-07-14 Francisco Huhn , Francesco M. Velotti

Differentiable optimization has attracted significant research interest, particularly for quadratic programming (QP). Existing approaches for differentiating the solution of a QP with respect to its defining parameters often rely on…

Machine Learning · Computer Science 2025-10-31 Connor W. Magoon , Fengyu Yang , Noam Aigerman , Shahar Z. Kovalsky

A novel model was recently proposed by Schulze-Forster et al. in [1] for unsupervised music source separation. This model allows to tackle some of the major shortcomings of existing source separation frameworks. Specifically, it eliminates…

Signal Processing · Electrical Eng. & Systems 2024-01-31 Gael Richard , Pierre Chouteau , Bernardo Torres

Highly accurate simulations of problems including second derivatives on complex geometries are of primary interest in academia and industry. Consider for example the Navier-Stokes equations or wave propagation problems of acoustic or…

Numerical Analysis · Mathematics 2024-04-16 Gustav Eriksson

Compatible schemes localize degrees of freedom according to the physical nature of the underlying fields and operate a clear distinction between topological laws and closure relations. For elliptic problems, the cornerstone in the scheme…

Numerical Analysis · Mathematics 2019-02-20 Jerome Bonelle , Alexandre Ern

Sparse tensors are prevalent in many data-intensive applications, yet existing differentiable programming frameworks are tailored towards dense tensors. This presents a significant challenge for efficiently computing gradients through…

Programming Languages · Computer Science 2023-03-14 Amir Shaikhha , Mathieu Huot , Shideh Hashemian

The Sinkhorn operator has recently experienced a surge of popularity in computer vision and related fields. One major reason is its ease of integration into deep learning frameworks. To allow for an efficient training of respective neural…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Marvin Eisenberger , Aysim Toker , Laura Leal-Taixé , Florian Bernard , Daniel Cremers

The development of deep learning software libraries enabled significant progress in the field by allowing users to focus on modeling, while letting the library to take care of the tedious and time-consuming task of optimizing execution for…

Machine Learning · Computer Science 2023-10-17 Miloš Stanojević , Laurent Sartran

Spectral discretizations of fractional derivative operators are examined, where the approximation basis is related to the set of Jacobi polynomials. The pseudo-spectral method is implemented by assuming that the grid, used to represent the…

Numerical Analysis · Mathematics 2018-03-29 Lorella Fatone , Daniele Funaro

We introduce the Autoregressive PDE Emulator Benchmark (APEBench), a comprehensive benchmark suite to evaluate autoregressive neural emulators for solving partial differential equations. APEBench is based on JAX and provides a seamlessly…

Machine Learning · Computer Science 2024-11-04 Felix Koehler , Simon Niedermayr , Rüdiger Westermann , Nils Thuerey

Differential operators are widely used in geometry processing for problem domains like spectral shape analysis, data interpolation, parametrization and mapping, and meshing. In addition to the ubiquitous cotangent Laplacian, anisotropic…

Graphics · Computer Science 2021-06-29 David R. Palmer , Oded Stein , Justin Solomon

The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that…

Optimization and Control · Mathematics 2024-03-05 Lucas Fuentes Valenzuela , Robin Brown , Marco Pavone

Solving complex fluid-structure interaction (FSI) problems, which are described by nonlinear partial differential equations, is crucial in various scientific and engineering applications. Traditional computational fluid dynamics based…

Computational Physics · Physics 2023-03-24 Xiantao Fan , Jian-Xun Wang

The paradigm of differentiable programming has significantly enhanced the scope of machine learning via the judicious use of gradient-based optimization. However, standard differentiable programming methods (such as autodiff) typically…

The recent advancements in artificial intelligence (AI), with the release of several large models having only query access, make a strong case for explainability of deep models in a post-hoc gradient free manner. In this paper, we propose a…

Artificial Intelligence · Computer Science 2024-09-18 Debarpan Bhattacharya , Amir H. Poorjam , Deepak Mittal , Sriram Ganapathy

In the present work, advanced spatial and temporal discretization techniques are tailored to hyperelastic physics-augmented neural networks, i.e., neural network based constitutive models which fulfill all relevant mechanical conditions of…

Computational Engineering, Finance, and Science · Computer Science 2023-06-19 Marlon Franke , Dominik K. Klein , Oliver Weeger , Peter Betsch