English
Related papers

Related papers: Fast and General Automatic Differentiation for Fin…

200 papers

We propose a variational splitting technique for the generalized-$\alpha$ method to solve hyperbolic partial differential equations. We use tensor-product meshes to develop the splitting method, which has a computational cost that grows…

Numerical Analysis · Mathematics 2019-11-12 Pouria Behnoudfar , Quanling Deng , Victor M. Calo

We demonstrate that automatic differentiation (AD), which has become commonly available in machine learning frameworks, is an efficient way to explore ideas that lead to algorithmic improvement in multi-scale affine image registration and…

Optimization and Control · Mathematics 2025-08-05 Warin Watson , Cash Cherry , Rachelle Lang

In this paper we develop automatic shape differentiation techniques for unfitted discretisations and link these to recent advances in shape calculus for unfitted methods. We extend existing analytic shape calculus results to the case where…

Optimization and Control · Mathematics 2026-01-26 Zachary J. Wegert , Jordi Manyer , Connor Mallon , Santiago Badia , Vivien J. Challis

A \emph{data automaton} is a finite automaton equipped with variables (counters or registers) ranging over infinite data domains. A trace of a data automaton is an alternating sequence of alphabet symbols and values taken by the counters…

Logic in Computer Science · Computer Science 2015-10-22 Radu Iosif , Adam Rogalewicz , Tomas Vojnar

Finite-difference methods are a class of algorithms designed to solve black-box optimization problems by approximating a gradient of the target function on a set of directions. In black-box optimization, the non-smooth setting is…

Optimization and Control · Mathematics 2023-11-07 Marco Rando , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

A systematic digital-discrete method for obtaining continuous functions with smoothness to a certain order (C^(n)) from sample data is designed. This method is based on gradually varied functions and the classical finite difference method.…

Numerical Analysis · Mathematics 2010-10-19 Li Chen

Finite element discretizations of problems in computational physics often rely on adaptive mesh refinement (AMR) to preferentially resolve regions containing important features during simulation. However, these spatial refinement strategies…

Computational Engineering, Finance, and Science · Computer Science 2022-09-27 Corbin Foucart , Aaron Charous , Pierre F. J. Lermusiaux

Weighted logic programming, a generalization of bottom-up logic programming, is a well-suited framework for specifying dynamic programming algorithms. In this setting, proofs correspond to the algorithm's output space, such as a path…

Artificial Intelligence · Computer Science 2012-08-15 Shay B. Cohen , Robert J. Simmons , Noah A. Smith

The goal of this paper is to investigate an approach for derivative-free optimization that has not received sufficient attention in the literature and is yet one of the simplest to implement and parallelize. It consists of computing…

Optimization and Control · Mathematics 2021-02-22 Hao-Jun Michael Shi , Melody Qiming Xuan , Figen Oztoprak , Jorge Nocedal

Finite State Machine is a popular modeling notation for various systems, especially software and electronic. Test paths can be automatically generated from the system model to test such systems using a suitable algorithm. This paper…

Software Engineering · Computer Science 2022-07-26 Vaclav Rechtberger , Miroslav Bures , Bestoun S. Ahmed , Hynek Schvach

In this paper, we propose an algebraic formalization of the two important classes of dynamic programming algorithms called forward and forward-backward algorithms. They are generalized extensively in this study so that a wide range of other…

Machine Learning · Computer Science 2017-02-23 Ai Azuma , Masashi Shimbo , Yuji Matsumoto

Tools for algorithmic differentiation (AD) provide accurate derivatives of computer-implemented functions for use in, e. g., optimization and machine learning (ML). However, they often require the source code of the function to be available…

Mathematical Software · Computer Science 2022-12-29 Max Aehle , Johannes Blühdorn , Max Sagebaum , Nicolas R. Gauger

Dynamic programming (DP) is an algorithmic design paradigm for the efficient, exact solution of otherwise intractable, combinatorial problems. However, DP algorithm design is often presented in an ad-hoc manner. It is sometimes difficult to…

Data Structures and Algorithms · Computer Science 2024-05-17 Max A. Little , Xi He , Ugur Kayas

We present a hybridization technique for summation-by-parts finite difference methods with weak enforcement of interface and boundary conditions for second order, linear elliptic partial differential equations. The method is based on…

Numerical Analysis · Mathematics 2021-06-03 Jeremy E. Kozdon , Brittany A. Erickson , Lucas C. Wilcox

We introduce a mesh-type approach for tackling discrete-time, finite-horizon Markov Decision Processes (MDPs) characterized by state and action spaces that are general, encompassing both finite and infinite (yet suitably regular) subsets of…

Optimization and Control · Mathematics 2024-07-02 Denis Belomestny , John Schoenmakers

Current algorithmic approaches for piecewise affine motion estimation are based on alternating motion segmentation and estimation. We propose a new method to estimate piecewise affine motion fields directly without intermediate…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Denis Fortun , Martin Storath , Dennis Rickert , Andreas Weinmann , Michael Unser

Many problems in quantum information theory can be formulated as optimizations over the sequential outcomes of dynamical systems subject to unpredictable external influences. Such problems include many-body entanglement detection through…

Quantum Physics · Physics 2024-06-07 Mirjam Weilenmann , Costantino Budroni , Miguel Navascues

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists…

Optimization and Control · Mathematics 2025-05-28 Francesco Cordiano , Matin Jafarian , Bart De Schutter

This contribution proposes a new formulation to efficiently compute directional derivatives of order one to fourth. The formulation is based on automatic differentiation implemented with dual numbers. Directional derivatives are particular…

Numerical Analysis · Mathematics 2023-06-14 R. Peón-Escalante , K. B. Cantún-Avila , O. Carvente , A. Espinosa-Romero , F. Peñuñuri

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient…

Computational Physics · Physics 2021-04-28 Weiqiang Zhu , Kailai Xu , Eric Darve , Gregory C. Beroza