English
Related papers

Related papers: Differentiation via Logarithmic Expansions

200 papers

We consider the linear discriminant analysis problem in the high-dimensional settings. In this work, we propose PANDA(PivotAl liNear Discriminant Analysis), a tuning-insensitive method in the sense that it requires very little effort to…

Statistics Theory · Mathematics 2023-09-19 Ethan X. Fang , Yajun Mei , Yuyang Shi , Qunzhi Xu , Tuo Zhao

We perform scalable approximate inference in continuous-depth Bayesian neural networks. In this model class, uncertainty about separate weights in each layer gives hidden units that follow a stochastic differential equation. We demonstrate…

Machine Learning · Statistics 2022-02-01 Winnie Xu , Ricky T. Q. Chen , Xuechen Li , David Duvenaud

Zhang Neural Networks rely on convergent 1-step ahead finite difference formulas of which very few are known. Those which are known have been constructed in ad-hoc ways and suffer from low truncation error orders. This paper develops a…

Numerical Analysis · Mathematics 2019-04-25 Frank Uhlig

We present a numerical method for rigorous over-approximation of a reachable set of differential inclusions. The method gives high-order error bounds for single step approximations and a uniform bound on the error over the finite time…

Classical Analysis and ODEs · Mathematics 2012-06-29 Sanja Gonzalez Zivanovic , Pieter Collins

It is an established fact that a finite difference operator approximates a derivative with a fixed algebraic rate of convergence. Nevertheless, we exhibit a new finite difference operator and prove it has spectral accuracy. Its rate of…

Numerical Analysis · Mathematics 2019-07-01 Andre Nachbin

We propose a new numerical scheme for Backward Stochastic Differential Equations based on branching processes. We approximate an arbitrary (Lipschitz) driver by local polynomials and then use a Picard iteration scheme. Each step of the…

Numerical Analysis · Mathematics 2017-07-31 Bruno Bouchard , Xiaolu Tan , Xavier Warin , Yiyi Zou

We develop several deep learning algorithms for approximating families of parametric PDE solutions. The proposed algorithms approximate solutions together with their gradients, which in the context of mathematical finance means that the…

Computational Finance · Quantitative Finance 2022-01-19 Marc Sabate Vidales , David Siska , Lukasz Szpruch

Utilizing language models (LMs) without internal access is becoming an attractive paradigm in the field of NLP as many cutting-edge LMs are released through APIs and boast a massive scale. The de-facto method in this type of black-box…

Computation and Language · Computer Science 2023-06-12 Hyunsoo Cho , Youna Kim , Sang-goo Lee

Many important physical problems, such as fluid structure interaction or conjugate heat transfer, require numerical methods that compute boundary derivatives or fluxes to high accuracy. This paper proposes a novel alternative to calculating…

Numerical Analysis · Mathematics 2018-03-12 David Wells , Jeffrey Banks

In this paper we introduce a method of characteristic sets with respect to several term orderings for difference-differential polynomials. Using this technique, we obtain a method of computation of multivariate dimension polynomials of…

Commutative Algebra · Mathematics 2013-02-07 Alexander Levin

In this study, we examine numerical approximations for 2nd-order linear-nonlinear differential equations with diverse boundary conditions, followed by the residual corrections of the first approximations. We first obtain numerical results…

Numerical Analysis · Mathematics 2023-06-19 Shovan Sourav Datta Pranta , Md. Shafiqul Islam

Finite differences, as a subclass of direct methods in the calculus of variations, consist in discretizing the objective functional using appropriate approximations for derivatives that appear in the problem. This article generalizes the…

Optimization and Control · Mathematics 2013-08-09 Shakoor Pooseh , Ricardo Almeida , Delfim F. M. Torres

This paper deals with bounding the error on the estimation of quantities of interest obtained by finite element and domain decomposition methods. The proposed bounds are written in order to separate the two errors involved in the resolution…

Computational Physics · Physics 2015-02-11 Valentine Rey , Pierre Gosselet , Christian Rey

We provide improved error bounds for kernel-based numerical differentiation in terms of growth functions when kernels are of a finite smoothness, such as polyharmonic splines, thin plate splines or Wendland kernels. In contrast to existing…

Numerical Analysis · Mathematics 2025-12-24 Oleg Davydov

Black box variational inference allows researchers to easily prototype and evaluate an array of models. Recent advances allow such algorithms to scale to high dimensions. However, a central question remains: How to specify an expressive…

Machine Learning · Statistics 2016-06-01 Rajesh Ranganath , Dustin Tran , David M. Blei

We present numerical solutions for differential equations by expanding the unknown function in terms of Chebyshev polynomials and solving a system of linear equations directly for the values of the function at the extrema (or zeros) of the…

Computational Physics · Physics 2009-10-31 Bogdan Mihaila , Ioana Mihaila

We present a new numerical dissipation algorithm, which can be efficiently used in combination with centered finite-difference methods. We start from a formulation of centered finite-volume methods for Numerical Relativity, in which…

General Relativity and Quantum Cosmology · Physics 2009-11-13 Daniela Alic , Carles Bona , Carles Bona-Casas

This paper focuses on the further development of the Lie bracket approximation approach for extremum seeking systems. Classical results in this area provide extremum seeking algorithms with exponential convergence rates for quadratic-like…

Optimization and Control · Mathematics 2025-10-28 Victoria Grushkovskaya , Sameh A. Eisa

This paper introduces a scalar numerical differentiator, represented as a system of nonlinear differential equations of any high order. We derive the explicit solution for this system and demonstrate that, with a suitable choice of…

Machine Learning · Computer Science 2024-11-05 Igor Katrichek

In this paper, we provide a new and sharper bound for the Legendre coefficients of differentiable functions and then derive a new error bound of the truncated Legendre series in the uniform norm. The key idea of proof relies on integration…

Numerical Analysis · Mathematics 2018-06-18 Haiyong Wang