English
Related papers

Related papers: Asymptotic Expansion as Prior Knowledge in Deep Le…

200 papers

Asymptotic expansions are given for large values of $n$ of the generalized Bernoulli polynomials $B_n^\mu(z)$ and Euler polynomials $E_n^\mu(z)$. In a previous paper L\'opez and Temme (1999) these polynomials have been considered for large…

Classical Analysis and ODEs · Mathematics 2009-09-18 Jose Luis Lopez , Nico M. Temme

Understanding the asymptotic behavior of wide networks is of considerable interest. In this work, we present a general method for analyzing this large width behavior. The method is an adaptation of Feynman diagrams, a standard tool for…

Machine Learning · Computer Science 2019-09-26 Ethan Dyer , Guy Gur-Ari

In this paper we show how to accelerate randomized coordinate descent methods and achieve faster convergence rates without paying per-iteration costs in asymptotic running time. In particular, we show how to generalize and efficiently…

Data Structures and Algorithms · Computer Science 2013-05-09 Yin Tat Lee , Aaron Sidford

A type of discrete Boltzmann model for simulating shallow water flows is derived by using the Hermite expansion approach. Through analytical analysis, we study the impact of truncating distribution function and discretizing particle…

Fluid Dynamics · Physics 2018-07-16 Jianping Meng , Xiao-Jun Gu , David R Emerson , Yong Peng , Jianmin Zhang

We consider the asymptotic method designed by F. Olver [Olver, 1974] for linear differential equations of the second order containing a large (asymptotic) parameter $\Lambda$: $x^my"-\Lambda^2y=g(x)y$, with $m\in\mathbb{Z}$ and $g$…

Classical Analysis and ODEs · Mathematics 2014-06-09 Chelo Ferreira , Jose L. Lopez , Ester Perez Sinusia

We establish some asymptotic expansions for infinite weighted convolutions of distributions having light subexponential tails. Examples are presented, some showing that in order to obtain an expansion with two significant terms, one needs…

Probability · Mathematics 2007-06-13 Ph. Barbe , W. P. McCormick

Applications in quantitative finance such as optimal trade execution, risk management of options, and optimal asset allocation involve the solution of high dimensional and nonlinear Partial Differential Equations (PDEs). The connection…

Machine Learning · Statistics 2019-10-28 Batuhan Güler , Alexis Laignelet , Panos Parpas

We investigate the asymptotic behaviour of gradient boosting algorithms when the learning rate converges to zero and the number of iterations is rescaled accordingly. We mostly consider L2-boosting for regression with linear base learner as…

Machine Learning · Statistics 2021-01-01 Clément Dombry , Youssef Esstafa

Support vector machine (SVM) training is an active research area since the dawn of the method. In recent years there has been increasing interest in specialized solvers for the important case of linear models. The algorithm presented by…

Machine Learning · Statistics 2013-02-25 Tobias Glasmachers , Ürün Dogan

The Brent-McMillan algorithm is the fastest known procedure for the high-precision computation of Euler's constant $\gamma$ and is based on the modified Bessel functions $I_0(2x)$ and $K_0(2x)$. An error estimate for this algorithm relies…

Classical Analysis and ODEs · Mathematics 2019-02-19 R B Paris

This paper proposes a novel deep generative model, called BSDE-Gen, which combines the flexibility of backward stochastic differential equations (BSDEs) with the power of deep neural networks for generating high-dimensional complex target…

Machine Learning · Computer Science 2023-04-11 Xingcheng Xu

We provide an asymptotic expansion of the maximal mean squared error (MSE) of the sample median to be attained on shrinking gross error neighborhoods about an ideal central distribution. More specifically, this expansion comes in powers of…

Statistics Theory · Mathematics 2010-06-02 Peter Ruckdeschel

Deep Learning is a very powerful machine learning model. Deep Learning trains a large number of parameters for multiple layers and is very slow when data is in large scale and the architecture size is large. Inspired from the shrinking…

Machine Learning · Computer Science 2016-09-20 Shuai Zheng , Abhinav Vishnu , Chris Ding

Using a differential equation approach asymptotic expansions are rigorously obtained for Lommel, Weber, Anger-Weber and Struve functions, as well as Neumann polynomials, each of which is a solution of an inhomogeneous Bessel equation. The…

Classical Analysis and ODEs · Mathematics 2021-04-06 T. M. Dunster

In this paper, we derive an asymptotic error expansion for the eigenvalue approximations by the lowest order Raviart-Thomas mixed finite element method for the general second order elliptic eigenvalue problems. Extrapolation based on such…

Numerical Analysis · Mathematics 2011-01-11 Hehu Xie

Reformulated uniform asymptotic expansions are derived for ordinary differential equations having a large parameter and a simple turning point. These involve Airy functions, but not their derivatives, unlike traditional asymptotic…

Classical Analysis and ODEs · Mathematics 2024-05-15 T. M. Dunster

In this paper, we consider coupled forward-backward stochastic differential equations (FBSDEs in short) with parameter $\varepsilon >0$. We study the asymptotic behavior of its solutions and establish a large deviation principle for the…

Probability · Mathematics 2013-11-05 Ana Bela Cruzeiro , André de Oliveira Gomes , Liangquan Zhang

Deep learning has shown its human-level performance in various applications. However, current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes. This poses a challenge particularly…

Machine Learning · Computer Science 2022-04-29 Yang Yang , Zhiying Cui , Junjie Xu , Changhong Zhong , Wei-Shi Zheng , Ruixuan Wang

The aim of this paper is to derive new representations for the Hankel functions, the Bessel functions and their derivatives, exploiting the reformulation of the method of steepest descents by M. V. Berry and C. J. Howls (Berry and Howls,…

Classical Analysis and ODEs · Mathematics 2015-10-27 Gergő Nemes

Backpropagation through (neural) SDE solvers is traditionally approached in two ways: discretise-then-optimise, which offers accurate gradients but incurs prohibitive memory costs; and optimise-then-discretise, which achieves constant…

Machine Learning · Computer Science 2026-05-12 Daniil Shmelev , Luke Thompson , Cristopher Salvi