English
Related papers

Related papers: Algorithm 985: Simple, efficient, and relatively a…

200 papers

In this paper, we present an improved continued fraction approximation of the Wallis ratio. This approximation is fast in comparison with the recently discovered asymptotic series. We also establish the double-side inequality related to…

Classical Analysis and ODEs · Mathematics 2017-12-07 Xu You

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

In min-min optimization or max-min optimization, one has to compute the gradient of a function defined as a minimum. In most cases, the minimum has no closed-form, and an approximation is obtained via an iterative algorithm. There are two…

Machine Learning · Statistics 2020-02-11 Pierre Ablin , Gabriel Peyré , Thomas Moreau

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

The ODE method has been a workhorse for algorithm design and analysis since the introduction of the stochastic approximation. It is now understood that convergence theory amounts to establishing robustness of Euler approximations for ODEs,…

Optimization and Control · Mathematics 2020-10-02 Shuhang Chen , Adithya Devraj , Andrey Bernstein , Sean Meyn

The article is devoted to the estimation of the rate of convergence of integral functionals of a Markov process. Under the assumption that the given Markov process admits a transition probability density which is differentiable in $t$ and…

Probability · Mathematics 2015-08-03 I. Ganychenko , V. Knopova , A. Kulik

In this article, we design fast algorithms for the computation of approximant bases in shifted Popov normal form. We first recall the algorithm known as PM-Basis, which will be our second fundamental engine after polynomial matrix…

Symbolic Computation · Computer Science 2019-04-09 Claude-Pierre Jeannerod , Vincent Neiger , Gilles Villard

We present a rational approximation for rapid and accurate computation of the Voigt function, obtained by residue calculus. The computational test reveals that with only $16$ summation terms this approximation provides average accuracy…

Data Analysis, Statistics and Probability · Physics 2015-05-13 S. M. Abrarov , B. M. Quine

In this work, we consider the approximation of Hilbert space-valued meromorphic functions that arise as solution maps of parametric PDEs whose operator is the shift of an operator with normal and compact resolvent, e.g. the Helmholtz…

Numerical Analysis · Mathematics 2020-02-28 Francesca Bonizzoni , Fabio Nobile , Ilaria Perugia , Davide Pradovera

This paper presents an algorithm for approximately minimizing a convex function in simple, not necessarily bounded convex domains, assuming only that function values and subgradients are available. No global information about the objective…

Optimization and Control · Mathematics 2014-02-06 Arnold Neumaier

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

Approximate probabilistic inference algorithms are central to many fields. Examples include sequential Monte Carlo inference in robotics, variational inference in machine learning, and Markov chain Monte Carlo inference in statistics. A key…

Machine Learning · Statistics 2017-11-07 Marco F. Cusumano-Towner , Vikash K. Mansinghka

We compare the efficiency of four different algorithms to compute the overlap Dirac operator, both for the speed, i.e., time required to reach a desired numerical accuracy, and for the adaptability, i.e., the scaling of speed with the…

High Energy Physics - Lattice · Physics 2009-11-07 Rajiv V. Gavai , Sourendu Gupta , Robert Lacaze

We study algorithms for the sliding-window model, an important variant of the data-stream model, in which the goal is to compute some function of a fixed-length suffix of the stream. We extend the smooth-histogram framework of Braverman and…

Data Structures and Algorithms · Computer Science 2022-05-26 Robert Krauthgamer , David Reitblat

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

We present an algorithm for generating approximations for the logarithm of Barnes $G$-function in the half-plane $Re(z)\ge 3/2$. These approximations involve only elementary functions and are easy to implement. The algorithm is based on a…

Numerical Analysis · Mathematics 2022-04-13 Alexey Kuznetsov

In this short note, we provide a simple version of an accelerated forward-backward method (a.k.a. Nesterov's accelerated proximal gradient method) possibly relying on approximate proximal operators and allowing to exploit strong convexity…

Optimization and Control · Mathematics 2022-01-24 Mathieu Barré , Adrien Taylor , Francis Bach

We describe a simple and efficient procedure for approximating the L\'evy measure of a $\text{Gamma}(\alpha,1)$ random variable. We use this approximation to derive a finite sum-representation that converges almost surely to Ferguson's…

Machine Learning · Statistics 2012-01-26 Mahmoud Zarepour , Luai Al Labadi

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

The proximal algorithm is a powerful tool to minimize nonlinear and nonsmooth functionals in a general metric space. Motivated by the recent progress in studying the training dynamics of the noisy gradient descent algorithm on two-layer…

Optimization and Control · Mathematics 2026-05-19 Shuailong Zhu , Xiaohui Chen