English
Related papers

Related papers: On Polynomial Approximation of Activation Function

200 papers

We present an extension of our GPGCD method, an iterative method for calculating approximate greatest common divisor (GCD) of univariate polynomials, to polynomials with the complex coefficients. For a given pair of polynomials and a…

Commutative Algebra · Mathematics 2010-07-13 Akira Terui

Many promising applications of quantum computing with a provable speedup center around the HHL algorithm. Due to restrictions on the hardware and its significant demand on qubits and gates in known implementations, its execution is…

This paper introduces a novel algorithmic solution for the approximation of a given multivariate function by a nomographic function that is composed of a one-dimensional continuous and monotone outer function and a sum of univariate…

Information Theory · Computer Science 2015-07-14 Steffen Limmer , Jafar Mohammadi , Slawomir Stanczak

We use discrete holomorphic polynomials to prove that, given a refining sequence of critical maps of a Riemann surface, any holomorphic function can be approximated by a converging sequence of discrete holomorphic functions.

Mathematical Physics · Physics 2007-05-23 Christian Mercat

We enhance the approximation capabilities of algebraic polynomials by composing them with homeomorphisms. This composition yields families of functions that remain dense in the space of continuous functions, while enabling more accurate…

Numerical Analysis · Mathematics 2025-12-17 Álvaro Fernández Corral , Yahya Saleh

We study the problem of approximating an unknown function $f:\mathbb{R}\to\mathbb{R}$ by a degree-$d$ polynomial using as few function evaluations as possible, where error is measured with respect to a probability distribution $\mu$.…

Data Structures and Algorithms · Computer Science 2025-08-11 Chris Camaño , Raphael A. Meyer , Kevin Shu

We present two approximate versions of the proximal subgradient method for minimizing the sum of two convex functions (not necessarily differentiable). The algorithms involve, at each iteration, inexact evaluations of the proximal operator…

Optimization and Control · Mathematics 2019-07-12 Reinier Díaz Millán , Majela Pentón Machado

In this paper we discuss approximation of partially smooth functions. The problem arises naturally in the study of laminated currents.

Dynamical Systems · Mathematics 2015-06-26 John Fornaess , Yinxia Wang , Erlend Fornaess Wold

A rational approximation by a ratio of polynomial functions is a flexible alternative to polynomial approximation. In particular, rational functions exhibit accurate estimations to nonsmooth and non- Lipschitz functions, where polynomial…

Optimization and Control · Mathematics 2020-02-27 V. Peiris , N. Sharon , N. Sukhorukova J. Ugon

Minimal annihilating polynomials are very useful in a wide variety of algorithms in exact linear algebra. A new efficient method is proposed for calculating the minimal annihilating polynomials for all the unit vectors, for a square matrix…

Commutative Algebra · Mathematics 2018-06-13 Shinichi Tajima , Katsuyoshi Ohara , Akira Terui

The choice of activation function can significantly influence the performance of neural networks. The lack of guiding principles for the selection of activation function is lamentable. We try to address this issue by introducing our…

Machine Learning · Computer Science 2018-10-16 Yiwei Li , Enzhi Li

The scope of research in the domain of activation functions remains limited and centered around improving the ease of optimization or generalization quality of neural networks (NNs). However, to develop a deeper understanding of deep…

Machine Learning · Computer Science 2020-12-10 Mohit Goyal , Rajan Goyal , Brejesh Lall

Many interesting functions arising in applications map into Riemannian manifolds. We present an algorithm, using the manifold exponential and logarithm, for approximating such functions. Our approach extends approximation techniques for…

Numerical Analysis · Mathematics 2026-01-27 Simon Jacobsson , Raf Vandebril , Joeri van der Veken , Nick Vannieuwenhoven

Given a set of matrices, modeled as samples of a matrix-valued function, we suggest a method to approximate the underline function using a product approximation operator. This operator extends known approximation methods by exploiting the…

Numerical Analysis · Mathematics 2016-11-15 Nira Dyn , Uri Itai , Nir Sharon

We investigate a family of approximate multi-step proximal point methods, accelerated by implicit linear discretizations of gradient flow. The resulting methods are multi-step proximal point methods, with similar computational cost in each…

Optimization and Control · Mathematics 2023-10-23 Yushen Huang , Yifan Sun

We propose to approximate a (possibly discontinuous) multivariate function f (x) on a compact set by the partial minimizer arg miny p(x, y) of an appropriate polynomial p whose construction can be cast in a univariate sum of squares (SOS)…

Numerical Analysis · Mathematics 2025-07-22 Didier Henrion , Milan Korda , Jean-Bernard Lasserre

In this paper, we propose a method to obtain a constrained approximation of a rational B\'{e}zier curve by a polynomial B\'{e}zier curve. This problem is reformulated as an approximation problem between two polynomial B\'{e}zier curves…

Numerical Analysis · Mathematics 2014-09-16 Mao Shi , Jiansong Deng

We consider the problem of approximating the partition function of the hard-core model on planar graphs of degree at most 4. We show that when the activity lambda is sufficiently large, there is no fully polynomial randomised approximation…

Computational Complexity · Computer Science 2014-07-08 Leslie Ann Goldberg , Mark Jerrum , Colin McQuillan

In this paper we describe active set type algorithms for minimization of a smooth function under general order constraints, an important case being functions on the set of bimonotone r-by-s matrices. These algorithms can be used, for…

Computation · Statistics 2010-03-30 Rudolf Beran , Lutz Duembgen

A recurrence scheme is defined for the numerical determination of high degree polynomial approximations to functions as, for instance, inverse powers near zero. As an example, polynomials needed in the two-step multi-boson (TSMB) algorithm…

High Energy Physics - Lattice · Physics 2007-05-23 C. Gebert , I. Montvay
‹ Prev 1 4 5 6 7 8 10 Next ›