English
Related papers

Related papers: A New First Order Taylor-like Theorem With An Opti…

200 papers

Stochastic optimization often involves calculating the expected value of a first-order max or min function, known as a first-order loss function. In this context, loss functions are frequently approximated using piecewise linear functions.…

Optimization and Control · Mathematics 2023-09-26 Yotaro Takazawa

In this paper, we propose a systematic approach for extending first-order optimization algorithms, originally designed for unconstrained strongly convex problems, to handle closed and convex set constraints. We show that the resulting…

Optimization and Control · Mathematics 2026-01-05 Mengmou Li , Ioannis Lestas , Masaaki Nagahara

We propose a fast proximal Newton-type algorithm for minimizing regularized finite sums that returns an $\epsilon$-suboptimal point in $\tilde{\mathcal{O}}(d(n + \sqrt{\kappa d})\log(\frac{1}{\epsilon}))$ FLOPS, where $n$ is number of…

Machine Learning · Computer Science 2017-08-30 Xuanqing Liu , Cho-Jui Hsieh , Jason D. Lee , Yuekai Sun

In this work, we present a new way to compute the Taylor polynomial of the matrix exponential which reduces the number of matrix multiplications in comparison with the de-facto standard Patterson-Stockmeyer method. This reduction is…

Numerical Analysis · Mathematics 2017-10-31 Philipp Bader , Sergio Blanes , Fernando Casas

The purpose of this letter is to investigate the time complexity consequences of the truncated Taylor series, known as Taylor Polynomials \cite{bakas2019taylor,Katsoprinakis2011,Nestoridis2011}. In particular, it is demonstrated that the…

Computational Complexity · Computer Science 2020-05-28 Nikolaos P. Bakas , Elias Kosmatopoulos , Mihalis Nicolaou , Savvas A. Chatzichristofis

This paper is devoted to studying the first-order variational analysis of non-convex and non-differentiable functions that may not be subdifferentially regular. To achieve this goal, we entirely rely on two concepts of directional…

Optimization and Control · Mathematics 2022-04-22 Ashkan Mohammadi

In this paper, we present a variational integrator that is based on an approximation of the Euler--Lagrange boundary-value problem via Taylor's method. This can viewed as a special case of the shooting-based variational integrator. The…

Numerical Analysis · Mathematics 2017-03-21 Jeremy Schmitt , Tatiana Shingel , Melvin Leok

We introduce in this document a direct method allowing to solve numerically inverse type problems for linear parabolic equations. We consider the reconstruction of the full solution of the parabolic equation posed in $\Omega\times (0,T)$ -…

Optimization and Control · Mathematics 2024-02-11 Arnaud Munch , Diego Souza

Floating-point round-off errors are ubiquitous in numerically intensive programs arising in fields such as scientific computing and optimization. As floating-point errors potentially lead to unexpected and catastrophic program failures, one…

Logic in Computer Science · Computer Science 2026-05-07 Yichen Tao , Hongfei Fu , Jiawei Chen , Jean-Baptiste Jeannin

We study the Hamiltonian truncation for the two-dimensional $\lambda\phi^4$ theory within the framework of Hamiltonian truncation effective theory, where truncation artifacts are mitigated through a systematic inclusion of corrective terms…

High Energy Physics - Phenomenology · Physics 2026-02-16 Andrea Maestri , Simone Rodini , Barbara Pasquini

We prove an intrinsic Taylor-like formula for a class of Lie groups arising in the study of some sub-elliptic differential operators, namely the Kolmogorov operators. The estimate of the remainder is in terms of the intrinsic norm induced…

Analysis of PDEs · Mathematics 2017-07-07 Stefano Pagliarani , Michele Pignotti

We present a family of high order trapezoidal rule-based quadratures for a class of singular integrals, where the integrand has a point singularity. The singular part of the integrand is expanded in a Taylor series involving terms of…

Numerical Analysis · Mathematics 2023-07-27 Federico Izzo , Olof Runborg , Richard Tsai

We study numerical integration of smooth functions defined over the $s$-dimensional unit cube. A recent work by Dick et al. (2019) has introduced so-called extrapolated polynomial lattice rules, which achieve the almost optimal rate of…

Numerical Analysis · Mathematics 2020-07-15 Takashi Goda

Exactly solving first-order constraints (i.e., first-order formulas over a certain predefined structure) can be a very hard, or even undecidable problem. In continuous structures like the real numbers it is promising to compute approximate…

Logic in Computer Science · Computer Science 2007-05-23 Stefan Ratschan

The main point of this paper is to present a class of equations over integers that one can check if they have a solution by checking a set of inequalities. The prototype of such equations is the equations appearing in the well-known…

Combinatorics · Mathematics 2014-06-18 Masood Aryapoor

In this paper, we introduce the first-order integer-valued autoregressive (INAR(1)) model, with Poisson-Lindley innovations based on power series thinning operator. Some mathematical features of this process are given and estimating the…

Applications · Statistics 2018-10-08 Eisa Mahmoudi , Ameneh Rostami , Rasool Roozegar

A new method for the numerical solution of ODEs is presented. This approach is based on an approximate formulation of the Taylor methods that has a much easier implementation than the original Taylor methods, since only the functions in the…

Numerical Analysis · Mathematics 2025-01-30 Antonio Baeza , Sebastiano Boscarino , Pep Mulet , Giovanni Russo , David Zorío

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

Machine Learning · Statistics 2013-05-15 Julien Mairal

This paper describes an algorithm for the computation of FIRST and FOLLOW sets for use with feature-theoretic grammars in which the value of the sets consists of pairs of feature-theoretic categories. The algorithm preserves as much…

cmp-lg · Computer Science 2008-02-03 Arturo Trujillo

We consider regression scenarios where it is natural to impose an order constraint on the coefficients. We propose an order-constrained version of L1-regularized regression for this problem, and show how to solve it efficiently using the…

Applications · Statistics 2017-06-01 Xiaotong Suo , Robert Tibshirani
‹ Prev 1 3 4 5 6 7 10 Next ›