English
Related papers

Related papers: An adaptive step size controller for iterative imp…

200 papers

Time series are difficult to monitor, summarize and predict. Segmentation organizes time series into few intervals having uniform characteristics (flatness, linearity, modality, monotonicity and so on). For scalability, we require fast…

Databases · Computer Science 2007-05-23 Daniel Lemire

We consider a Markov chain $(x_n)$ whose kernel is indexed by a scaling parameter $\gamma>0$, refered to as the step size. The aim is to analyze the behavior of the Markov chain in the doubly asymptotic regime where $n\to\infty$ then…

Probability · Mathematics 2017-12-18 Pascal Bianchi , Walid Hachem , Adil Salim

Indirect experiments provide a valuable framework for estimating treatment effects in situations where conducting randomized control trials (RCTs) is impractical or unethical. Unlike RCTs, indirect experiments estimate treatment effects by…

Machine Learning · Computer Science 2023-12-06 Yash Chandak , Shiv Shankar , Vasilis Syrgkanis , Emma Brunskill

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

Machine Learning · Computer Science 2025-07-10 Jihao Andreas Lin

This paper presents an extremum seeking control algorithm with an adaptive step-size that adjusts the aggressiveness of the controller based on the quality of the gradient estimate. The adaptive step-size ensures that the integral-action…

Optimization and Control · Mathematics 2021-12-21 Claus Danielson , Scott A. Bortoff , Ankush Chakrabarty

We consider the solution of large stiff systems of ordinary differential equations with explicit exponential Runge--Kutta integrators. These problems arise from semi-discretized semi-linear parabolic partial differential equations on…

Numerical Analysis · Mathematics 2023-08-24 Kai Bergermann , Martin Stoll

To integrate large systems of nonlinear differential equations in time, we consider a variant of nonlinear waveform relaxation (also known as dynamic iteration or Picard-Lindel\"of iteration), where at each iteration a linear inhomogeneous…

Numerical Analysis · Mathematics 2024-04-23 Mike A. Botchev

The problem of designing adaptive stepsize sequences for the gradient descent method applied to convex and locally smooth functions is studied. We take an adaptive control perspective and design update rules for the stepsize that make use…

Optimization and Control · Mathematics 2025-08-27 Andrea Iannelli

Computational efficiency demands discretised, hierarchically organised, and individually adaptive time-step sizes (known as the block-step scheme) for the time integration of N-body models. However, most existing N-body codes adapt…

Instrumentation and Methods for Astrophysics · Physics 2017-09-20 Walter Dehnen

This paper is concerned with a posteriori error bounds for linear transport equations and related questions of contriving corresponding adaptive solution strategies in the context of Discontinuous-Petrov-Galerkin schemes. After indicating…

Numerical Analysis · Mathematics 2019-02-22 W. Dahmen , R. P. Stevenson

Interpolation-based methods are well-established and effective approaches for the efficient generation of accurate reduced-order surrogate models. Common challenges for such methods are the automatic selection of good or even optimal…

Numerical Analysis · Mathematics 2024-07-23 Quirin Aumann , Steffen W. R. Werner

We derive computationally tractable methods to select a small subset of experiment settings from a large pool of given design points. The primary focus is on linear regression models, while the technique extends to generalized linear models…

Machine Learning · Statistics 2017-12-21 Yining Wang , Adams Wei Yu , Aarti Singh

The Rosenbrock-Krylov family of time integration schemes is an extension of Rosenbrock-W methods that employs a specific Krylov based approximation of the linear system solutions arising within each stage of the integrator. This work…

Numerical Analysis · Mathematics 2019-10-08 Paul Tranquilli , Ross Glandon , Adrian Sandu

Automatic numerical algorithms attempt to provide approximate solutions that differ from exact solutions by no more than a user-specified error tolerance. The computational cost is often determined \emph{adaptively} by the algorithm based…

Numerical Analysis · Mathematics 2015-01-16 Nicholas Clancy , Yuhan Ding , Caleb Hamilton , Fred J. Hickernell , Yizhi Zhang

This paper introduces adaptive Bregman proximal gradient algorithms for solving convex composite minimization problems without relying on global relative smoothness or strong convexity assumptions. Building upon recent advances in adaptive…

Optimization and Control · Mathematics 2025-08-05 Hongjia Ou , Puya Latafat , Andreas Themelis

Classical stochastic gradient methods for optimization rely on noisy gradient approximations that become progressively less accurate as iterates approach a solution. The large noise and small signal in the resulting gradients makes it…

Machine Learning · Computer Science 2017-04-10 Soham De , Abhay Yadav , David Jacobs , Tom Goldstein

We propose a statistical adaptive procedure called SALSA for automatically scheduling the learning rate (step size) in stochastic gradient methods. SALSA first uses a smoothed stochastic line-search procedure to gradually increase the…

Machine Learning · Statistics 2020-02-26 Pengchuan Zhang , Hunter Lang , Qiang Liu , Lin Xiao

The use of implicit time-stepping schemes for the numerical approximation of solutions to stiff nonlinear time-evolution equations brings well-known advantages including, typically, better stability behaviour and corresponding support of…

Numerical Analysis · Mathematics 2025-02-14 Tianyu Jin , Georg Maierhofer , Katharina Schratz , Yang Xiang

Iterative solvers for large-scale linear systems such as Krylov subspace methods can diverge when the linear system is ill-conditioned, thus significantly reducing the applicability of these iterative methods in practice for…

Numerical Analysis · Mathematics 2025-07-24 Vasileios Kalantzis , Mark S. Squillante , Chai Wah Wu

We propose an iterative method for nonlinear semidefinite programs with box constraints. The search direction in the proposed method utilizes the distance from the current point to the boundary of a feasible set. The computation of the…

Optimization and Control · Mathematics 2015-05-15 Akihiko Komatsu , Makoto Yamashita
‹ Prev 1 4 5 6 7 8 10 Next ›