English
Related papers

Related papers: Nonstationary iterative processes

200 papers

Stochastic iterative methods are useful in a variety of large-scale numerical linear algebraic, machine learning, and statistical problems, in part due to their low-memory footprint. They are frequently used in a variety of applications,…

Numerical Analysis · Mathematics 2025-11-27 Toby Anderson , Max Collins , Jamie Haddock , Jackie Lok , Elizaveta Rebrova

We introduce highly efficient online nonlinear regression algorithms that are suitable for real life applications. We process the data in a truly online manner such that no storage is needed, i.e., the data is discarded after being used.…

Machine Learning · Computer Science 2017-01-19 Burak C. Civek , Ibrahim Delibalta , Suleyman S. Kozat

Solving linear systems is a ubiquitous task in science and engineering. Because directly inverting a large-scale linear system can be computationally expensive, iterative algorithms are often used to numerically find the inverse. To…

Numerical Analysis · Mathematics 2021-07-20 Zheyuan Zhu , Andrew B. Klein , Guifang Li , Shuo Pang

Nonparametric and machine learning methods are flexible methods for obtaining accurate predictions. Nowadays, data sets with a large number of predictors and complex structures are fairly common. In the presence of item nonresponse,…

Methodology · Statistics 2022-08-23 Mehdi Dagdoug , Camelia Goga , David Haziza

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

Machine Learning · Computer Science 2025-07-10 Jihao Andreas Lin

With the ever increasing computational power available and the development of high-performances computing, investigating the properties of realistic very large-scale nonlinear dynamical systems has been become reachable. It must be noted…

The Iterative Filtering method is a technique developed recently for the decomposition and analysis of non-stationary and non-linear signals. In this work we propose two alternative formulations of the original algorithm which allows to…

Numerical Analysis · Mathematics 2018-11-09 Antonio Cicone

Within the study of uncertain dynamical systems, iterated random functions are a key tool. There, one samples a family of functions according to a stationary distribution. Here, we introduce an extension, where one sample functions…

Probability · Mathematics 2019-09-24 Ramen Ghosh , Jakub Marecek , Robert Shorten

We give an iterative algorithm for phase estimation of a parameter theta, which is within a logarithmic factor of the Heisenberg limit. Unlike other methods, we do not need any entanglement or an extra rotation gate which can perform…

Quantum Physics · Physics 2010-01-22 Caleb J O'Loan

Memoryless and finite-memory policies offer a practical alternative for solving partially observable Markov decision processes (POMDPs), as they operate directly in the output space rather than in the high-dimensional belief space. However,…

Machine Learning · Computer Science 2025-12-15 Roy van Zuijlen , Duarte Antunes

We present two related anytime algorithms for control of nonlinear systems when the processing resources available are time-varying. The basic idea is to calculate tentative control input sequences for as many time steps into the future as…

Optimization and Control · Mathematics 2013-08-09 Daniel E. Quevedo , Vijay Gupta

In this paper, we propose a class of super-schemes for efficiently solving nonlinear unconstrained optimization problems. The proposed approach introduces two novel choices of step-size parameters, leading to efficient descent directions…

Optimization and Control · Mathematics 2026-04-24 Tugal Zhanlav , Lkhamsuren Altangerel , Khuder Otgondorj

This article concerned with the issue of solving a nonlinear equation with the help of iterative method where no any derivative evaluation is required per iteration. Therefore, this work contributes to a new class of optimal eighth-order…

Numerical Analysis · Mathematics 2014-04-14 Anuradha Singh , J. P. Jaiswal

Inference for partially observed Markov process models has been a longstanding methodological challenge with many scientific and engineering applications. Iterated filtering algorithms maximize the likelihood function for partially observed…

Statistics Theory · Mathematics 2012-11-26 Edward L. Ionides , Anindya Bhadra , Yves Atchadé , Aaron King

This paper introduces a novel approach to evaluating the asymptotic stability of equilibrium points in both continuous-time (CT) and discrete-time (DT) nonlinear autonomous systems. By utilizing indirect Lyapunov methods and linearizing…

Systems and Control · Electrical Eng. & Systems 2025-08-08 Sadredin Hokmi , Mohammad Khajenejad

Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with…

Computation · Statistics 2022-06-13 Paul G. Beckman , Christopher J. Geoga , Michael L. Stein , Mihai Anitescu

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of…

Information Theory · Computer Science 2015-11-24 Patricia Wollstadt , Mario Martínez-Zarzuela , Raul Vicente , Francisco J. Díaz-Pernas , Michael Wibral

We establish the weak convergence of inertial Krasnoselskii-Mann iterations towards a common fixed point of a family of quasi-nonexpansive operators, along with estimates for the non-asymptotic rate at which the residuals vanish. Strong and…

Optimization and Control · Mathematics 2023-08-23 Juan José Maulén , Ignacio Fierro , Juan Peypouquet

We study the non-Markovian random continuous processes described by the Mori-Zwanzig equation. As a starting point, we use the Markovian Gaussian Ornstein-Uhlenbeck process and introduce an integral memory term depending on the past of the…

Statistical Mechanics · Physics 2019-12-04 S. S. Melnyk , V. A. Yampol'skii , O. V. Usatenko

In this paper, we introduce a new iterative method which we call one step back approach: the main idea is to anticipate the consequence of the iterative computation per coordinate and to optimize on the choice of the sequence of the…

Numerical Analysis · Computer Science 2013-02-19 Dohy Hong