English
Related papers

Related papers: Competing with stationary prediction strategies

200 papers

The paper introduces an asymptotically optimal lifelong sampling-based path planning algorithm that combines the merits of lifelong planning algorithms and lazy search algorithms for rapid replanning in dynamic environments where edge…

Robotics · Computer Science 2025-07-23 Lu Huang , Jingwen Yu , Jiankun Wang , Xingjian Jing

We study the approximation of stationary processes by a simple class of purely deterministic signals. This has an analytic counterpart in the approximation of symmetric positive definite Toeplitz matrices by submatrices of finite rank. We…

Probability · Mathematics 2020-09-15 Giorgio Picci , Bin Zhu

This paper studies nonstationary open dynamical systems from the statistical viewpoint. By open, we mean that trajectories may escape through holes in the phase space. By nonstationary, we mean that the dynamical model itself (as well as…

Dynamical Systems · Mathematics 2020-05-19 Brett Geiger , William Ott

For complex nonlinear systems, it is challenging to design algorithms that are fast, scalable, and give an accurate approximation of the stability region. This paper proposes a sampling-based approach to address these challenges. By…

Systems and Control · Electrical Eng. & Systems 2024-05-24 Péter Antal , Tamás Péni , Roland Tóth

Causal inference from observational data following the restricted structural causal model (SCM) framework hinges largely on the asymmetry between cause and effect from the data generating mechanisms, such as non-Gaussianity or nonlinearity.…

Methodology · Statistics 2021-09-06 Kang Du , Yu Xiang

Let $(B(t))_{t\in \Theta}$ with $\Theta={\mathbb Z}$ or $\Theta={\mathbb R}$ be a wide sense stationary process with discrete or continuous time. The classical linear prediction problem consists of finding an element in…

Probability · Mathematics 2020-02-07 Ildar Ibragimov , Zakhar Kabluchko , Mikhail Lifshits

We discuss a variant of Thompson sampling for nonparametric reinforcement learning in a countable classes of general stochastic environments. These environments can be non-Markov, non-ergodic, and partially observable. We show that Thompson…

Machine Learning · Computer Science 2016-06-06 Jan Leike , Tor Lattimore , Laurent Orseau , Marcus Hutter

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

An algorithm for non-stationary spatial modelling using multiple secondary variables is developed. It combines Geostatistics with Quantile Random Forests to give a new interpolation and stochastic simulation algorithm. This paper introduces…

Methodology · Statistics 2022-01-13 Colin Daly

A class of asymptotically autonomous systems on the plane with oscillatory coefficients is considered. It is assumed that the limiting system is Hamiltonian with a stable equilibrium. The effect of damped multiplicative stochastic…

Dynamical Systems · Mathematics 2023-06-14 Oskar A. Sultanov

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

In this paper, we focus on the problem of stable prediction across unknown test data, where the test distribution is agnostic and might be totally different from the training one. In such a case, previous machine learning methods might…

Machine Learning · Computer Science 2020-06-11 Kun Kuang , Bo Li , Peng Cui , Yue Liu , Jianrong Tao , Yueting Zhuang , Fei Wu

Non-stationary environments are challenging for reinforcement learning algorithms. If the state transition and/or reward functions change based on latent factors, the agent is effectively tasked with optimizing a behavior that maximizes…

Machine Learning · Computer Science 2021-05-21 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

We show that, for a fixed order $\gamma\geq 1$, each local minimizer of a rather general nonsmooth optimization problem in Euclidean spaces is either M-stationary in the classical sense (corresponding to stationarity of order $1$),…

Optimization and Control · Mathematics 2023-02-10 Matúš Benko , Patrick Mehlitz

Biological populations are subject to fluctuating environmental conditions. Different adaptive strategies can allow them to cope with these fluctuations: specialization to one particular environmental condition, adoption of a generalist…

Populations and Evolution · Quantitative Biology 2017-09-27 Andreas Mayer , Thierry Mora , Olivier Rivoire , Aleksandra M. Walczak

Energy-efficient real-time task scheduling has been actively explored in the past decade. Different from the past work, this paper considers schedulability conditions for stochastic real-time tasks. A schedulability condition is first…

Operating Systems · Computer Science 2008-04-07 Vandy Berten , Chi-Ju Chang , Tei-Wei Kuo

The growing prevalence of nonsmooth optimization problems in machine learning has spurred significant interest in generalized smoothness assumptions. Among these, the (L0, L1)-smoothness assumption has emerged as one of the most prominent.…

Optimization and Control · Mathematics 2026-02-24 Zhirayr Tovmasyan , Grigory Malinovsky , Laurent Condat , Peter Richtárik

Composition methodologies in the current literature are mainly to promote estimation efficiency via direct composition, either, of initial estimators or of objective functions. In this paper, composite estimation is investigated for both…

Methodology · Statistics 2013-12-31 Lu Lin , Feng Li , Kangning Wang , Lixing Zhu

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonconvex part is smooth and the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this fundamental problem…

Optimization and Control · Mathematics 2016-05-24 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola