English
Related papers

Related papers: Identification and Adaptation with Binary-Valued O…

200 papers

Changes in the statistical properties of a stochastic process are typically assumed to occur via change-points, which demark instantaneous moments of complete and total change in process behavior. In cases where these transitions occur…

Machine Learning · Statistics 2022-05-06 Chris Browne

The linear fractional stable motion generalizes two prominent classes of stochastic processes, namely stable L\'evy processes, and fractional Brownian motion. For this reason it may be regarded as a basic building block for continuous time…

Statistics Theory · Mathematics 2022-08-17 Fabian Mies , Mark Podolskij

In this paper, we consider the data-driven discovery of stable dynamical models with a single equilibrium. The proposed approach uses a basis-function parameterization of the differential equations and the associated Lyapunov function. This…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Zhe Li , Ilias Mitrai

This work proposes a detectability condition for linear time-varying systems based on the exponential dichotomy spectrum. The condition guarantees the existence of an observer, whose gain is determined only by the unstable modes of the…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Markus Tranninger , Richard Seeber , Martin Steinberger , Martin Horn , Christian Pötzsche

Network models have been popular for modeling and representing complex relationships and dependencies between observed variables. When data comes from a dynamic stochastic process, a single static network model cannot adequately capture…

Machine Learning · Statistics 2013-04-03 Mladen Kolar , Eric P. Xing

The question of how to incorporate curvature information in stochastic approximation methods is challenging. The direct application of classical quasi- Newton updating techniques for deterministic optimization leads to noisy curvature…

Optimization and Control · Mathematics 2015-02-19 R. H. Byrd , S. L. Hansen , J. Nocedal , Y. Singer

A wide variety of physical systems ranging from the firing of neurons to eutrophication of lakes to the presence of Arctic summer sea ice exhibit a phenomenon known as tipping. In mathematical models, tipping can be caused by bifurcations,…

Dynamical Systems · Mathematics 2018-03-14 Alanna Hoyer-Leitzel , Alice Nadeau , Andrew Roberts , Andrew Steyer

In this paper we propose a new parameter estimator that ensures global exponential convergence of linear regression models requiring only the necessary assumption of identifiability of the regression equation,which we show is equivalent to…

Systems and Control · Electrical Eng. & Systems 2021-08-20 Lei Wang , Romeo Ortega , Alexey Bobtsov , Jose Guadalupe Romero , Bowen Yi

The parameter convergence relies on a stringent persistent excitation (PE) condition in adaptive control. Several works have proposed a memory term in the last decade to translate the PE condition to a feasible finite excitation (FE)…

Systems and Control · Electrical Eng. & Systems 2025-06-26 Manish Patel , Arnab Maity

Nonlinear regression is a useful statistical tool, relating observed data and a nonlinear function of unknown parameters. When the parameter-dependent nonlinear function is computationally intensive, a straightforward regression analysis by…

Applications · Statistics 2009-01-26 Dorin Drignei , Chris E. Forest , Doug Nychka

Extracting the spectral representations of the neural processes that underlie spiking activity is key to understanding how the brain rhythms mediate cognitive functions. While spectral estimation of continuous time-series is well studied,…

Information Theory · Computer Science 2020-12-02 Anuththara Rupasinghe , Behtash Babadi

In modern data science, dynamic tensor data is prevailing in numerous applications. An important task is to characterize the relationship between such dynamic tensor and external covariates. However, the tensor data is often only partially…

Machine Learning · Statistics 2021-05-17 Jie Zhou , Will Wei Sun , Jingfei Zhang , Lexin Li

Discrete-state, continuous-time Markov models are widely used in the modeling of biochemical reaction networks. Their complexity often precludes analytic solution, and we rely on stochastic simulation algorithms to estimate system…

Quantitative Methods · Quantitative Biology 2016-05-20 Christopher Lester , Christian A. Yates , Michael B. Giles , Ruth E. Baker

It is nontrivial to achieve exponential stability even for time-invariant nonlinear systems with matched uncertainties and persistent excitation (PE) condition. In this paper, without the need for PE condition, we address the problem of…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Hefu Ye , Haijia Wu , Kai Zhao , Yongduan Song

An adaptive observer is designed for online estimation of Hilbert-Schmidt operators from online measurement of the state for some class of nonlinear infinite-dimensional dynamical systems. Convergence is ensured under detectability and…

Optimization and Control · Mathematics 2022-10-10 Lucas Brivadis , Antoine Chaillet , Jean Auriol

Four decades after their invention, quasi-Newton methods are still state of the art in unconstrained numerical optimization. Although not usually interpreted thus, these are learning algorithms that fit a local quadratic approximation to…

Numerical Analysis · Computer Science 2012-06-22 Philipp Hennig , Martin Kiefel

In this paper we investigate quasi-stationary distributions {\mu}_N of stochastic approximation algorithms with constant step size which can be viewed as random perturbations of a time-continuous dynamical system. Inspired by ecological…

Probability · Mathematics 2013-05-03 Bastien Marmet

We introduce a novel approach based on stochastic optimization to find the optimal sampling distribution for the data-driven stability analysis of switched linear systems. Our goal is to address limitations of existing approaches, in…

Optimization and Control · Mathematics 2025-09-01 Alexis Vuille , Guillaume O. Berger , Raphaël M. Jungers

The article considers the problem of identifying the variable frequency of a sinusoidal signal. To obtain a regression model of the signal, an iterative differentiation of the original analytical expression is performed, and the swapping…

Systems and Control · Electrical Eng. & Systems 2021-09-21 S. I. Nizovtsev , S. V. Shavetov , A. A. Pyrkin

Surprise-based learning allows agents to rapidly adapt to non-stationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off…

Machine Learning · Statistics 2020-09-25 Vasiliki Liakoni , Alireza Modirshanechi , Wulfram Gerstner , Johanni Brea