English
Related papers

Related papers: Identification and Adaptation with Binary-Valued O…

200 papers

Many machine learning and optimization algorithms can be cast as instances of stochastic approximation (SA). The convergence rate of these algorithms is known to be slow, with the optimal mean squared error (MSE) of order $O(n^{-1})$. In…

Optimization and Control · Mathematics 2024-09-13 Caio Kalil Lauand , Sean Meyn

Deep Neural Networks (DNNs) are increasingly used in control applications due to their powerful function approximation capabilities. However, many existing formulations focus primarily on tracking error convergence, often neglecting the…

Systems and Control · Electrical Eng. & Systems 2025-05-19 Rebecca G. Hart , Omkar Sudhir Patil , Zachary I. Bell , Warren E. Dixon

Strict stationarity is a common assumption used in the time series literature in order to derive asymptotic distributional results for second-order statistics, like sample autocovariances and sample autocorrelations. Focusing on weak…

Statistics Theory · Mathematics 2023-02-28 Yunyi Zhang , Efstathios Paparoditis , Dimitris N. Politis

It is well known that ignoring the presence of stochastic disturbances in the identification of stochastic Wiener models leads to asymptotically biased estimators. On the other hand, optimal statistical identification, via likelihood-based…

Methodology · Statistics 2024-03-12 Mohamed Abdalmoaty , Efe C. Balta , John Lygeros , Roy S. Smith

Parameter sensitivity analysis is a powerful tool in the building and analysis of biochemical network models. For stochastic simulations, parameter sensitivity analysis can be computationally expensive, requiring multiple simulations for…

Computational Physics · Physics 2015-06-04 Patrick B. Warren , Rosalind J. Allen

We propose a new method for parameter learning in Bayesian networks with qualitative influences. This method extends our previous work from networks of binary variables to networks of discrete variables with ordered values. The specified…

Artificial Intelligence · Computer Science 2012-06-26 Ad Feelders

In this work, we first show that the problem of parameter identification is often ill-conditioned and lacks the persistence of excitation required for the convergence of online learning schemes. To tackle these challenges, we introduce the…

Systems and Control · Electrical Eng. & Systems 2025-08-19 Chi Ho Leung , Ashish R. Hota , Philip E. Paré

For systems with uncertain linear models, bounded additive disturbances and state and control constraints, a robust model predictive control algorithm incorporating online model adaptation is proposed. Sets of model parameters are…

Optimization and Control · Mathematics 2020-07-16 Xiaonan Lu , Mark Cannon , Denis Koksal-Rivet

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We study equilibrium selection for invariant measures of stochastic dynamical systems with constant step size, under persistent noise and minimal moment assumptions, in a general quasi-Feller framework. Such dynamics arise in…

Probability · Mathematics 2026-01-16 Jean-Gabriel Attali

Since batch algorithms suffer from lack of proficiency in confronting model mismatches and disturbances, this contribution proposes an adaptive scheme based on continuous Lyapunov function for online robot dynamic identification. This paper…

Robotics · Computer Science 2022-10-28 Pedram Agand , Mahdi Aliyari Shoorehdeli

This paper deals with the problem of finite-time learning for unknown discrete-time nonlinear systems' dynamics, without the requirement of the persistence of excitation. Two finite-time concurrent learning methods are presented to…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Farzaneh Tatari , Christos Panayiotou , Marios Polycarpou

Continuous-time adaptive controllers for systems with a matched uncertainty often comprise an online parameter estimator and a corresponding parameterized controller to cancel the uncertainty. However, such methods are often impossible to…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Aren Karapetyan , Efe C. Balta , Anastasios Tsiamis , Andrea Iannelli , John Lygeros

This paper considers the distributed sparse identification problem over wireless sensor networks such that all sensors cooperatively estimate the unknown sparse parameter vector of stochastic dynamic systems by using the local information…

Systems and Control · Electrical Eng. & Systems 2022-03-08 Die Gan , Zhixin Liu

Inferring the parameters of a stochastic model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e. when distinct sets of parameters…

Machine Learning · Statistics 2021-11-10 Pedro L. C. Rodrigues , Thomas Moreau , Gilles Louppe , Alexandre Gramfort

This paper investigates gradient-based adaptive prediction and control for nonlinear stochastic dynamical systems under a weak convexity condition on the prediction-based loss. This condition accommodates a broad range of nonlinear models…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Yujing Liu , Xin Zheng , Zhixin Liu , Lei Guo

This paper discusses the problem of estimating a stochastic signal from nonlinear uncertain observations with time-correlated additive noise described by a first-order Markov process. Random deception attacks are assumed to be launched by…

Signal Processing · Electrical Eng. & Systems 2024-05-09 R. Caballero-Águila , J. Hu , J. Linares-Pérez

We consider the problem of parameter estimation for a stochastic McKean-Vlasov equation, and the associated system of weakly interacting particles. We study two cases: one in which we observe multiple independent trajectories of the…

Statistics Theory · Mathematics 2022-11-28 Louis Sharrock , Nikolas Kantas , Panos Parpas , Grigorios A. Pavliotis

In the present paper, two existing nonlinear system identification methodologies are used to identify data-driven models. The first methodology focuses on identifying the system using steady-state excitations. To accomplish this, a…

Systems and Control · Electrical Eng. & Systems 2020-11-18 Maren Scheel , Gleb Kleyman , Ali Tatar , Matthew R. W. Brake , Simon Peter , Jean-Philippe Noël , Matthew S. Allen , Malte Krack

In regression models, predictor variables with inherent ordering, such as tumor staging ranging and ECOG performance status, are commonly seen in medical settings. Statistically, it may be difficult to determine the functional form of an…

Methodology · Statistics 2020-08-04 Emily Roberts , Lili Zhao