English
Related papers

Related papers: Sequential Regression Learning with Randomized Alg…

200 papers

In data-driven SHM, the signals recorded from systems in operation can be noisy and incomplete. Data corresponding to each of the operational, environmental, and damage states are rarely available a priori; furthermore, labelling to…

We present algorithms for nonparametric regression in settings where the data are obtained sequentially. While traditional estimators select bandwidths that depend upon the sample size, for sequential data the effective sample size is…

Methodology · Statistics 2012-07-03 Haijie Gu , John Lafferty

We present a new distribution-free conformal prediction algorithm for sequential data (e.g., time series), called the \textit{sequential predictive conformal inference} (\texttt{SPCI}). We specifically account for the nature that time…

Machine Learning · Statistics 2023-05-31 Chen Xu , Yao Xie

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

This paper presents a physics-informed deep learning approach for predicting the replicator equation, allowing accurate forecasting of population dynamics. This methodological innovation allows us to derive governing differential or…

Artificial Intelligence · Computer Science 2024-12-04 Advait Chandorkar

We present AC-SINDy, a compositional extension of the Sparse Identification of Nonlinear Dynamics (SINDy) framework that replaces explicit feature libraries with a structured representation based on arithmetic circuits. Rather than…

Machine Learning · Computer Science 2026-04-22 Peter Racioppo

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional approximations to…

Econometrics · Economics 2022-12-23 Karun Adusumilli , Dita Eckardt

Modern learning systems increasingly interact with data that evolve over time and depend on hidden internal state. We ask a basic question: when is such a dynamical system learnable from observations alone? This paper proposes a research…

Machine Learning · Computer Science 2025-12-23 Elad Hazan , Shai Shalev Shwartz , Nathan Srebro

Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and…

Machine Learning · Statistics 2024-09-09 Haoyu Jiang , Jason Xu

We introduce a sequential learning algorithm to address a robust controller tuning problem, which in effect, finds (with high probability) a candidate solution satisfying the internal performance constraint to a chance-constrained program…

Optimization and Control · Mathematics 2021-10-19 Robert Chin , Chris Manzie , Iman Shames , Dragan Nešić , Jonathan E. Rowe

RaNNDy is a randomized neural network architecture for the data-driven approximation of transfer operators associated with complex dynamical systems. The weights and biases of the hidden layers of the network are randomly initialized and…

Machine Learning · Computer Science 2026-05-25 Mohammad Tabish , Stefan Klus

This paper presents a new approach to statistical similarity assessment based on sequence alignment. The algorithm performs mutual matching of two random sequences by successively searching for common elements and by applying sequence…

Signal Processing · Electrical Eng. & Systems 2021-06-09 Jakub Nikonowicz , Łukasz Matuszewski , Paweł Kubczak

Much more attention has been paid to unsupervised feature selection nowadays due to the emergence of massive unlabeled data. The distribution of samples and the latent effect of training a learning method using samples in more effective…

Machine Learning · Computer Science 2021-12-15 Weiyi Li , Hongmei Chen , Tianrui Li , Jihong Wan , Binbin Sang

The demand of probabilistic time series forecasting has been recently raised in various dynamic system scenarios, for example, system identification and prognostic and health management of machines. To this end, we combine the advances in…

Machine Learning · Computer Science 2022-05-25 Haitao Liu , Changjun Liu , Xiaomo Jiang , Xudong Chen , Shuhua Yang , Xiaofang Wang

We present a scheme for sequential decision making with a risk-sensitive objective and constraints in a dynamic environment. A neural network is trained as an approximator of the mapping from parameter space to space of risk and policy with…

Artificial Intelligence · Computer Science 2019-07-10 Shuai Ma , Jia Yuan Yu , Ahmet Satir

Sparse identification of nonlinear dynamics (SINDy) has been widely used to discover the governing equations of a dynamical system from data. It uses sparse regression techniques to identify parsimonious models of unknown systems from a…

Methodology · Statistics 2026-04-07 Kairui Ding

The Backprop algorithm for learning in neural networks utilizes two mechanisms: first, stochastic gradient descent and second, initialization with small random weights, where the latter is essential to the effectiveness of the former. We…

Machine Learning · Computer Science 2022-05-06 Shibhansh Dohare , Richard S. Sutton , A. Rupam Mahmood

Self-paced learning and hard example mining re-weight training instances to improve learning accuracy. This paper presents two improved alternatives based on lightweight estimates of sample uncertainty in stochastic gradient descent (SGD):…

Machine Learning · Statistics 2018-01-09 Haw-Shiuan Chang , Erik Learned-Miller , Andrew McCallum

The discovery of structure from time series data is a key problem in fields of study working with complex systems. Most identifiability results and learning algorithms assume the underlying dynamics to be discrete in time. Comparatively…

Machine Learning · Statistics 2022-02-04 Alexis Bellot , Kim Branson , Mihaela van der Schaar

The sparse identification of nonlinear dynamical systems (SINDy) is a data-driven technique employed for uncovering and representing the fundamental dynamics of intricate systems based on observational data. However, a primary obstacle in…

Dynamical Systems · Mathematics 2025-09-23 Ali Forootani , Harshit Kapadia , Sridhar Chellappa , Pawan Goyal , Peter Benner