English
Related papers

Related papers: Robust and optimal sparse regression for nonlinear…

200 papers

Dynamical systems are typically governed by a set of linear/nonlinear differential equations. Distilling the analytical form of these equations from very limited data remains intractable in many disciplines such as physics, biology, climate…

Machine Learning · Computer Science 2021-05-18 Fangzheng Sun , Yang Liu , Hao Sun

In order to extract governing equations from time-series data, various approaches are proposed. Among those, sparse identification of nonlinear dynamics (SINDy) stands out as a successful method capable of modeling governing equations with…

Signal Processing · Electrical Eng. & Systems 2024-06-07 Jinho Choi

Parameter estimation for non-stationary stochastic differential equations (SDE) with an arbitrary nonlinear drift, and nonlinear diffusion is accomplished in combination with a non-parametric clustering methodology. Such a model-based…

Optimization and Control · Mathematics 2021-09-07 Vyacheslav Boyko , Sebastian Krumscheid , Nikki Vercauteren

State estimation is required whenever we deal with high-dimensional dynamical systems, as the complete measurement is often unavailable. It is key to gaining insight, performing control or optimizing design tasks. Most deep learning-based…

Machine Learning · Computer Science 2022-03-15 Yash Kumar , Souvik Chakraborty

With the rapid increase of available data for complex systems, there is great interest in the extraction of physically relevant information from massive datasets. Recently, a framework called Sparse Identification of Nonlinear Dynamics…

Machine Learning · Statistics 2018-04-18 Lorenzo Boninsegna , Feliks Nüske , Cecilia Clementi

The data-driven models allow one to define the model structure in cases when a priori information is not sufficient to build other types of models. The possible way to obtain physical interpretation is the data-driven differential equation…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Michail Maslyaev , Alexander Hvatov , Anna Kalyuzhnaya

A new concept is introduced for the adaptive finite element discretization of partial differential equations that have a sparsely representable solution. Motivated by recent work on compressed sensing, a recursive mesh refinement procedure…

Numerical Analysis · Mathematics 2009-02-26 Sadegh Jokar , Volker Mehrmann , Marc Pfetsch , Harry Yserentant

Identifying governing equations from data is a critical step in the modeling and control of complex dynamical systems. Here, we investigate the data-driven identification of nonlinear dynamical systems with inputs and forcing using…

Dynamical Systems · Mathematics 2016-05-24 Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

Robust and sparse estimation of linear regression coefficients is investigated. The situation addressed by the present paper is that covariates and noises are sampled from heavy-tailed distributions, and the covariates and noises are…

Machine Learning · Statistics 2022-10-11 Takeyuki Sasai

In this note, we propose to use sparse methods (e.g. LASSO, Post-LASSO, sqrt-LASSO, and Post-sqrt-LASSO) to form first-stage predictions and estimate optimal instruments in linear instrumental variables (IV) models with many instruments in…

Methodology · Statistics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen

We present an optimization process to estimate parameters in systems of ordinary differential equations from chaotic time series. The optimization technique is based on a variational approach, and numerical studies on noisy time series…

Chaotic Dynamics · Physics 2014-07-31 Jose-Maria Fullana

In this paper, we consider the problem of learning prediction models for spatiotemporal physical processes driven by unknown partial differential equations (PDEs). We propose a deep learning framework that learns the underlying dynamics and…

Machine Learning · Statistics 2021-05-04 Priyabrata Saha , Saibal Mukhopadhyay

A functional (lagged) time series regression model involves the regression of scalar response time series on a time series of regressors that consists of a sequence of random functions. In practice, the underlying regressor curve time…

Methodology · Statistics 2020-07-28 Tomáš Rubín , Victor M. Panaretos

We develop an efficient and robust high-dimensional sparse Fourier algorithm for noisy samples. Earlier in the paper ``Multi-dimensional sublinear sparse Fourier algorithm" (2016), an efficient sparse Fourier algorithm with $\Theta(ds \log…

Numerical Analysis · Mathematics 2019-07-09 Bosu Choi , Andrew Christlieb , Yang Wang

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

Methodology · Statistics 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

In this thesis we study adaptive nonparametric regression with noise misspecification and the complexity of approximation of random fields in dependence of the dimension. First, we consider the problem of pointwise estimation in…

Statistics Theory · Mathematics 2012-08-15 Nora Serdyukova

We propose a new method for spatio-temporal forecasting on arbitrarily distributed points. Assuming that the observed system follows an unknown partial differential equation, we derive a continuous-time model for the dynamics of the data…

Machine Learning · Computer Science 2022-03-18 Marten Lienen , Stephan Günnemann

We consider the problem of estimating a deterministic sparse vector x from underdetermined measurements Ax+w, where w represents white Gaussian noise and A is a given deterministic dictionary. We analyze the performance of three sparse…

Statistics Theory · Mathematics 2015-05-13 Zvika Ben-Haim , Yonina C. Eldar , Michael Elad

In this work we present a data-driven method for the discovery of parametric partial differential equations (PDEs), thus allowing one to disambiguate between the underlying evolution equations and their parametric dependencies. Group…

Numerical Analysis · Mathematics 2018-06-05 Samuel Rudy , Alessandro Alla , Steven L. Brunton , J. Nathan Kutz