English
Related papers

Related papers: Using Noisy or Incomplete Data to Discover Models …

200 papers

Learning vector autoregressive models from multivariate time series is conventionally approached through least squares or maximum likelihood estimation. These methods typically assume a fully connected model which provides no direct insight…

Computation · Statistics 2021-09-24 Kimmo Suotsalo , Yingying Xu , Jukka Corander , Johan Pensar

We introduce a novel grid-independent model for learning partial differential equations (PDEs) from noisy and partial observations on irregular spatiotemporal grids. We propose a space-time continuous latent neural PDE model with an…

Machine Learning · Computer Science 2023-10-27 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki

We develop an efficient and robust high-dimensional sparse Fourier algorithm for noisy samples. Earlier in the paper ``Multi-dimensional sublinear sparse Fourier algorithm" (2016), an efficient sparse Fourier algorithm with $\Theta(ds \log…

Numerical Analysis · Mathematics 2019-07-09 Bosu Choi , Andrew Christlieb , Yang Wang

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

In many applications, flow measurements are usually sparse and possibly noisy. The reconstruction of a high-resolution flow field from limited and imperfect flow information is significant yet challenging. In this work, we propose an…

Computational Physics · Physics 2020-01-17 Luning Sun , Jian-Xun Wang

Reconstructing high derivatives of noisy measurements is an important step in many control, identification and diagnosis problems. In this paper, a heuristic is proposed to address this challenging issue. The framework is based on a…

Systems and Control · Electrical Eng. & Systems 2025-03-10 Mazen Alamir

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

We consider the data-driven discovery of governing equations from time-series data in the limit of high noise. The algorithms developed describe an extensive toolkit of methods for circumventing the deleterious effects of noise in the…

Machine Learning · Computer Science 2022-01-03 Charles B. Delahunt , J. Nathan Kutz

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

Methodology · Statistics 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

In order to extract governing equations from time-series data, various approaches are proposed. Among those, sparse identification of nonlinear dynamics (SINDy) stands out as a successful method capable of modeling governing equations with…

Signal Processing · Electrical Eng. & Systems 2024-06-07 Jinho Choi

Generating dense physical fields from sparse measurements is a fundamental question in sampling, signal processing, and many other applications. State-of-the-art methods either use spatial statistics or rely on examples of dense fields in…

Machine Learning · Statistics 2026-01-29 Ofek Aloni , Barak Fishbain

Partial differential equations (PDEs) that fit scientific data can represent physical laws with explainable mechanisms for various mathematically-oriented subjects, such as physics and finance. The data-driven discovery of PDEs from…

Machine Learning · Computer Science 2023-05-29 Yingtao Luo , Qiang Liu , Yuntian Chen , Wenbo Hu , Tian Tian , Jun Zhu

In many problems of data-driven modeling for dynamical systems, the governing equations are not known a priori and must be selected phenomenologically from a large set of candidate interactions and basis functions. In such situations, point…

Applications · Statistics 2026-04-14 Shuhei Kashiwamura , Yusuke Kato , Hiroshi Kori , Masato Okada

A new algorithm is presented for reconstructing stochastic nonlinear dynamical models from noisy time-series data. The approach is analytical; consequently, the resulting algorithm does not require an extensive global search for the model…

Other Condensed Matter · Physics 2009-11-10 V. N. Smelyanskiy , D. G. Luchinsky , D. A. Timucin , A. Bandrivskyy

We consider the problem of estimating an unknown coordinate-wise monotone function given noisy measurements, known as the isotonic regression problem. Often, only a small subset of the features affects the output. This motivates the sparse…

Statistics Theory · Mathematics 2019-07-04 David Gamarnik , Julia Gaudio

Predicting the behavior of complex systems is critical in many scientific and engineering domains, and hinges on the model's ability to capture their underlying dynamics. Existing methods encode the intrinsic dynamics of high-dimensional…

Computational Engineering, Finance, and Science · Computer Science 2025-11-18 Jingwen Cheng , Ruikun Li , Huandong Wang , Yong Li

In many applications it is important to estimate a fluid flow field from limited and possibly corrupt measurements. Current methods in flow estimation often use least squares regression to reconstruct the flow field, finding the…

Fluid Dynamics · Physics 2019-11-06 Jared Callaham , Kazuki Maeda , Steven L. Brunton

Sparse Identification of Nonlinear Dynamical Systems (SINDy) is a powerful tool for the data-driven discovery of governing equations. However, it encounters challenges when modeling complex dynamical systems involving high-order derivatives…

Dynamical Systems · Mathematics 2024-11-05 Haoyang Zheng , Guang Lin

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

Machine Learning · Statistics 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

This paper proposes a fast and accurate method for sparse regression in the presence of missing data. The underlying statistical model encapsulates the low-dimensional structure of the incomplete data matrix and the sparsity of the…

Machine Learning · Statistics 2015-03-31 Ravi Ganti , Rebecca M. Willett