English
Related papers

Related papers: Using Noisy or Incomplete Data to Discover Models …

200 papers

Sparse system identification of nonlinear dynamic systems is still challenging, especially for stiff and high-order differential equations for noisy measurement data. The use of highly correlated functions makes distinguishing between true…

Computational Physics · Physics 2025-12-19 Ashish Pal , Sutanu Bhowmick , Satish Nagarajaiah

In spatially extended systems, it is common to find latent variables that are hard, or even impossible, to measure with acceptable precision, but are crucially important for the proper description of the dynamics. This substantially…

Numerical Analysis · Computer Science 2019-08-28 Patrick A. K. Reinbold , Roman O. Grigoriev

Stochastic differential equations (SDEs) are a ubiquitous modeling framework that finds applications in physics, biology, engineering, social science, and finance. Due to the availability of large-scale data sets, there is growing interest…

Machine Learning · Statistics 2025-03-04 Ziheng Guo , James Greene , Ming Zhong

This paper leverages recent advances in high derivatives reconstruction from noisy-time series and sparse multivariate polynomial identification in order to improve the process of parsimoniously identifying, from a small amount of data,…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Mazen Alamir

The ability to discover physical laws and governing equations from data is one of humankind's greatest intellectual achievements. A quantitative understanding of dynamic constraints and balances in nature has facilitated rapid development…

Dynamical Systems · Mathematics 2016-04-27 Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

High-dimensional time series data exist in numerous areas such as finance, genomics, healthcare, and neuroscience. An unavoidable aspect of all such datasets is missing data, and dealing with this issue has been an important focus in…

Machine Learning · Statistics 2018-02-27 Amin Jalali , Rebecca Willett

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

Discovering governing equations of complex dynamical systems directly from data is a central problem in scientific machine learning. In recent years, the sparse identification of nonlinear dynamics (SINDy) framework, powered by heuristic…

Machine Learning · Computer Science 2022-06-02 Dimitris Bertsimas , Wes Gurnee

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

Data-driven discovery of partial differential equations (PDEs) from observed data in machine learning has been developed by embedding the discovery problem. Recently, the discovery of traditional ODEs dynamics using linear multistep methods…

Numerical Analysis · Mathematics 2023-06-27 Xingjian Xu , Minghua Chen

High-dimensional time series datasets are becoming increasingly common in many areas of biological and social sciences. Some important applications include gene regulatory network reconstruction using time course gene expression data, brain…

Methodology · Statistics 2021-08-02 Sumanta Basu , David S. Matteson

We consider high dimensional sparse regression, and develop strategies able to deal with arbitrary -- possibly, severe or coordinated -- errors in the covariance matrix $X$. These may come from corrupted data, persistent experimental…

Machine Learning · Statistics 2013-01-15 Yudong Chen , Constantine Caramanis , Shie Mannor

Scientific measurements are often bottlenecked by suboptimal conditions, whether that be noise, incomplete spatial coverage, or limited resolution, rendering accurate field reconstruction a difficult task. We introduce LatentPDE, a latent…

Machine Learning · Computer Science 2026-04-28 Valerie Tsao , Nathaniel Chaney , Manolis Veveakis

The identification of Partial Differential Equations (PDEs) has emerged as a prominent data-driven approach for mathematical modeling and has attracted considerable attention in recent years. The stability and precision in identifying PDE…

Numerical Analysis · Mathematics 2026-03-11 Cheng Tang , Roy Y. He , Hao Liu

Sparse functional/longitudinal data have attracted widespread interest due to the prevalence of such data in social and life sciences. A prominent scenario where such data are routinely encountered are accelerated longitudinal studies,…

Methodology · Statistics 2024-06-24 Yidong Zhou , Hans-Georg Müller

This paper presents a novel machine-learning framework for reconstructing low-order gust-encounter flow field and lift coefficients from sparse, noisy surface pressure measurements. Our study thoroughly investigates the time-varying…

Machine Learning · Computer Science 2025-06-25 Hanieh Mousavi , Jeff D. Eldredge

The sparse pseudo-input Gaussian process (SPGP) is a new approximation method for speeding up GP regression in the case of a large number of data points N. The approximation is controlled by the gradient optimization of a small set of M…

Machine Learning · Computer Science 2012-07-02 Edward Snelson , Zoubin Ghahramani

In recent years, data-driven methods have been developed to learn dynamical systems and partial differential equations (PDE). The goal of such work is discovering unknown physics and the corresponding equations. However, prior to achieving…

Machine Learning · Statistics 2021-02-17 Hao Xu , Haibin Chang , Dongxiao Zhang

Identifying the governing equations of a nonlinear dynamical system is key to both understanding the physical features of the system and constructing an accurate model of the dynamics that generalizes well beyond the available data. We…

Machine Learning · Computer Science 2022-08-16 Peter Y. Lu , Joan Ariño , Marin Soljačić

Accurate and concise governing equations are crucial for understanding system dynamics. Recently, data-driven methods such as sparse regression have been employed to automatically uncover governing equations from data, representing a…

Machine Learning · Computer Science 2025-08-05 Boqian Zhang , Juanmian Lei , Guoyou Sun , Shuaibing Ding , Jian Guo