English
Related papers

Related papers: Sparse Identification of Slow Timescale Dynamics

200 papers

Automatic machine learning of empirical models from experimental data has recently become possible as a result of increased availability of computational power and dedicated algorithms. Despite the successes of non-parametric inference and…

Statistical Mechanics · Physics 2024-06-04 Yunfei Huang , Youssef Mabrouk , Gerhard Gompper , Benedikt Sabass

We present a numerical method for learning the dynamics of slow components of unknown multiscale stochastic dynamical systems. While the governing equations of the systems are unknown, bursts of observation data of the slow variables are…

Machine Learning · Computer Science 2024-08-28 Yuan Chen , Dongbin Xiu

High-dimensional time series datasets are becoming increasingly common in many areas of biological and social sciences. Some important applications include gene regulatory network reconstruction using time course gene expression data, brain…

Methodology · Statistics 2021-08-02 Sumanta Basu , David S. Matteson

A powerful approach for understanding neural population dynamics is to extract low-dimensional trajectories from population recordings using dimensionality reduction methods. Current approaches for dimensionality reduction on neural data…

Machine Learning · Statistics 2017-11-07 Marcel Nonnenmacher , Srinivas C. Turaga , Jakob H. Macke

Temporal variations in biological systems and more generally in natural sciences are typically modelled as a set of Ordinary, Partial, or Stochastic Differential or Difference Equations. Algorithms for learning the structure and the…

Molecular Networks · Quantitative Biology 2019-01-23 Yannis Pantazis , Ioannis Tsamardinos

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is done by solving an l_1-regularized linear regression problem, usually called Lasso. In this work we first combine the…

Information Theory · Computer Science 2010-03-02 Pablo Sprechmann , Ignacio Ramirez , Guillermo Sapiro , Yonina C. Eldar

In this work, we introduce a novel approach for determining a joint sparse spectrum from several non-uniformly sampled data sets, where each data set is assumed to have its own, possibly disjoint, and only partially known, sampling times.…

Signal Processing · Electrical Eng. & Systems 2021-10-07 David Svedberg , Filip Elvander , Andreas Jakobsson

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

Sparse model selection is ubiquitous from linear regression to graphical models where regularization paths, as a family of estimators upon the regularization parameter varying, are computed when the regularization parameter is unknown or…

Machine Learning · Statistics 2018-10-10 Chendi Huang , Yuan Yao

Discovering nonlinear differential equations that describe system dynamics from empirical data is a fundamental challenge in contemporary science. Here, we propose a methodology to identify dynamical laws by integrating denoising techniques…

Machine Learning · Computer Science 2023-05-04 Kevin Egan , Weizhen Li , Rui Carvalho

In the first part of the series papers, we set out to answer the following question: given specific restrictions on a set of samplers, what kind of signal can be uniquely represented by the corresponding samples attained, as the foundation…

Information Theory · Computer Science 2021-08-25 Hanshen Xiao , Yaowen Zhang , Guoqiang Xiao

In order to extract governing equations from time-series data, various approaches are proposed. Among those, sparse identification of nonlinear dynamics (SINDy) stands out as a successful method capable of modeling governing equations with…

Signal Processing · Electrical Eng. & Systems 2024-06-07 Jinho Choi

Many signal and image processing applications have benefited remarkably from the fact that the underlying signals reside in a low dimensional subspace. One of the main models for such a low dimensionality is the sparsity one. Within this…

Information Theory · Computer Science 2015-03-25 Raja Giryes

Many applications of contemporary science involve multiscale dynamics, which are typically characterized by the time and space scale separation of patterns of motion, with fewer slowly evolving variables and much larger set of faster…

Dynamical Systems · Mathematics 2016-04-08 Rafail V. Abramov

We investigate the approximate dynamics of several differential equations when the solutions are restricted to a sparse subset of a given basis. The restriction is enforced at every time step by simply applying soft thresholding to the…

Numerical Analysis · Mathematics 2015-06-12 Hayden Schaeffer , Stanley Osher , Russel Caflisch , Cory Hauck

We address the problem of learning the dynamics of an unknown non-parametric system linking a target and a feature time series. The feature time series is measured on a sparse and irregular grid, while we have access to only a few points of…

Machine Learning · Statistics 2023-06-01 Linus Bleistein , Adeline Fermanian , Anne-Sophie Jannot , Agathe Guilloux

Understanding the dynamics of complex systems is a central task in many different areas ranging form biology via epidemics to economics and engineering. Unexpected behaviour of dynamic systems or even systems failure is sometimes difficult…

Optimization and Control · Mathematics 2020-06-11 Dominik Kahl , Andreas Weber , Maik Kschischo

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

Methodology · Statistics 2022-10-14 Erik Spånberg