English
Related papers

Related papers: Data-driven discovery of coordinates and governing…

200 papers

This paper introduces an efficient and robust method for discovering interpretable circuits in large language models using discrete sparse autoencoders. Our approach addresses key limitations of existing techniques, namely computational…

Computation and Language · Computer Science 2024-05-22 Charles O'Neill , Thang Bui

Autoencoders are a prominent model in many empirical branches of machine learning and lossy data compression. However, basic theoretical questions remain unanswered even in a shallow two-layer setting. In particular, to what degree does a…

Machine Learning · Computer Science 2024-02-08 Kevin Kögler , Alexander Shevchenko , Hamed Hassani , Marco Mondelli

Many low-mass stars like the Sun host periodic, oscillatory magnetic fields that lead to variable levels of stellar activity, driving space weather that affects the habitability and detection of exoplanets. Owing to the intrinsic difficulty…

Solar and Stellar Astrophysics · Physics 2026-04-01 Anna Guseva , Calum Skene , Steve Tobias

Sparse dictionary coding represents signals as linear combinations of a few dictionary atoms. It has been applied to images, time series, graph signals and multi-way spatio-temporal data by jointly employing temporal and spatial…

Machine Learning · Computer Science 2025-09-15 Boya Ma , Abram Magner , Maxwell McNeil , Petko Bogdanov

We propose sparse regression as an alternative to neural networks for the discovery of parsimonious constitutive models (CMs) from oscillatory shear experiments. Symmetry and frame-invariance are strictly imposed by using tensor basis…

Soft Condensed Matter · Physics 2024-08-21 Sachin Shanbhag , Gordon Erlebacher

Effectively modeling phenomena present in highly nonlinear dynamical systems whilst also accurately quantifying uncertainty is a challenging task, which often requires problem-specific techniques. We present a novel, domain-agnostic…

Machine Learning · Statistics 2021-10-26 Thomas M. McDonald , Mauricio A. Álvarez

This work leverages laser vibrometry and the weak form of the sparse identification of nonlinear dynamics (WSINDy) for partial differential equations to learn macroscale governing equations from full-field experimental data. In the…

Numerical Analysis · Mathematics 2024-10-01 Abigail C. Schmid , Alireza Doostan , Fatemeh Pourahmadian

This work investigates model reduction techniques for nonlinear parameterized and time-dependent PDEs, specifically focusing on bifurcating phenomena in Computational Fluid Dynamics (CFD). We develop interpretable and non-intrusive Reduced…

Numerical Analysis · Mathematics 2025-12-01 Lorenzo Tomada , Moaad Khamlich , Federico Pichi , Gianluigi Rozza

Machine learning (ML) is redefining what is possible in data-intensive fields of science and engineering. However, applying ML to problems in the physical sciences comes with a unique set of challenges: scientists want physically…

Computational Physics · Physics 2020-07-06 Kathleen Champion , Peng Zheng , Aleksandr Y. Aravkin , Steven L. Brunton , J. Nathan Kutz

System identification of complex and nonlinear systems is a central problem for model predictive control and model-based reinforcement learning. Despite their complexity, such systems can often be approximated well by a set of linear…

Machine Learning · Statistics 2019-05-30 Philip Becker-Ehmck , Jan Peters , Patrick van der Smagt

Modeling multivariate time series as temporal signals over a (possibly dynamic) graph is an effective representational framework that allows for developing models for time series analysis. In fact, discrete sequences of graphs can be…

Machine Learning · Computer Science 2022-10-11 Ivan Marisca , Andrea Cini , Cesare Alippi

Unsupervised discovery of latent representations, in addition to being useful for density modeling, visualisation and exploratory data analysis, is also increasingly important for learning features relevant to discriminative tasks.…

Machine Learning · Statistics 2011-10-27 Jasper Snoek , Ryan Prescott Adams , Hugo Larochelle

Large scale dynamical systems (e.g. many nonlinear coupled differential equations) can often be summarized in terms of only a few state variables (a few equations), a trait that reduces complexity and facilitates exploration of behavioral…

Networks are landmarks of many complex phenomena where interweaving interactions between different agents transform simple local rule-sets into nonlinear emergent behaviors. While some recent studies unveil associations between the network…

Social and Information Networks · Computer Science 2021-08-05 Ali Tavasoli , Teague Henry , Heman Shakeri

Structural monitoring for complex built environments often suffers from mismatch between design, laboratory testing, and actual built parameters. Additionally, real-world structural identification problems encounter many challenges. For…

Machine Learning · Computer Science 2022-08-29 Xuyang Li , Hamed Bolandi , Talal Salem , Nizar Lajnef , Vishnu Naresh Boddeti

It is commonplace to encounter heterogeneous or nonstationary data, of which the underlying generating process changes across domains or over time. Such a distribution shift feature presents both challenges and opportunities for causal…

Machine Learning · Computer Science 2020-06-26 Biwei Huang , Kun Zhang , Jiji Zhang , Joseph Ramsey , Ruben Sanchez-Romero , Clark Glymour , Bernhard Schölkopf

Data-driven methodologies are nowadays ubiquitous. Their rapid development and spread have led to applications even beyond the traditional fields of science. As far as dynamical systems and differential equations are concerned, neural…

Numerical Analysis · Mathematics 2025-12-05 Dimitri Breda , Xunbi A. Ji , Gábor Orosz , Muhammad Tanveer

In todays age of data, discovering relationships between different variables is an interesting and a challenging problem. This problem becomes even more critical with regards to complex dynamical systems like weather forecasting and…

Data Analysis, Statistics and Probability · Physics 2021-02-01 Sachin Kasture

Physics-constrained data-driven computing is an emerging computational paradigm that allows simulation of complex materials directly based on material database and bypass the classical constitutive model construction. However, it remains…

Numerical Analysis · Mathematics 2022-09-12 Xiaolong He , Qizhi He , Jiun-Shyan Chen

PDE discovery shows promise for uncovering predictive models of complex physical systems but has difficulty when measurements are sparse and noisy. We introduce a new approach for PDE discovery that uses two Rational Neural Networks and a…

Machine Learning · Computer Science 2022-06-20 Robert Stephany , Christopher Earls