English
Related papers

Related papers: From Models To Experiments: Shallow Recurrent Deco…

200 papers

Elements composing complex systems usually interact in several different ways and as such the interaction architecture is well modelled by a multiplex network. However often this architecture is hidden, as one usually only has experimental…

We explore the relationship among model fidelity, experimental design, and parameter estimation in sloppy models. We show that the approximate nature of mathematical models poses challenges for experimental design in sloppy models. In many…

Quantitative Methods · Quantitative Biology 2017-02-08 Andrew White , Malachi Tolman , Howard D. Thames , Hubert Rodney Withers , Kathy A. Mason , Mark K. Transtrum

Reconstructing flow fields from sparse measurements is a fundamental problem in fluid mechanics with broad implications for modeling, control, and design. In this work, we propose a novel operator learning framework that leverages the…

Computational Engineering, Finance, and Science · Computer Science 2026-05-25 Qian Zhang , George Em Karniadakis

Unpredictable sensor-to-estimator delays fundamentally distort what matters for wireless remote state estimation: not just freshness, but how delay interacts with sensor informativeness and energy efficiency. In this paper, we present a…

Information Theory · Computer Science 2026-01-30 Nho-Duc Tran , Aamir Mahmood , Mikael Gidlund

In this paper, we adapt Recurrent Neural Networks with Stochastic Layers, which are the state-of-the-art for generating text, music and speech, to the problem of acoustic novelty detection. By integrating uncertainty into the hidden states,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-24 Duong Nguyen , Oliver S. Kirsebom , Fábio Frazão , Ronan Fablet , Stan Matwin

Linear Recurrent Neural Networks (linear RNNs) have emerged as competitive alternatives to Transformers for sequence modeling, offering efficient training and linear-time inference. However, existing architectures face a fundamental…

Machine Learning · Computer Science 2025-10-24 Julien Siems , Timur Carstensen , Arber Zela , Frank Hutter , Massimiliano Pontil , Riccardo Grazzi

Linear recurrent networks (LRNNs) and linear state space models (SSMs) promise computational and memory efficiency on long-sequence modeling tasks, yet their diagonal state transitions limit expressivity. Dense and nonlinear architectures…

Machine Learning · Computer Science 2026-03-03 Igor Dubinin , Antonio Orvieto , Felix Effenberger

The formation of secondary structures by a random RNA sequence is studied as a model system for the sequence-structure problem omnipresent in biopolymers. Several toy energy models are introduced to allow detailed analytical and numerical…

Statistical Mechanics · Physics 2009-11-07 R. Bundschuh , T. Hwa

We investigate recurrent neural networks with asymmetric interactions and demonstrate that the inclusion of self-couplings or sparse excitatory inter-module connections leads to the emergence of a densely connected manifold of dynamically…

Disordered Systems and Neural Networks · Physics 2026-01-01 Davide Badalotti , Carlo Baldassi , Marc Mézard , Mattia Scardecchia , Riccardo Zecchina

Highly accurate simulations of complex phenomena governed by partial differential equations (PDEs) typically require intrusive methods and entail expensive computational costs, which might become prohibitive when approximating steady-state…

Machine Learning · Computer Science 2023-05-17 Paolo Conti , Giorgio Gobat , Stefania Fresca , Andrea Manzoni , Attilio Frangi

Deep convection is one of the most important atmospheric transport mechanisms and associated with various severe weather phenomena. Manifestations of deep convection in the atmosphere are composed of a recurring fundamental building block,…

Atmospheric and Oceanic Physics · Physics 2024-10-29 Tobias Bölle , Christoph Metzl , Kianusch Vahid Yousefnia

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

Machine Learning · Computer Science 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

This paper presents a new exploration into a category of diffusion models built upon state space architecture. We endeavor to train diffusion models for image data, wherein the traditional U-Net backbone is supplanted by a state space…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zhengcong Fei , Mingyuan Fan , Changqian Yu , Junshi Huang

Latent dynamical models are commonly used to learn the distribution of a latent dynamical process that represents a sequence of noisy data samples. However, producing samples from such models with high fidelity is challenging due to the…

Machine Learning · Computer Science 2023-08-17 Mohammad R. Rezaei

Reaction-diffusion models are widely used to study spatially-extended chemical reaction systems. In order to understand how the dynamics of a reaction-diffusion model are affected by changes in its input parameters, efficient methods for…

Quantitative Methods · Quantitative Biology 2017-03-08 Christopher Lester , Christian A. Yates , Ruth E. Baker

Dense random sampling and surfacing of shapes encoded via implicit occupancy functions (OFs) are critical elements of many applications. Existing methods largely provide either one or the other of random sampling or mesh surfaces: ray…

Graphics · Computer Science 2026-05-06 Suzuran Takikawa , Leo Foord-Kelcey , Oliver Oxford , Nicholas Vining , Alla Sheffer

Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces…

Chaotic Dynamics · Physics 2020-05-19 Allen G Hart , James L Hook , Jonathan H P Dawes

A spatially distributed system contains a large amount of agents with limited sensing, data processing, and communication capabilities. Recent technological advances have opened up possibilities to deploy spatially distributed systems for…

Information Theory · Computer Science 2015-11-30 Cheng Cheng , Yingchun Jiang , Qiyu Sun

Contagions such as the spread of popular news stories, or infectious diseases, propagate in cascades over dynamic networks with unobservable topologies. However, "social signals" such as product purchase time, or blog entry timestamps are…

Machine Learning · Statistics 2016-12-21 Brian Baingana , Georgios B. Giannakis

Structural resonance involves the absorption of inertial loads by a tuned structural elasticity: a process playing a key role in a wide range of biological and technological systems, including many biological and bio-inspired locomotion…

Pattern Formation and Solitons · Physics 2023-07-20 Arion Pons , Tsevi Beatus