English
Related papers

Related papers: Stable Invariant Models via Koopman Spectra

200 papers

Stiff dynamical systems represent a central challenge in multi scale modeling across combustion, chemical kinetics, and nonlinear dynamical systems. Neural operator learning has recently emerged as a promising approach to approximate…

Computational Physics · Physics 2026-01-06 Mauro Valorani

Generalized Linear Models (GLMs) and Single Index Models (SIMs) provide powerful generalizations of linear regression, where the target variable is assumed to be a (possibly unknown) 1-dimensional function of a linear predictor. In general,…

Artificial Intelligence · Computer Science 2011-04-14 Sham Kakade , Adam Tauman Kalai , Varun Kanade , Ohad Shamir

When neural networks are used to model dynamics, properties such as stability of the dynamics are generally not guaranteed. In contrast, there is a recent method for learning the dynamics of autonomous systems that guarantees global…

Machine Learning · Computer Science 2022-03-21 Kenji Kashima , Ryota Yoshiuchi , Yu Kawano

The received in-phase and quadrature (I/Q) baseband signals inherently encode physical-layer and channel characteristics of wireless links. Learning robust and transferable representations directly from such raw signals, however, remains…

Information Theory · Computer Science 2026-01-14 Namhyun Kim , Sadjad Alikhani , Ahmed Alkhateeb

Model-based deep learning (MoDL) algorithms that rely on unrolling are emerging as powerful tools for image recovery. In this work, we introduce a novel monotone operator learning framework to overcome some of the challenges associated with…

Machine Learning · Computer Science 2021-11-23 Aniket Pramanik , Mathews Jacob

Semi-implicit distributions have shown great promise in variational inference and generative modeling. Hierarchical semi-implicit models, which stack multiple semi-implicit layers, enhance the expressiveness of semi-implicit distributions…

Machine Learning · Statistics 2025-06-10 Longlin Yu , Jiajun Zha , Tong Yang , Tianyu Xie , Xiangyu Zhang , S. -H. Gary Chan , Cheng Zhang

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal sets to…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Dongdong Chen , Mike Davies , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Ferdia Sherry , Julián Tachella

The deployment of learning-based models in safety-critical control systems demands mathematical guarantees that standard regression architectures cannot provide. This paper presents an integrated framework that bridges Neural Ordinary…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Lin Feng , Xin He

Structured illumination microscopy (SIM) has become an important technique for optical super-resolution imaging because it allows a doubling of image resolution at speeds compatible for live-cell imaging. However, the reconstruction of SIM…

Image and Video Processing · Electrical Eng. & Systems 2020-03-26 Charles N. Christensen , Edward N. Ward , Pietro Lio , Clemens F. Kaminski

Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function. The accurate estimation (or discovery)…

Machine Learning · Computer Science 2025-10-22 Patrick Seifner , Kostadin Cvejoski , David Berghaus , Cesar Ojeda , Ramses J. Sanchez

The Method of Invariant Grid (MIG) is a model reduction technique based on the concept of slow invariant manifold (SIM), which approximates the SIM by a set of nodes in the concentration space (invariant grid). In the present work, the MIG…

Statistical Mechanics · Physics 2007-12-17 E. Chiavazzo , I. V. Karlin , C. E. Frouzakis , K. B. Boulouchos

Representations learnt through deep neural networks tend to be highly informative, but opaque in terms of what information they learn to encode. We introduce an approach to probabilistic modelling that learns to represent data with two…

Machine Learning · Statistics 2019-05-21 Ilya Feige

Permutation symmetries of deep networks make basic operations like model merging and similarity estimation challenging. In many cases, aligning the weights of the networks, i.e., finding optimal permutations between their weights, is…

Machine Learning · Computer Science 2024-11-12 Aviv Navon , Aviv Shamsian , Ethan Fetaya , Gal Chechik , Nadav Dym , Haggai Maron

Despite their impressive performance, contemporary neural networks often lack structural safeguards that promote stable learning and interpretable behavior. In this work, we introduce a reformulation of layer-level transformations that…

Machine Learning · Computer Science 2025-08-04 Saleh Nikooroo , Thomas Engel

Deep learning has been proposed as an efficient alternative for the numerical approximation of PDE solutions, offering fast, iterative simulation of PDEs through the approximation of solution operators. However, deep learning solutions have…

Machine Learning · Computer Science 2026-02-02 Sean Current , Chandan Kumar , Datta Gaitonde , Srinivasan Parthasarathy

We study delay-independent stability in nonlinear models with a distributed delay which have a positive equilibrium. Such models frequently occur in population dynamics and other applications. In particular, we construct a relevant…

Dynamical Systems · Mathematics 2009-01-12 Elena Braverman , Sergey Zhukovskiy

We propose and analyse a new Milstein type scheme for simulating stochastic differential equations (SDEs) with highly nonlinear coefficients. Our work is motivated by the need to justify multi-level Monte Carlo simulations for…

Numerical Analysis · Mathematics 2012-04-10 Desmond J. Higham , Xuerong Mao , Lukasz Szpruch

Model-based deep learning methods such as loop unrolling (LU) and deep equilibrium model}(DEQ) extensions offer outstanding performance in solving inverse problems (IP). These methods unroll the optimization iterations into a sequence of…

Machine Learning · Computer Science 2024-06-11 Peimeng Guan , Naveed Iqbal , Mark A. Davenport , Mudassir Masood

We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications…

Machine Learning · Computer Science 2021-03-30 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , Johan U. Backström , R. Bhushan Gopaluni

Distributions of data or sensory stimuli often enjoy underlying invariances. How and to what extent those symmetries are captured by unsupervised learning methods is a relevant question in machine learning and in computational neuroscience.…

Disordered Systems and Neural Networks · Physics 2020-06-24 Moshir Harsh , Jérôme Tubiana , Simona Cocco , Remi Monasson