English
Related papers

Related papers: Learning Stiff Dynamical Operators: Scaling, Fast-…

200 papers

Estimation of parameters is a crucial part of model development. When models are deterministic, one can minimise the fitting error; for stochastic systems one must be more careful. Broadly parameterisation methods for stochastic dynamical…

Statistics Theory · Mathematics 2018-04-12 Asbjørn N. Riseth , Jake P. Taylor-King

Neural surrogates for stiff differential-algebraic equations (DAEs) face two barriers: soft-constraint methods leave algebraic residuals that stiffness amplifies into errors, and hard-constraint methods require trajectory data from stiff…

Machine Learning · Computer Science 2026-04-28 Huy Hoang Le , Haoguang Wang , Christian Moya , Marcos Netto , Guang Lin

Over the last few years, several works have proposed deep learning architectures to learn dynamical systems from observation data with no or little knowledge of the underlying physics. A line of work relies on learning representations where…

Machine Learning · Computer Science 2023-03-14 Anthony Frion , Lucas Drumetz , Mauro Dalla Mura , Guillaume Tochon , Abdeldjalil Aissa El Bey

This article underlines the learning and discrimination capabilities of a model of associative memory based on artificial networks of spiking neurons. Inspired from neuropsychology and neurobiology, the model implements top-down…

Neural and Evolutionary Computing · Computer Science 2016-08-16 Anthony Mouraud , Hélène Paugam-Moisy

Stiff dynamical systems present a challenge for machine-learning reduced-order models (ML-ROMs), as explicit time integration becomes unstable in stiff regimes while implicit integration within learning loops is computationally expensive…

Machine Learning · Computer Science 2026-03-19 Joe Standridge , Daniel Livescu , Paul Cizmas

Spiking Neural Network (SNN) naturally inspires hardware implementation as it is based on biology. For learning, spike time dependent plasticity (STDP) may be implemented using an energy efficient waveform superposition on memristor based…

Neural and Evolutionary Computing · Computer Science 2017-08-03 Aditya Shukla , Vinay Kumar , Udayan Ganguly

Concurrent estimation and control of robotic systems remains an ongoing challenge, where controllers rely on data extracted from states/parameters riddled with uncertainties and noises. Framework suitability hinges on task complexity and…

Robotics · Computer Science 2023-10-09 Reza Ahmadvand , Sarah Safura Sharif , Yaser Mike Banad

This work introduces and rigorously analyzes a novel operator-splitting finite element scheme for approximating viscosity solutions of a broad class of constrained second-order partial differential equations. By decoupling the primary PDE…

Numerical Analysis · Mathematics 2025-07-01 Po-Yi Wu

This paper describes the optimal selection of a control policy to program the steady state of controlled nonlinear systems with hyperbolic fixed points. This work is motivated by the field of synthetic biology, in which saddle points are…

Dynamical Systems · Mathematics 2020-06-11 Aqib Hasnain , Nibodh Boddupalli , Shara Balakrishnan , Enoch Yeung

Parametric differential equations of the form du/dt = f(u, x, t, p) are fundamental in science and engineering. While deep learning frameworks such as the Fourier Neural Operator (FNO) can efficiently approximate solutions, they struggle…

Machine Learning · Computer Science 2025-06-03 Abdolmehdi Behroozi , Chaopeng Shen and , Daniel Kifer

Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is…

This paper introduces Stress-Aware Learning, a resilient neural training paradigm in which deep neural networks dynamically adjust their optimization behavior - whether under stable training regimes or in settings with uncertain dynamics -…

Machine Learning · Computer Science 2025-08-04 Ashkan Shakarami , Yousef Yeganeh , Azade Farshad , Lorenzo Nicole , Stefano Ghidoni , Nassir Navab

Children possess the ability to learn multiple cognitive tasks sequentially, which is a major challenge toward the long-term goal of artificial general intelligence. Existing continual learning frameworks are usually applicable to Deep…

Artificial Intelligence · Computer Science 2023-08-10 Bing Han , Feifei Zhao , Yi Zeng , Wenxuan Pan , Guobin Shen

Deep Neural Networks trained in a fully supervised fashion are the dominant technology in perception-based autonomous driving systems. While collecting large amounts of unlabeled data is already a major undertaking, only a subset of it can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Elmar Haussmann , Michele Fenzi , Kashyap Chitta , Jan Ivanecky , Hanson Xu , Donna Roy , Akshita Mittel , Nicolas Koumchatzky , Clement Farabet , Jose M. Alvarez

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are based on semi-definite programming (\textit{SDP}), which is generally…

Machine Learning · Computer Science 2019-12-03 Ke Ma , Jinshan Zeng , Qianqian Xu , Xiaochun Cao , Wei Liu , Yuan Yao

Although the temporal spike dynamics of spiking neural networks (SNNs) enable low-power temporal pattern capture capabilities, they also incur inherent inconsistencies that severely compromise representation. In this paper, we perform dual…

Neural and Evolutionary Computing · Computer Science 2026-03-13 Yongqi Ding , Kunshan Yang , Linze Li , Yiyang Zhang , Mengmeng Jing , Lin Zuo

Learning-based control of linear systems received a lot of attentions recently. In popular settings, the true dynamical models are unknown to the decision-maker and need to be interactively learned by applying control inputs to the systems.…

Systems and Control · Electrical Eng. & Systems 2022-01-06 Mohamad Kazem Shirani Faradonbeh , Aditya Modi

Artificial Neural Networks (ANN) have gained significant popularity thanks to their ability to learn using the well-known backpropagation algorithm. Conversely, Spiking Neural Networks (SNNs), despite having broader capabilities than ANNs,…

Neural and Evolutionary Computing · Computer Science 2024-06-26 Sergio Davies , Andrew Gait , Andrew Rowley , Alessandro Di Nuovo

The reconstruction and inference of stochastic dynamical systems from data is a fundamental task in inverse problems and statistical learning. While surrogate modeling advances computational methods to approximate these dynamics, standard…

Optimization and Control · Mathematics 2026-04-14 Nicole Tianjiao Yang

Spiking Neural Networks are a recent and new neural network design approach that promises tremendous improvements in power efficiency, computation efficiency, and processing latency. They do so by using asynchronous spike-based data flow,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Sambit Mohapatra , Thomas Mesquida , Mona Hodaei , Senthil Yogamani , Heinrich Gotzig , Patrick Mader