English
Related papers

Related papers: A Weak Penalty Neural ODE for Learning Chaotic Dyn…

200 papers

Causal inference in continuous-time sequential decision problems is challenged by hidden confounders. We show that, in latent state-space models with time-varying interventions, observability of the latent dynamics from observed data is…

Machine Learning · Computer Science 2026-05-14 Jennifer Wendland , Nicolas Freitag , Maik Kschischo

We introduce a Noise-based prior Learning (NoL) approach for training neural networks that are intrinsically robust to adversarial attacks. We find that the implicit generative modeling of random noise with the same loss function used…

Machine Learning · Computer Science 2019-06-04 Priyadarshini Panda , Kaushik Roy

We introduce an unsupervised formulation to estimate heteroscedastic uncertainty in retrieval systems. We propose an extension to triplet loss that models data uncertainty for each input. Besides improving performance, our formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data. However, every…

Machine Learning · Computer Science 2023-01-02 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, current NO-based…

Machine Learning · Computer Science 2024-03-18 Ashutosh Singh , Ricardo Augusto Borsoi , Deniz Erdogmus , Tales Imbiriba

Sparse system identification of nonlinear dynamic systems is still challenging, especially for stiff and high-order differential equations for noisy measurement data. The use of highly correlated functions makes distinguishing between true…

Computational Physics · Physics 2025-12-19 Ashish Pal , Sutanu Bhowmick , Satish Nagarajaiah

This paper is centered around the approximation of dynamical systems by means of Gaussian processes. To this end, trajectories of such systems must be collected to be used as training data. The measurements of these trajectories are…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Tobias M. Wolff , Victor G. Lopez , Matthias A. Müller

This note presents a unified analysis of the identification of dynamical systems with low-rank constraints under high-dimensional scaling. This identification problem for dynamic systems are challenging due to the intrinsic dependency of…

Statistics Theory · Mathematics 2019-12-23 Junlin Li

Penalized likelihood models are widely used to simultaneously select variables and estimate model parameters. However, the existence of weak signals can lead to inaccurate variable selection, biased parameter estimation, and invalid…

Methodology · Statistics 2022-12-13 Yuexia Zhang , Peibei Shi , Zhongyi Zhu , Linbo Wang , Annie Qu

We present a novel approach (DyNODE) that captures the underlying dynamics of a system by incorporating control in a neural ordinary differential equation framework. We conduct a systematic evaluation and comparison of our method and…

Machine Learning · Computer Science 2020-09-10 Victor M. Martinez Alvarez , Rareş Roşca , Cristian G. Fălcuţescu

Previous preliminary results on the application of knowledge networks to noise reduction in stationary harmonic and weakly chaotic signals are extended to more general cases. The formalism gives a novel algorithm from which statistical…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Arturo Berrones

We study filtering of multiscale dynamical systems with model error arising from unresolved smaller scale processes. The analysis assumes continuous-time noisy observations of all components of the slow variables alone. For a linear model…

Dynamical Systems · Mathematics 2014-12-03 Tyrus Berry , John Harlim

The objective function of a matrix factorization model usually aims to minimize the average of a regression error contributed by each element. However, given the existence of stochastic noises, the implicit deviations of sample data from…

Machine Learning · Computer Science 2016-10-31 Guang-He Lee , Shao-Wen Yang , Shou-De Lin

This paper develops a direct data-driven framework for constructing reduced-order models (ROMs) of discrete-time linear dynamical systems with unknown dynamics and process disturbances. The proposed scheme enables controller synthesis on…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Behrad Samari , Henrik Sandberg , Karl H. Johansson , Abolfazl Lavaei

This work proposes a Stochastic Variational Deep Kernel Learning method for the data-driven discovery of low-dimensional dynamical models from high-dimensional noisy data. The framework is composed of an encoder that compresses…

Machine Learning · Computer Science 2023-06-28 Nicolò Botteghi , Mengwu Guo , Christoph Brune

Machine learning offers an intriguing alternative to first-principles analysis for discovering new physics from experimental data. However, to date, purely data-driven methods have only proven successful in uncovering physical laws…

A general many quantiles + noise model is studied in the robust formulation (allowing non-normal, non-independent observations), where the identifiability requirement for the noise is formulated in terms of quantiles rather than the…

Statistics Theory · Mathematics 2022-11-21 Eduard Belitser , Paulo Serra , Alexandra Vegelien

Kalman filter is a key tool for time-series forecasting and analysis. We show that the dependence of a prediction of Kalman filter on the past is decaying exponentially, whenever the process noise is non-degenerate. Therefore, Kalman filter…

Statistics Theory · Mathematics 2019-09-24 Mark Kozdoba , Jakub Marecek , Tigran Tchrakian , Shie Mannor

To predict rare extreme events using deep neural networks, one encounters the so-called small data problem because even long-term observations often contain few extreme events. Here, we investigate a model-assisted framework where the…

Machine Learning · Computer Science 2022-04-20 Anna Asch , Ethan Brady , Hugo Gallardo , John Hood , Bryan Chu , Mohammad Farazmand

This paper considers the Linear Quadratic Regulator problem for linear systems with unknown dynamics, a central problem in data-driven control and reinforcement learning. We propose a method that uses data to directly return a controller…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Claudio De Persis , Pietro Tesi