English
Related papers

Related papers: Data-driven parameterization of the generalized La…

200 papers

We introduce an evidence-driven Bayesian formulation of physics-informed neural networks that enables automatic optimization of loss weights between PDE residuals, boundary conditions, and observational data. Unlike existing Bayesian PINN…

Computational Physics · Physics 2026-05-29 Krzysztof M. Graczyk , Kornel Witkowski

In molecular dynamics simulations, dynamically consistent coarse-grained (CG) models commonly use stochastic thermostats to model friction and fluctuations that are lost in a CG description. While Markovian, i.e., time-local, formulations…

Statistical Mechanics · Physics 2024-06-24 V. Klippenstein , N. Wolf , N. F. A. van der Vegt

Previous results pertaining to algebraic state and parameter estimation of linear systems based on a special construction of a forward-backward kernel representation of linear differential invariants are extended to handle large noise in…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Debarshi Patanjali Ghoshal , Hannah Michalska

When nano-magnets are coupled to random external sources, their magnetization becomes a random variable, whose properties are defined by an induced probability density, that can be reconstructed from its moments, using the Langevin…

Statistical Mechanics · Physics 2017-03-21 Stam Nicolis , Pascal Thibaudeau , Julien Tranchida

It is a well-known fact that adding noise to the input data often improves network performance. While the dropout technique may be a cause of memory loss, when it is applied to recurrent connections, Tikhonov regularization, which can be…

Machine Learning · Computer Science 2017-08-11 Andrei Turkin

We propose a general framework for reduced-rank modeling of matrix-valued data. By applying a generalized nuclear norm penalty we can directly model low-dimensional latent variables associated with rows and columns. Our framework flexibly…

Machine Learning · Statistics 2017-08-23 William Fithian , Rahul Mazumder

We consider the asymptotic behaviour of the fluctuation process for large stochastic systems of interacting particles driven by both idiosyncratic and common noise with an interaction kernel \(k \in L^2(\R^d) \cap L^\infty(\R^d)\). Our…

Probability · Mathematics 2026-05-28 Paul Nikolaev

High-dimensional regression often suffers from heavy-tailed noise and outliers, which can severely undermine the reliability of least-squares based methods. To improve robustness, we adopt a non-smooth Wilcoxon score based rank objective…

Machine Learning · Statistics 2026-01-29 Meixia Lin , Meijiao Shi , Yunhai Xiao , Qian Zhang

A data-driven ab initio generalized Langevin equation (AIGLE) approach is developed to learn and simulate high-dimensional, heterogeneous, coarse-grained conformational dynamics. Constrained by the fluctuation-dissipation theorem, the…

Biological Physics · Physics 2024-09-13 Pinchen Xie , Yunrui Qiu , Weinan E

Kernel random matrices have attracted a lot of interest in recent years, from both practical and theoretical standpoints. Most of the theoretical work so far has focused on the case were the data is sampled from a low-dimensional structure.…

Statistics Theory · Mathematics 2010-11-12 Noureddine El Karoui

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

We present an efficient coresets-based neural network compression algorithm that sparsifies the parameters of a trained fully-connected neural network in a manner that provably approximates the network's output. Our approach is based on an…

Machine Learning · Computer Science 2019-05-21 Cenk Baykal , Lucas Liebenwein , Igor Gilitschenski , Dan Feldman , Daniela Rus

It is by now well-established that modern over-parameterized models seem to elude the bias-variance tradeoff and generalize well despite overfitting noise. Many recent works attempt to analyze this phenomenon in the relatively tractable…

Machine Learning · Computer Science 2024-02-21 Daniel Barzilai , Ohad Shamir

The present work concerns the transferability of coarse-grained (CG) modeling in reproducing the dynamic properties of the reference atomistic systems across a range of parameters. In particular, we focus on implicit-solvent CG modeling of…

Computational Engineering, Finance, and Science · Computer Science 2021-03-22 Zhan Ma , Shu Wang , Minhee Kim , Kaibo Liu , Chun-Long Chen , Wenxiao Pan

This paper discusses the estimation of the generalization gap, the difference between generalization performance and training performance, for overparameterized models including neural networks. We first show that a functional variance, a…

Machine Learning · Statistics 2023-03-21 Akifumi Okuno , Keisuke Yano

Data-driven control algorithms use observations of system dynamics to construct an implicit model for the purpose of control. However, in practice, data-driven techniques often require excessive sample sizes, which may be infeasible in…

Systems and Control · Electrical Eng. & Systems 2023-01-10 Adam J. Thorpe , Cyrus Neary , Franck Djeumou , Meeko M. K. Oishi , Ufuk Topcu

We propose a scalable, approximate inference hypernetwork framework for a general model of history-dependent processes. The flexible data model is based on a neural ordinary differential equation (NODE) representing the evolution of…

A continuous approximation framework for non-linear stochastic as well as deterministic discrete maps is developed. For the stochastic map with uncorelated Gaussian noise, by successively applying the It\^o lemma, we obtain a Langevin type…

Statistical Mechanics · Physics 2017-10-25 David A. Kessler , Stanislav Burov

A formulation of Langevin dynamics for discrete systems is derived as a class of generic stochastic processes. The dynamics simplify for a two-state system and suggest a network architecture which is implemented by the Langevin machine. The…

Neural and Evolutionary Computing · Computer Science 2021-04-08 Lukas Kades , Jan M. Pawlowski

This paper presents a general approach to linear stochastic processes driven by various random noises. Mathematically, such processes are described by linear stochastic differential equations of arbitrary order (the simplest non-trivial…

Condensed Matter · Physics 2009-10-28 Alon Drory