English
Related papers

Related papers: Combining machine learning and data assimilation t…

200 papers

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

We address the problem of learning the dynamics of an unknown non-parametric system linking a target and a feature time series. The feature time series is measured on a sparse and irregular grid, while we have access to only a few points of…

Machine Learning · Statistics 2023-06-01 Linus Bleistein , Adeline Fermanian , Anne-Sophie Jannot , Agathe Guilloux

In the studies of network structures, much attention has been devoted to developing approaches to reconstruct networks and predict missing links when edge-related information is given. However, such approaches are not applicable when we are…

Networking and Internet Architecture · Computer Science 2022-12-09 Junyao Kuang , Caterina Scoglio , Kristin Michel

Despite the recent advances in multi-task learning of dense prediction problems, most methods rely on expensive labelled datasets. In this paper, we present a label efficient approach and look at jointly learning of multiple dense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wei-Hong Li , Xialei Liu , Hakan Bilen

We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks.…

Machine Learning · Statistics 2013-04-15 Pierre Chainais , Cédric Richard

Empirical data on real complex systems are becoming increasingly available. Parallel to this is the need for new methods of reconstructing (inferring) the topology of networks from time-resolved observations of their node-dynamics. The…

Dynamical Systems · Mathematics 2019-09-16 Marc G. Leguia , Zoran Levnajic , Ljupco Todorovski , Bernard Zenko

Deep learning methods are notoriously data-hungry, which requires a large number of labeled samples. Unfortunately, the large amount of interactive sample labeling efforts has dramatically hindered the application of deep learning methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Han Hu , Xinrong Liang , Yulin Ding , Qisen Shang , Bo Xu , Xuming Ge , Min Chen , Ruofei Zhong , Qing Zhu

Dynamic sampling mechanisms in deep learning architectures have demonstrated utility across many computer vision models, though the theoretical analysis of these structures has not yet been unified. In this paper we connect the various…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Dario Morle , Reid Zaffino

In this manuscript, we investigate the problem of how two-layer neural networks learn features from data, and improve over the kernel regime, after being trained with a single gradient descent step. Leveraging the insight from (Ba et al.,…

Machine Learning · Statistics 2024-09-06 Hugo Cui , Luca Pesce , Yatin Dandi , Florent Krzakala , Yue M. Lu , Lenka Zdeborová , Bruno Loureiro

We introduce a simulation-based, amortised Bayesian inference scheme to infer the parameters of random walks. Our approach learns the posterior distribution of the walks' parameters with a likelihood-free method. In the first step a graph…

Machine Learning · Computer Science 2022-12-07 Hippolyte Verdier , François Laurent , Alhassan Cassé , Christian Vestergaard , Jean-Baptiste Masson

In machine learning, there is renewed interest in neural network ensembles (NNEs), whereby predictions are obtained as an aggregate from a diverse set of smaller models, rather than from a single larger model. Here, we show how to define…

Statistical Mechanics · Physics 2023-05-11 Jamie F. Mair , Dominic C. Rose , Juan P. Garrahan

Conventional Supervised Learning approaches focus on the mapping from input features to output labels. After training, the learnt models alone are adapted onto testing features to predict testing labels in isolation, with training data…

Machine Learning · Computer Science 2021-06-16 Yi Luo , Aiguo Chen , Bei Hui , Ke Yan

In this article we develop further an algorithm for data assimilation based upon a shadowing refinement technique [de Leeuw et al., SIAM J. Appl. Dyn. Sys., 17 (2018)] to take partial observations into account. Our method is based on…

Optimization and Control · Mathematics 2020-11-13 Bart de Leeuw , Svetlana Dubinkina

We propose a novel learning-based surrogate data assimilation (DA) model for efficient state estimation in a limited area. Our model employs a feedforward neural network for online computation, eliminating the need for integrating…

Numerical Analysis · Mathematics 2023-07-17 Wei Kang , Liang Xu , Hong Zhou

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample because two or more training examples may…

Artificial Intelligence · Computer Science 2017-06-06 Yuyi Wang , Jan Ramon , Zheng-Chu Guo

We investigate the ability to discover data assimilation (DA) schemes meant for chaotic dynamics with deep learning. The focus is on learning the analysis step of sequential DA, from state trajectories and their observations, using a simple…

Increasing the resolution of a model can improve the performance of a data assimilation system: first because model field are in better agreement with high resolution observations, then the corrections are better sustained and, with…

Atmospheric and Oceanic Physics · Physics 2022-09-07 Sébastien Barthélémy , Julien Brajard , Laurent Bertino , François Counillon

We introduce a mathematical formulation of feature-informed data assimilation (FIDA). In FIDA, the information about feature events, such as shock waves, level curves, wavefronts and peak value, in dynamical systems are used for the…

Systems and Control · Electrical Eng. & Systems 2022-11-02 Wei Kang , Daniel M. Tartakovsky , Apoorv Srivastava

State-of-the-art reinforcement learning algorithms predominantly learn a policy from either a numerical state vector or images. Both approaches generally do not take structural knowledge of the task into account, which is especially…

Machine Learning · Computer Science 2022-03-14 Marco Oliva , Soubarna Banik , Josip Josifovski , Alois Knoll

A critical challenge in the data-driven modeling of dynamical systems is producing methods robust to measurement error, particularly when data is limited. Many leading methods either rely on denoising prior to learning or on access to large…

Numerical Analysis · Mathematics 2019-09-04 Samuel H. Rudy , J. Nathan Kutz , Steven L. Brunton