English
Related papers

Related papers: Model Error in Data Assimilation

200 papers

Shallow water equations are extensively considered in the domains of oceans, atmospheric modelling, and engineering research (Franca et al., 2022), which play significant roles in floods and tsunami governance. Nonetheless, the accurate…

Fluid Dynamics · Physics 2023-09-22 Ruijia Yu

We study the problem of parameter estimation for time-series possessing two, widely separated, characteristic time scales. The aim is to understand situations where it is desirable to fit a homogenized singlescale model to such multiscale…

Statistics Theory · Mathematics 2009-11-11 G. A. Pavliotis , A. M. Stuart

Sparse feature selection is necessary when we fit statistical models, we have access to a large group of features, don't know which are relevant, but assume that most are not. Alternatively, when the number of features is larger than the…

Applications · Statistics 2017-04-04 Emiliano Diaz

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

Methodology · Statistics 2022-03-22 Thomas Lumley , Tong Chen

The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. \emph{Bias} in the data can adversely affect this decision-making. We present a new mitigation strategy to…

Machine Learning · Computer Science 2025-07-25 Bruno Scarone , Alfredo Viola , Renée J. Miller , Ricardo Baeza-Yates

Ensuring that analyses performed on a dataset are representative of the entire population is one of the central problems in statistics. Most classical techniques assume that the dataset is independent of the analyst's query and break down…

Machine Learning · Computer Science 2024-09-25 Guy Blanc

We propose two new methods based/inspired by machine learning for tabular data and distance-free localization to enhance the covariance estimations in an ensemble data assimilation. The main goal is to enhance the data assimilation results…

Machine Learning · Computer Science 2025-07-31 Vinicius L. S. Silva , Gabriel S. Seabra , Alexandre A. Emerick

Complex statistical models such as scalar-on-image regression often require strong assumptions to overcome the issue of non-identifiability. While in theory it is well understood that model assumptions can strongly influence the results,…

Methodology · Statistics 2020-05-04 Clara Happ , Sonja Greven , Volker J. Schmid

Frailty models are often the model of choice for heterogeneous survival data. A frailty model contains both random effects and fixed effects, with the random effects accommodating for the correlation in the data. Different estimation…

Methodology · Statistics 2019-09-17 Oodally Ajmal , Luc Duchateau , Estelle Kuhn

This paper studies the role of sparse regularization in a properly chosen basis for variational data assimilation (VDA) problems. Specifically, it focuses on data assimilation of noisy and down-sampled observations while the state variable…

Data Analysis, Statistics and Probability · Physics 2014-06-25 A. M. Ebtehaj , M. Zupanski , G. Lerman , E. Foufoula-Georgiou

Data assimilation performance can be significantly impacted by biased noise in observations, altering the signal magnitude and introducing fast oscillations or discontinuities when the system lacks smoothness. To mitigate these issues, this…

Numerical Analysis · Mathematics 2024-11-05 Felipe Galarce , Joaquin Mura , Alfonso Caiazzo

Inverse problems use physical measurements along with a computational model to estimate the parameters or state of a system of interest. Errors in measurements and uncertainties in the computational model lead to inaccurate estimates. This…

Numerical Analysis · Mathematics 2015-02-02 Vishwas Rao , Adrian Sandu

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, however, is paramount to…

Machine Learning · Computer Science 2020-02-14 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro

A new type of robust estimation problem is introduced where the goal is to recover a statistical model that has been corrupted after it has been estimated from data. Methods are proposed for "repairing" the model using only the design and…

Statistics Theory · Mathematics 2020-05-21 Chao Gao , John Lafferty

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

Statistics Theory · Mathematics 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger

Generalization is an important attribute of machine learning models, particularly for those that are to be deployed in a medical context, where unreliable predictions can have real world consequences. While the failure of models to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Brennan Nichyporuk , Jillian Cardinell , Justin Szeto , Raghav Mehta , Jean-Pierre R. Falet , Douglas L. Arnold , Sotirios A. Tsaftaris , Tal Arbel

Data assimilation (DA) provides a general framework for estimation in dynamical systems based on the concepts of Bayesian inference. This constitutes a common basis for the different linear and nonlinear filtering and smoothing techniques…

Optimization and Control · Mathematics 2023-03-08 Tarek Diaa-Eldeen , Marcus Krogh Nielsen , Carl Fredrik Berg , Morten Hovd , John Bagterp Jørgensen

Adaptivity is an important feature of data analysis---typically the choice of questions asked about a dataset depends on previous interactions with the same dataset. However, generalization error is typically bounded in a non-adaptive…

Machine Learning · Computer Science 2015-11-11 Raef Bassily , Adam Smith , Thomas Steinke , Jonathan Ullman

We propose to address the common problem of linear estimation in linear statistical models by using a model selection approach via penalization. Depending then on the framework in which the linear statistical model is considered namely the…

Statistics Theory · Mathematics 2009-09-11 Ikhlef Bechar
‹ Prev 1 4 5 6 7 8 10 Next ›