English
Related papers

Related papers: Model Error Covariance Estimation for Weak Constra…

200 papers

Data assimilation schemes are confronted with the presence of model errors arising from the imperfect description of atmospheric dynamics. These errors are usually modeled on the basis of simple assumptions such as bias, white noise, first…

Chaotic Dynamics · Physics 2009-11-13 A. Carrassi , S. Vannitsem , C. Nicolis

This paper presents a practical computational approach to quantify the effect of individual observations in estimating the state of a system. Such an analysis can be used for pruning redundant measurements, and for designing future sensor…

Computational Engineering, Finance, and Science · Computer Science 2013-07-22 Alexandru Cioaca , Adrian Sandu , Eric de Sturler

We present a methodology for model evaluation and selection where the sampling mechanism violates the i.i.d. assumption. Our methodology involves a formulation of the bias between the standard Cross-Validation (CV) estimator and the mean…

Methodology · Statistics 2025-03-14 Oren Yuval , Saharon Rosset

Errors in the representation of clouds in convection-permitting numerical weather prediction models can be introduced by different sources. These can be the forcing and boundary conditions, the representation of orography, the accuracy of…

Atmospheric and Oceanic Physics · Physics 2022-03-14 Stefanie Legler , Tijana Janjic

We consider high-dimensional generalized linear models when the covariates are contaminated by measurement error. Estimates from errors-in-variables regression models are well-known to be biased in traditional low-dimensional settings if…

Computation · Statistics 2020-01-06 Michael Byrd , Monnie McGee

The ensemble smoother with multiple data assimilation (ES-MDA) is becoming a popular assisted history matching method. In its standard form, the method requires the specification of the number of iterations in advance. If the selected…

Numerical Analysis · Mathematics 2024-06-11 Alexandre A. Emerick

In a regression model, prediction is typically performed after model selection. The large variability in the model selection makes the prediction unstable. Thus, it is essential to reduce the variability in model selection and improve…

Computation · Statistics 2024-04-11 Wataru Yoshida , Kei Hirose

We study the sample complexity of estimating the covariance matrix $T$ of a distribution $\mathcal{D}$ over $d$-dimensional vectors, under the assumption that $T$ is Toeplitz. This assumption arises in many signal processing problems, where…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Yonina C. Eldar , Jerry Li , Cameron Musco , Christopher Musco

We address the problem of structured covariance matrix estimation for radar space-time adaptive processing (STAP). A priori knowledge of the interference environment has been exploited in many previous works to enable accurate estimators…

Methodology · Statistics 2016-02-18 Bosung Kang , Vishal Monga , Muralidhar Rangaswamy , Yuri I. Abramovich

Structured covariance matrix estimation in the presence of missing data is addressed in this paper with emphasis on radar signal processing applications. After a motivation of the study, the array model is specified and the problem of…

Signal Processing · Electrical Eng. & Systems 2022-12-09 Augusto Aubry , Antonio De Maio , Stefano Marano , Massimo Rosamilia

While the formulation of most data assimilation schemes assumes an unbiased observation model error, in real applications, model error with nontrivial biases is unavoidable. A practical example is the error in the radiative transfer model…

Methodology · Statistics 2016-11-17 John Harlim , Tyrus Berry

Variational data assimilation and deep learning share many algorithmic aspects in common. While the former focuses on system state estimation, the latter provides great inductive biases to learn complex relationships. We here design a…

Machine Learning · Computer Science 2022-11-18 Arthur Filoche , Julien Brajard , Anastase Charantonis , Dominique Béréziat

High-dimensional vector autoregressive (VAR) models are important tools for the analysis of multivariate time series. This paper focuses on high-dimensional time series and on the different regularized estimation procedures proposed for…

Machine Learning · Statistics 2020-06-11 Jonas Krampe , Efstathios Paparoditis

In the framework of solid mechanics, the task of deriving material parameters from experimental data has recently re-emerged with the progress in full-field measurement capabilities and the renewed advances of machine learning. In this…

Computational Engineering, Finance, and Science · Computer Science 2026-01-27 Ulrich Römer , Stefan Hartmann , Jendrik-Alexander Tröger , David Anton , Henning Wessels , Moritz Flaschel , Laura De Lorenzis

An important class of nonlinear weighted least-squares problems arises from the assimilation of observations in atmospheric and ocean models. In variational data assimilation, inverse error covariance matrices define the weighting matrices…

Numerical Analysis · Mathematics 2022-12-06 Olivier Goux , Selime Gürol , Anthony T. Weaver , Oliver Guillet , Youssef Diouane

In variational assimilation, the most probable state of a dynamical system under Gaussian assumptions for the prior and likelihood can be found by solving a least-squares minimization problem . In recent years, we have seen the popularity…

Numerical Analysis · Mathematics 2023-06-22 Shaerdan Shataer , Amos S. Lawless , Nancy K. Nichols

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

We consider the problem of estimating the covariance matrix of a random vector by observing i.i.d samples and each entry of the sampled vector is missed with probability $p$. Under the standard $L_4-L_2$ moment equivalence assumption, we…

Statistics Theory · Mathematics 2024-06-17 Pedro Abdalla

Data assimilation techniques, developed in the last two decades mainly for weather prediction, produce better forecasts by taking advantage of both theoretical/numerical models and real-time observations. In this paper, we explore the…

Astrophysics · Physics 2015-05-13 Eric Bélanger , Alain Vincent , Paul Charbonneau

Estimating the disturbance or clutter covariance is a centrally important problem in radar space time adaptive processing (STAP). The disturbance covariance matrix should be inferred from training sample observations in practice. Large…

Applications · Statistics 2016-02-22 Bosung Kang