English
Related papers

Related papers: Variational Data Assimilation via Sparse Regulariz…

200 papers

We analyze sparse frame based regularization of inverse problems by means of a diagonal frame decomposition (DFD) for the forward operator, which generalizes the SVD. The DFD allows to define a non-iterative (direct) operator-adapted frame…

Numerical Analysis · Mathematics 2019-12-13 Jürgen Frikel , Markus Haltmeier

Recent developments in Carrillo et al. (2012) and Carrillo et al. (2013) introduced a novel regularization method for compressive imaging in the context of compressed sensing with coherent redundant dictionaries. The approach relies on the…

Information Theory · Computer Science 2013-07-05 Rafael E. Carrillo , Jason D. McEwen , Yves Wiaux

In this paper, we develop a randomized algorithm and theory for learning a sparse model from large-scale and high-dimensional data, which is usually formulated as an empirical risk minimization problem with a sparsity-inducing regularizer.…

Machine Learning · Computer Science 2016-10-18 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

Statistical Data Assimilation (SDA) is the transfer of information from field or laboratory observations to a user selected model of the dynamical system producing those observations. The data is noisy and the model has errors; the…

Computation · Statistics 2019-01-16 Adrian S. Wong , Kangbo Hao , Zheng Fang , Henry D. I. Abarbanel

State estimates from weak constraint 4D-Var data assimilation can vary significantly depending on the data and model error covariances. As a result, the accuracy of these estimates heavily depends on the correct specification of both model…

Methodology · Statistics 2025-04-28 Sandra R. Babyale , Jodi Mead , Donna Calhoun , Patricia O. Azike

As a powerful statistical image modeling technique, sparse representation has been successfully used in various image restoration applications. The success of sparse representation owes to the development of l1-norm optimization techniques,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-20 Weisheng Dong , Lei Zhang , Guangming Shi , Xiaolin Wu

Variational data assimilation estimates the dynamical system states by minimizing a cost function that fits the numerical models with the observational data. Although four-dimensional variational assimilation (4D-Var) is widely used, it…

Machine Learning · Computer Science 2025-06-16 Yiming Yang , Xiaoyuan Cheng , Daniel Giles , Sibo Cheng , Yi He , Xiao Xue , Boli Chen , Yukun Hu

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

Machine Learning · Computer Science 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

Variational Data Assimilation (DA) has been broadly used in engineering problems for field reconstruction and prediction by performing a weighted combination of multiple sources of noisy data. In recent years, the integration of deep…

Machine Learning · Computer Science 2023-10-26 Sibo Cheng , Che Liu , Yike Guo , Rossella Arcucci

Variational data assimilation in continuous time is revisited. The central techniques applied in this paper are in part adopted from the theory of optimal nonlinear control. Alternatively, the investigated approach can be considered as a…

Atmospheric and Oceanic Physics · Physics 2015-05-18 Jochen Bröcker

Learning sparse models from data is an important task in all those frameworks where relevant information should be identified within a large dataset. This can be achieved by formulating and solving suitable sparsity promoting optimization…

Optimization and Control · Mathematics 2025-02-18 V. Cerone , S. M. Fosson , D. Regruto , A. Salam

This paper develops a computational framework for optimizing the parameters of data assimilation systems in order to improve their performance. The approach formulates a continuous meta-optimization problem for parameters; the…

Computational Engineering, Finance, and Science · Computer Science 2015-06-16 Alexandru Cioaca , Adrian Sandu

Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image…

Machine Learning · Statistics 2015-06-23 Saiprasad Ravishankar , Yoram Bresler

Data assimilation refers to the process of obtaining an estimate of a system's state using a model for the system's time evolution and a time series of measurements that are possibly noisy and incomplete. However, for practical reasons, the…

Chaotic Dynamics · Physics 2007-05-23 Matthew Cornick , Brian Hunt , Edward Ott , Michael F. Schatz

Adaptive sampling results in dramatic improvements in the recovery of sparse signals in white Gaussian noise. A sequential adaptive sampling-and-refinement procedure called Distilled Sensing (DS) is proposed and analyzed. DS is a form of…

Statistics Theory · Mathematics 2010-05-31 Jarvis Haupt , Rui Castro , Robert Nowak

Spectral methods are popular in detecting global structures in the given data that can be represented as a matrix. However when the data matrix is sparse or noisy, classic spectral methods usually fail to work, due to localization of…

Machine Learning · Statistics 2016-09-12 Pan Zhang

Data assimilation addresses the problem of identifying plausible state trajectories of dynamical systems given noisy or incomplete observations. In geosciences, it presents challenges due to the high-dimensionality of geophysical dynamical…

Machine Learning · Statistics 2023-11-03 François Rozet , Gilles Louppe

Domain Adaptation (DA) aims to generalize the classifier learned from the source domain to the target domain. Existing DA methods usually assume that rich labels could be available in the source domain. However, there are usually a large…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Wei Wang , Zhihui Wang , Yuankai Xiang , Jing Sun , Haojie Li , Fuming Sun , Zhengming Ding

Excessive computational cost for learning large data and streaming data can be alleviated by using stochastic algorithms, such as stochastic gradient descent and its variants. Recent advances improve stochastic algorithms on convergence…

Machine Learning · Statistics 2019-09-24 Shih-Kang Chao , Guang Cheng

Feature selection and feature transformation, the two main ways to reduce dimensionality, are often presented separately. In this paper, a feature selection method is proposed by combining the popular transformation based dimensionality…

Machine Learning · Computer Science 2015-04-22 Hong Tao , Chenping Hou , Feiping Nie , Yuanyuan Jiao , Dongyun Yi