English
Related papers

Related papers: Implicit particle filters for data assimilation

200 papers

We consider partially-specified optimization problems where the goal is to actively, but efficiently, acquire missing information about the problem in order to solve it. An algorithm designer wishes to solve a linear program (LP), $\max…

Data Structures and Algorithms · Computer Science 2021-09-07 Shuran Zheng , Bo Waggoner , Yang Liu , Yiling Chen

A multilayered particle is illuminated by plane acoustic or electromagnetic waves of one or several frequencies. We consider the inverse scattering problem for the identification of the layers and of the refraction coefficients of the…

Mathematical Physics · Physics 2016-09-07 Semion Gutman

User preferences for items can be inferred from either explicit feedback, such as item ratings, or implicit feedback, such as rental histories. Research in collaborative filtering has concentrated on explicit feedback, resulting in the…

Machine Learning · Computer Science 2015-03-19 Andriy Mnih , Yee Whye Teh

Many recent advances in sequential assimilation of data into nonlinear high-dimensional models are modifications to particle filters which employ efficient searches of a high-dimensional state space. In this work, we present a complementary…

Dynamical Systems · Mathematics 2020-12-10 John Maclean , Elaine T Spiller

We introduce an auxiliary technique, called residual nudging, to the particle filter to enhance its performance in cases that it performs poorly. The main idea of residual nudging is to monitor, and if necessary, adjust the residual norm of…

Atmospheric and Oceanic Physics · Physics 2013-06-03 Xiaodong Luo , Ibrahim Hoteit

In the era of big data, we first need to manage the data, which requires us to find missing data or predict the trend, so we need operations including interpolation and data fitting. Interpolation is a process to discover deducing new data…

Numerical Analysis · Mathematics 2022-08-26 Yijie Xu , Runqi Xu

In order to achieve state-of-the-art performance, modern machine learning techniques require careful data pre-processing and hyperparameter tuning. Moreover, given the ever increasing number of machine learning models being developed, model…

Machine Learning · Statistics 2018-05-03 Nicolo Fusi , Rishit Sheth , Huseyn Melih Elibol

Many real-life signals are defined on spherical domains, in particular in geophysics and physics applications. In this work, we tackle the problem of extending the iterative filtering algorithm, developed for the decomposition of…

Numerical Analysis · Mathematics 2023-12-01 Giovanni Barbarino , Roberto Cavassi , Antonio Cicone

Data assimilation methodologies are designed to incorporate noisy observations of a physical system into an underlying model in order to infer the properties of the state of the system. Filters refer to a class of data assimilation…

Optimization and Control · Mathematics 2011-10-13 C. E. A. Brett , K. F. Lam , K. J. H. Law , D. S. McCormick , M. R. Scott , A. M. Stuart

Chaos is ubiquitous in physical systems. The associated sensitivity to initial conditions is a significant obstacle in forecasting the weather and other geophysical fluid flows. Data assimilation is the process whereby the uncertainty in…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Alberto Carrassi , Marc Bocquet , Jonathan Demaeyer , Colin Grudzien , Patrick Raanes , Stephane Vannitsem

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

Optimization and Control · Mathematics 2020-11-06 Shushu Zhang , Vivak Patel

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

Within the task of collaborative filtering two challenges for computing conditional probabilities exist. First, the amount of training data available is typically sparse with respect to the size of the domain. Thus, support for higher-order…

Information Retrieval · Computer Science 2012-07-19 Lawrence Zitnick , Takeo Kanade

For challenging state estimation problems arising in domains like vision and robotics, particle-based representations attractively enable temporal reasoning about multiple posterior modes. Particle smoothers offer the potential for more…

Machine Learning · Computer Science 2025-02-18 Ali Younis , Erik B. Sudderth

We introduce a probabilistic approach to the LMS filter. By means of an efficient approximation, this approach provides an adaptable step-size LMS algorithm together with a measure of uncertainty about the estimation. In addition, the…

Machine Learning · Statistics 2016-04-11 Jesus Fernandez-Bes , Víctor Elvira , Steven Van Vaerenbergh

We present a general theory of fractal transformations and show how it leads to a new type of method for filtering and transforming digital images. This work substantially generalizes earlier work on fractal tops. The approach involves…

Geometric Topology · Mathematics 2011-02-17 Michael F. Barnsley , Brendan Harding , Konstantin Igudesman

Differentiable particle filters are an emerging class of particle filtering methods that use neural networks to construct and learn parametric state-space models. In real-world applications, both the state dynamics and measurements can…

Signal Processing · Electrical Eng. & Systems 2023-05-04 Wenhan Li , Xiongjie Chen , Wenwu Wang , Víctor Elvira , Yunpeng Li

This paper is concerned with particle filtering for $\alpha$-stable stochastic volatility models. The $\alpha$-stable distribution provides a flexible framework for modeling asymmetry and heavy tails, which is useful when modeling financial…

Computation · Statistics 2014-05-20 Emilian Vankov , Katherine B. Ensor

Bloom filters are space-efficient probabilistic data structures that are used to test whether an element is a member of a set, and may return false positives. Recently, variations referred to as learned Bloom filters were developed that can…

Data Structures and Algorithms · Computer Science 2020-10-06 Kapil Vaidya , Eric Knorr , Tim Kraska , Michael Mitzenmacher