English
Related papers

Related papers: Implicit particle filters for data assimilation

200 papers

Particle Filter algorithm (PF) suffers from some problems such as the loss of particle diversity, the need for large number of particles, and the costly selection of the importance density functions. In this paper, a novel Exponential…

Machine Learning · Computer Science 2015-11-24 Ghazal Zand , Mojtaba Taherkhani , Reza Safabakhsh

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Particle filtering is used to compute good nonlinear estimates of complex systems. It samples trajectories from a chosen distribution and computes the estimate as a weighted average. Easy-to-sample distributions often lead to degenerate…

Machine Learning · Computer Science 2021-10-07 Fernando Gama , Nicolas Zilberstein , Richard G. Baraniuk , Santiago Segarra

High-performance machine learning tools in particle physics rest on two complementary directions: encoding symmetries explicitly in the architecture, and implicitly learning the structure of the data through large-scale (pre-) training. We…

High Energy Physics - Phenomenology · Physics 2026-03-23 Victor Breso-Pla , Kevin Greif , Vinicius Mikuni , Benjamin Nachman , Tilman Plehn , Tanvi Wamorkar , Daniel Whiteson

We present a new algorithm to optimize distributions defined implicitly by parameterized stochastic diffusions. Doing so allows us to modify the outcome distribution of sampling processes by optimizing over their parameters. We introduce a…

The application of machine learning techniques to large-scale personalized recommendation problems is a challenging task. Such systems must make sense of enormous amounts of implicit feedback in order to understand user preferences across…

Information Retrieval · Computer Science 2019-01-15 Thom Lake , Sinead A. Williamson , Alexander T. Hawk , Christopher C. Johnson , Benjamin P. Wing

Confocal microscopy of colloids combined with digital image processing has become a powerful tool in soft matter physics and materials science. Together, these techniques enable locating and tracking of more than half a million individual…

Soft Condensed Matter · Physics 2016-05-10 Katharine E. Jensen , Nobutomo Nakamura

Finding a suitable data representation for a specific task has been shown to be crucial in many applications. The success of subspace clustering depends on the assumption that the data can be separated into different subspaces. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Zhengrui Ma , Zhao Kang , Guangchun Luo , Ling Tian

In this paper, we delve into the concept of interpretable image enhancement, a technique that enhances image quality by adjusting filter parameters with easily understandable names such as "Exposure" and "Contrast". Unlike using predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Satoshi Kosugi

Data assimilation is a method that combines observations (that is, real world data) of a state of a system with model output for that system in order to improve the estimate of the state of the system and thereby the model output. The model…

Numerical Analysis · Mathematics 2020-05-18 Melina A. Freitag

We describe a spectrally-filtered discrete-in-time downscaling data assimilation algorithm and prove, in the context of the two-dimensional Navier--Stokes equations, that this algorithm works for a general class of interpolants, such as…

Dynamical Systems · Mathematics 2019-03-18 Emine Celik , Eric Olson , Edriss S. Titi

An implicit purification scheme is proposed for calculation of the temperature-dependent, grand canonical single-particle density matrix, given as a Fermi operator expansion in terms of the Hamiltonian. The computational complexity is shown…

Materials Science · Physics 2009-11-10 Anders M. N. Niklasson

We present a technique for constructing suitable posterior probability distributions in situations for which the sampling distribution of the data is not known. This is very useful for modern scientific data analysis in the era of "big…

Instrumentation and Methods for Astrophysics · Physics 2017-08-30 Steven Gratton

This paper focuses on designing a particle filter for randomly delayed measurements with an unknown latency probability. A generalized measurement model is adopted which includes measurements that are delayed randomly by an arbitrary but…

Signal Processing · Electrical Eng. & Systems 2018-03-22 Ranjeet Kumar Tiwari , Shovan Bhaumik , Paresh Date

We investigate a new structure for machine learning classifiers applied to problems in high-energy physics by expanding the inputs to include not only measured features but also physics parameters. The physics parameters represent a…

High Energy Physics - Experiment · Physics 2016-05-25 Pierre Baldi , Kyle Cranmer , Taylor Faucett , Peter Sadowski , Daniel Whiteson

The typical particle filtering approximation error is exponentially dependent on the dimension of the model. Therefore, to control this error, an enormous number of particles are required, which means a heavy computational burden that is…

Optimization and Control · Mathematics 2014-07-02 Francesco Bertoli , Adrian N. Bishop

Recent research has shown a weak convergence - convergence in distribution - of particle filtering methods under certain assumptions. However, some applications of particle filtering methods, such as radiation source localization problems,…

Signal Processing · Electrical Eng. & Systems 2020-04-21 Jared Cook , Ralph C. Smith , Camila Ramirez , Nageswara S. V. Rao

In this paper, we consider a new framework for particle filtering under model uncertainty that operates beyond the scope of Markovian switching systems. Specifically, we develop a novel particle filtering algorithm that applies to general…

Computation · Statistics 2020-09-11 Yousef El-Laham , Liu Yang , Petar M. Djuric , Monica F. Bugallo

"Particle methods" are sequential Monte Carlo algorithms, typically involving importance sampling, that are used to estimate and sample from joint and marginal densities from a collection of a, presumably increasing, number of random…

Computation · Statistics 2014-07-17 J. N. Corcoran , D. Jennings

Data assimilation leads naturally to a Bayesian formulation in which the posterior probability distribution of the system state, given the observations, plays a central conceptual role. The aim of this paper is to use this Bayesian…

Data Analysis, Statistics and Probability · Physics 2013-01-01 K. J. H. Law , A. M. Stuart