English
Related papers

Related papers: Unsupervised Learning of Sampling Distributions fo…

200 papers

The process of dynamic state estimation (filtering) based on point process observations is in general intractable. Numerical sampling techniques are often practically useful, but lead to limited conceptual insight about optimal…

Machine Learning · Statistics 2015-08-04 Yuval Harel , Ron Meir , Manfred Opper

Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we…

Artificial Intelligence · Computer Science 2013-01-18 Luis E. Ortiz , Leslie Pack Kaelbling

Data sampling is an effective method to improve the training speed of neural networks, with recent results demonstrating that it can even break the neural scaling laws. These results critically rely on high-quality scores to estimate the…

Machine Learning · Computer Science 2023-11-23 Shabnam Daghaghi , Benjamin Coleman , Benito Geordie , Anshumali Shrivastava

Sampling is often a necessary evil to reduce the processing and storage costs of distributed tracing. In this work, we describe a scalable and adaptive sampling approach that can preserve events of interest better than the widely used…

Data Structures and Algorithms · Computer Science 2021-07-19 Otmar Ertl

Particle filters are a group of algorithms to solve inverse problems through statistical Bayesian methods when the model does not comply with the linear and Gaussian hypothesis. Particle filters are used in domains like data assimilation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Sebastian Friedemann , Kai Keller , Yen-Sen Lu , Bruno Raffin , Leonardo Bautista Gomez

Data sampling acts as a pivotal role in training deep learning models. However, an effective sampling schedule is difficult to learn due to the inherently high dimension of parameters in learning the sampling schedule. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Ming Sun , Haoxuan Dou , Baopu Li , Lei Cui , Junjie Yan , Wanli Ouyang

A supervisory observer is a multiple-model architecture, which estimates the parameters and the states of nonlinear systems. It consists of a bank of state observers, where each observer is designed for some nominal parameter values sampled…

Optimization and Control · Mathematics 2017-09-06 Michelle S. Chong , Romain Postoyan , Sei Zhen Khong , Dragan Nesic

In this article, an overview of Bayesian methods for sequential simulation from posterior distributions of nonlinear and non-Gaussian dynamic systems is presented. The focus is mainly laid on sequential Monte Carlo methods, which are based…

Methodology · Statistics 2023-04-28 Konstantinos E. Tatsis , Vasilis K. Dertimanis , Eleni N. Chatzi

Simulation is a useful tool in situations where training data for machine learning models is costly to annotate or even hard to acquire. In this work, we propose a reinforcement learning-based method for automatically adjusting the…

Machine Learning · Computer Science 2019-05-15 Nataniel Ruiz , Samuel Schulter , Manmohan Chandraker

Fitting probabilistic models to data is often difficult, due to the general intractability of the partition function and its derivatives. Here we propose a new parameter estimation technique that does not require computing an intractable…

Machine Learning · Computer Science 2015-03-13 Jascha Sohl-Dickstein , Peter Battaglino , Michael R. DeWeese

Sampling-based methods have become a cornerstone of contemporary approaches to Model Predictive Control (MPC), as they make no restrictions on the differentiability of the dynamics or cost function and are straightforward to parallelize.…

Robotics · Computer Science 2022-12-07 Jacob Sacks , Byron Boots

The distributed filtering problem sequentially estimates a global state variable using observations from a network of local sensors with different measurement models. In this work, we introduce a novel methodology for distributed nonlinear…

Multiagent Systems · Computer Science 2023-10-31 Daniel Grange , Ricardo Baptista , Amirhossein Taghvaei , Allen Tannenbaum , Sean Phillips

A key challenge when designing particle filters in high-dimensional state spaces is the construction of a proposal distribution that is close to the posterior distribution. Recent advances in particle flow filters provide a promising avenue…

Methodology · Statistics 2017-06-30 Yunpeng Li , Mark Coates

The ability to track a moving vehicle is of crucial importance in numerous applications. The task has often been approached by the importance sampling technique of particle filters due to its ability to model non-linear and non-Gaussian…

Machine Learning · Statistics 2016-11-16 Kira Kempinska , John Shawe-Taylor

Event-based sampling has been proposed as a general technique for lowering the average communication rate in remote state estimation, which can be important in scenarios with constraints on resources such as network bandwidth or sensor…

Systems and Control · Electrical Eng. & Systems 2022-09-29 Johan Ruuskanen , Anton Cervin

Sparse learning is a very important tool for mining useful information and patterns from high dimensional data. Non-convex non-smooth regularized learning problems play essential roles in sparse learning, and have drawn extensive attentions…

Machine Learning · Computer Science 2020-10-22 Guannan Liang , Qianqian Tong , Jiahao Ding , Miao Pan , Jinbo Bi

Sampling, grouping, and aggregation are three important components in the multi-scale analysis of point clouds. In this paper, we present a novel data-driven sampler learning strategy for point-wise analysis tasks. Unlike the widely used…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yiqun Lin , Lichang Chen , Haibin Huang , Chongyang Ma , Xiaoguang Han , Shuguang Cui

Distinguishability and, by extension, observability are key properties of dynamical systems. Establishing these properties is challenging, especially when no analytical model is available and they are to be inferred directly from…

Systems and Control · Electrical Eng. & Systems 2024-06-10 Pierre-François Massiani , Mona Buisson-Fenet , Friedrich Solowjow , Florent Di Meglio , Sebastian Trimpe

A central problem in machine learning involves modeling complex data-sets using highly flexible families of probability distributions in which learning, sampling, inference, and evaluation are still analytically or computationally…

Machine Learning · Computer Science 2015-11-20 Jascha Sohl-Dickstein , Eric A. Weiss , Niru Maheswaranathan , Surya Ganguli

It has been widely documented that the sampling and resampling steps in particle filters cannot be differentiated. The {\itshape reparameterisation trick} was introduced to allow the sampling step to be reformulated into a differentiable…

Machine Learning · Statistics 2022-08-10 Conor Rosato , Vincent Beraud , Paul Horridge , Thomas B. Schön , Simon Maskell