English
Related papers

Related papers: An Analytically Tractable Bayesian Approximation t…

200 papers

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

Accurate estimation of the states of a nonlinear dynamical system is crucial for their design, synthesis, and analysis. Particle filters are estimators constructed by simulating trajectories from a sampling distribution and averaging them…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Fernando Gama , Nicolas Zilberstein , Martin Sevilla , Richard Baraniuk , Santiago Segarra

We propose a method for optimal Bayesian filtering with deterministic particles. In order to avoid particle degeneration, the filter step is not performed at once. Instead, the particles progressively flow from prior to posterior. This is…

Machine Learning · Statistics 2023-03-07 Uwe D. Hanebeck

Functional data analysis, which models data as realizations of random functions over a continuum, has emerged as a useful tool for time series data. Often, the goal is to infer the dynamic connections (or time-varying conditional…

Methodology · Statistics 2024-12-10 Chunshan Liu , Daniel R. Kowal , James Doss-Gollin , Marina Vannucci

This paper considers the problem of designing time-dependent, real-time control policies for controllable nonlinear diffusion processes, with the goal of obtaining maximally-informative observations about parameters of interest. More…

Methodology · Statistics 2014-10-16 Giles Hooker , Kevin K. Lin , Bruce Rogers

The detection of change points is a pivotal task in statistical analysis. In the quantum realm, it is a new primitive where one aims at identifying the point where a source that supposedly prepares a sequence of particles in identical…

Quantum Physics · Physics 2017-10-11 Gael Sentís , John Calsamiglia , Ramon Munoz-Tapia

Active perception systems maximizing information gain to support both monitoring and decision making have seen considerable application in recent work. In this paper, we propose and demonstrate a method of acquiring and extrapolating…

Robotics · Computer Science 2020-05-04 Martin A. Sehr , Wei Xi Xia , Prithvi Akella , Juan Aparicio Ojea , Eugen Solowjow

Bayesian optimal experimental design (BOED) is a methodology to identify experiments that are expected to yield informative data. Recent work in cognitive science considered BOED for computational models of human behavior with tractable and…

Machine Learning · Computer Science 2021-11-01 Simon Valentin , Steven Kleinegesse , Neil R. Bramley , Michael U. Gutmann , Christopher G. Lucas

This paper studies a nonlinear filtering problem over an infinite time interval. The signal to be estimated is driven by a stochastic partial differential equation involves unknown parameters. Based on discrete observation, strongly…

Statistics Theory · Mathematics 2021-07-12 Qizhu Liang , Jie Xiong , Xingqiu Zhao

Empirical analysis serves as an important complement to theoretical analysis for studying practical Bayesian optimization. Often empirical insights expose strengths and weaknesses inaccessible to theoretical analysis. We define two metrics…

Machine Learning · Computer Science 2016-04-01 Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , George Ke

Causal discovery is crucial for understanding complex systems and informing decisions. While observational data can uncover causal relationships under certain assumptions, it often falls short, making active interventions necessary. Current…

Machine Learning · Computer Science 2024-06-18 Yuxuan Wang , Mingzhou Liu , Xinwei Sun , Wei Wang , Yizhou Wang

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem.…

Strongly Correlated Electrons · Physics 2016-08-18 Dominic Bergeron , A. -M. S. Tremblay

A recurrent idea in the study of complex systems is that optimal information processing is to be found near bifurcation points or phase transitions. However, this heuristic hypothesis has few (if any) concrete realizations where a standard…

Neurons and Cognition · Quantitative Biology 2007-05-23 Osame Kinouchi , Mauro Copelli

The likelihood-free sequential Approximate Bayesian Computation (ABC) algorithms, are increasingly popular inference tools for complex biological models. Such algorithms proceed by constructing a succession of probability distributions over…

Computation · Statistics 2012-10-12 Daniel Silk , Saran Filippi , Michael P. H. Stumpf

We propose a general framework for studying optimal impulse control problem in the presence of uncertainty on the parameters. Given a prior on the distribution of the unknown parameters, we explain how it should evolve according to the…

Probability · Mathematics 2017-12-06 N. Baradel , B. Bouchard , Ngoc Minh Dang

Biological systems display impressive capabilities in effectively responding to environmental signals in real time. There is increasing evidence that organisms may indeed be employing near optimal Bayesian calculations in their…

Neurons and Cognition · Quantitative Biology 2010-02-12 Steve Yaeli , Ron Meir

In a Bayesian setting, inverse problems and uncertainty quantification (UQ) --- the propagation of uncertainty through a computational (forward) model --- are strongly connected. In the form of conditional expectation the Bayesian update…

Two commonly arising computational tasks in Bayesian learning are Optimization (Maximum A Posteriori estimation) and Sampling (from the posterior distribution). In the convex case these two problems are efficiently reducible to each other.…

Machine Learning · Computer Science 2019-11-07 Kunal Talwar

We present a novel particle filtering framework for continuous-time dynamical systems with continuous-time measurements. Our approach is based on the duality between estimation and optimal control, which allows reformulating the estimation…

Optimization and Control · Mathematics 2021-10-08 Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

Bayesian optimization is a methodology to optimize black-box functions. Traditionally, it focuses on the setting where you can arbitrarily query the search space. However, many real-life problems do not offer this flexibility; in…