English
Related papers

Related papers: Particle-based adaptive-lag online marginal smooth…

200 papers

We present a scalable and robust Bayesian inference method for linear state space models. The method is applied to demand forecasting in the context of a large e-commerce platform, paying special attention to intermittent and bursty target…

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

Methodology · Statistics 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

Penalized estimation methods for diffusion processes and dependent data have recently gained significant attention due to their effectiveness in handling high-dimensional stochastic systems. In this work, we introduce an adaptive…

Statistics Theory · Mathematics 2024-12-24 Alessandro De Gregorio , Dario Frisardi , Francesco Iafrate , Stefano Iacus

We present an offline, iterated particle filter to facilitate statistical inference in general state space hidden Markov models. Given a model and a sequence of observations, the associated marginal likelihood L is central to…

Computation · Statistics 2016-06-16 Pieralberto Guarniero , Adam M. Johansen , Anthony Lee

We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient proposal distributions…

Computation · Statistics 2015-06-22 Thibaut Lienart , Yee Whye Teh , Arnaud Doucet

Our article deals with Bayesian inference for a general state space model with the simulated likelihood computed by the particle filter. We show empirically that the partially or fully adapted particle filters can be much more efficient…

Methodology · Statistics 2010-06-11 Michael Pitt , Ralph Silva , Paolo Giordani , Robert Kohn

We study the problem of distributed adaptive estimation over networks where nodes cooperate to estimate physical parameters that can vary over both space and time domains. We use a set of basis functions to characterize the space-varying…

Systems and Control · Computer Science 2015-07-22 Reza Abdolee , Benoit Champagne , Ali H. Sayed

We show that it is feasible to carry out exact Bayesian inference for non-Gaussian state space models using an adaptive Metropolis Hastings sampling scheme with the likelihood approximated by the particle filter. Furthermore, an adapyive…

Computation · Statistics 2009-11-03 Ralph Silva , Paolo Giordani , Robert Kohn , Mike Pitt

This paper studies a distributed state estimation problem for both continuous- and discrete-time linear systems. A simply structured distributed estimator (comprising interconnected local estimators) is first described for estimating the…

Systems and Control · Electrical Eng. & Systems 2023-10-30 Lili Wang , Ji Liu , Brian B. O. Anderson , A. Stephen Morse

Online Passive-Aggressive (PA) learning is a class of online margin-based algorithms suitable for a wide range of real-time prediction tasks, including classification and regression. PA algorithms are formulated in terms of deterministic…

Machine Learning · Statistics 2015-09-09 Arnold Salas , Stephen J. Roberts , Michael A. Osborne

In this paper, we explore an efficient online algorithm for quantum state estimation based on a matrix-exponentiated gradient method previously used in the context of machine learning. The state update is governed by a learning rate that…

Quantum Physics · Physics 2019-03-28 Akram Youssry , Christopher Ferrie , Marco Tomamichel

Generalized additive models have been popular among statisticians and data analysts in multivariate nonparametric regression with non-Gaussian responses including binary and count data. In this paper, a new likelihood approach for fitting…

Statistics Theory · Mathematics 2008-12-18 Kyusang Yu , Byeong U. Park , Enno Mammen

This article addresses online variational estimation in parametric state-space models. We propose a new procedure for efficiently computing the evidence lower bound and its gradient in a streaming-data setting, where observations arrive…

Methodology · Statistics 2026-02-09 Mathis Chagneux , Mathias Müller , Pierre Gloaguen , Sylvain Le Corff , Jimmy Olsson

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

In this paper we introduce a new sampling algorithm which has the potential to be adopted as a universal replacement to the Metropolis--Hastings algorithm. It is related to the slice sampler, and motivated by an algorithm which is…

Computation · Statistics 2020-10-19 Yanxin Li , Stephen G. Walker

Aligning generative real-world image super-resolution models with human visual preference is challenging due to the perception--fidelity trade-off and diverse, unknown degradations. Prior approaches rely on offline preference optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Shijie Zhao , Xuanyu Zhang , Bin Chen , Weiqi Li , Qunliang Xing , Kexin Zhang , Yan Wang , Junlin Li , Li Zhang , Jian Zhang , Tianfan Xue

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

We propose an adaptive Metropolis-Hastings algorithm in which sampled data are used to update the proposal distribution. We use the samples found by the algorithm at a particular step to form the information-theoretically optimal mean-field…

Other Condensed Matter · Physics 2007-05-23 David H. Wolpert , Chiu Fan Lee

Multiple generalized additive models (GAMs) are a type of distributional regression wherein parameters of probability distributions depend on predictors through smooth functions, with selection of the degree of smoothness via $L_2$…

Machine Learning · Statistics 2018-09-26 Yousra El-Bachir , Anthony C. Davison

Accelerated proximal gradient methods have recently been developed for solving quasi-static incremental problems of elastoplastic analysis with some different yield criteria. It has been demonstrated through numerical experiments that these…

Optimization and Control · Mathematics 2020-11-13 Yoshihiro Kanno