English
Related papers

Related papers: Unified Mixture Sampler for State-Space Models: Ap…

200 papers

Linear mixed models (LMMs), which incorporate fixed and random effects, are key tools for analyzing heterogeneous data, such as in personalized medicine. Nowadays, this type of data is increasingly wide, sometimes containing thousands of…

Machine Learning · Statistics 2026-05-15 Ryan Thompson , Matt P. Wand , Joanna J. J. Wang

We propose a nonparametric estimator of multivariate joint entropy based on partitioned sample spacing (PSS). The method extends univariate spacing ideas to $\mathbb{R}^{d}$ by partitioning into localized cells and aggregating within-cell…

Statistics Theory · Mathematics 2025-12-02 Jungwoo Ho , Sangun Park , Soyeong Oh

Multivariate time series (MTS) forecasting is crucial for decision-making in domains such as weather, energy, and finance. It remains challenging because real-world sequences intertwine slow trends, multi-rate seasonalities, and irregular…

Machine Learning · Computer Science 2026-02-06 Shunya Nagashima , Shuntaro Suzuki , Shuitsu Koyama , Shinnosuke Hirano

Particle Markov Chain Monte Carlo (PMCMC) is a general computational approach to Bayesian inference for general state space models. Our article scales up PMCMC in terms of the number of observations and parameters by generating the…

Methodology · Statistics 2023-07-04 David Gunawan , Chris Carter , Robert Kohn

Bayesian inference for factorial hidden Markov models is challenging due to the exponentially sized latent variable space. Standard Monte Carlo samplers can have difficulties effectively exploring the posterior landscape and are often…

Computation · Statistics 2019-02-28 Kaspar Märtens , Michalis K Titsias , Christopher Yau

Molecular dynamics (MD) simulations are useful in obtaining thermodynamic and kinetic properties of bio-molecules but are limited by the timescale barrier, i.e., we may be unable to efficiently obtain properties because we need to run…

Chemical Physics · Physics 2017-08-23 Surl-Hee Ahn , Jay W. Grate , Eric F. Darve

We investigate a Gaussian mixture model (GMM) with component means constrained in a pre-selected subspace. Applications to classification and clustering are explored. An EM-type estimation algorithm is derived. We prove that the subspace…

Machine Learning · Statistics 2015-08-27 Mu Qiao , Jia Li

Best linear unbiased prediction is well known for its wide range of applications including small area estimation. While the theory is well established for mixed linear models and under normality of the error and mixing distributions, the…

Statistics Theory · Mathematics 2007-06-13 Soumendra N. Lahiri , Tapabrata Maiti , Myron Katzoff , Van Parsons

Recently, Multi-Contrast MR Reconstruction (MCMR) has emerged as a hot research topic that leverages high-quality auxiliary modalities to reconstruct undersampled target modalities of interest. However, existing methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Jialin Li , Yiwei Ren , Kai Pan , Dong Wei , Pujin Cheng , Xian Wu , Xiaoying Tang

Sampling from binary quadratic distributions (BQDs) is a fundamental but challenging problem in discrete optimization and probabilistic inference. Previous work established theoretical guarantees for stochastic localization (SL) in…

Statistics Theory · Mathematics 2025-05-27 Chenguang Wang , Kaiyuan Cui , Weichen Zhao , Tianshu Yu

State-space models (SSMs) provide a flexible framework for modelling time series data, but their reliance on Gaussian error assumptions makes them highly sensitive to outliers. We propose a robust estimation method, ROAMS, that mitigates…

Methodology · Statistics 2025-11-20 Rajan Shankar , Ines Wilms , Jakob Raymaekers , Garth Tarr

Tensor networks, which are originally developed for characterizing complex quantum many-body systems, have recently emerged as a powerful framework for capturing high-dimensional probability distributions with strong physical…

Machine Learning · Computer Science 2026-03-13 Haotong Duan , Zhongming Chen , Ngai Wong

We present a variational method for online state estimation and parameter learning in state-space models (SSMs), a ubiquitous class of latent variable models for sequential data. As per standard batch variational techniques, we use…

Machine Learning · Statistics 2022-06-16 Andrew Campbell , Yuyang Shi , Tom Rainforth , Arnaud Doucet

Univariate time series (UTS), where each timestamp records a single variable, serve as crucial indicators in web systems and cloud servers. Anomaly detection in UTS plays an essential role in both data mining and system reliability…

Machine Learning · Computer Science 2026-02-11 Lingpei Zhang , Qingming Li , Yong Yang , Jiahao Chen , Rui Zeng , Chenyang Lyu , Shouling Ji

We propose a novel sampling-based federated learning framework for statistical inference on M-estimators with non-smooth objective functions, which frequently arise in modern statistical applications such as quantile regression and AUC…

Methodology · Statistics 2025-05-06 Xiudi Li , Lu Tian , Tianxi Cai

Accurate platform localization is an integral component of most robotic systems. As these robotic systems become more ubiquitous, it is necessary to develop robust state estimation algorithms that are able to withstand novel and…

Robotics · Computer Science 2019-10-15 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

Bayesian variable selection requires sampling from a posterior distribution that combines discrete model indicators with continuously varying parameters, a challenge often addressed through reversible jump Markov chain Monte Carlo (RJMCMC).…

Methodology · Statistics 2026-05-01 Don van den Bergh , Merlise A. Clyde , Adrian E. Raftery , Maarten Marsman

An efficient simulation framework is proposed to model collective emission in disordered ensembles of quantum emitters. Using a cumulant expansion approach, the computational complexity scales polynomially as opposed to exponentially with…

Optics · Physics 2025-12-17 Qingyi Zhou , Wenxin Wu , Maryam Zahedian , Zongfu Yu , Jennifer T. Choy

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

Uniform-noise discrete diffusion and flow models (e.g., D3PM, SEDD, UDLM, DFM) generate sequences non-autoregressively by iteratively refining randomly initialized vocabulary tokens through multiple context-dependent replacements. These…

Machine Learning · Computer Science 2026-02-18 Seunghwan Jang , SooJean Han