English
Related papers

Related papers: Sequence Alignment with Dirichlet Process Mixtures

200 papers

The convergence analysis of optimization algorithms using continuous-time dynamical systems has received much attention in recent years. In this paper, we investigate applications of these systems to analyze the convergence of linearized…

Optimization and Control · Mathematics 2023-09-14 Jiahong Guo , Xiao Wang , Xiantao Xiao

Consider a Dirichlet process mixture model (DPM) with random precision parameter $\alpha$, inducing $K_n$ clusters over $n$ observations through its latent random partition. Our goal is to specify the prior distribution…

Methodology · Statistics 2025-06-03 Carlo Vicentini , Ian Hyla Jermyn

Dirichlet process mixture models (DPMM) are a cornerstone of Bayesian non-parametrics. While these models free from choosing the number of components a-priori, computationally attractive variational inference often reintroduces the need to…

Machine Learning · Computer Science 2017-01-16 Arnim Bleier

We present the \textit{hierarchical Dirichlet scaling process} (HDSP), a Bayesian nonparametric mixed membership model. The HDSP generalizes the hierarchical Dirichlet process (HDP) to model the correlation structure between metadata in the…

Machine Learning · Computer Science 2017-07-10 Dongwoo Kim , Alice Oh

Distributed machine learning (DML) over time-varying networks can be an enabler for emerging decentralized ML applications such as autonomous driving and drone fleeting. However, the commonly used weighted arithmetic mean model aggregation…

Machine Learning · Computer Science 2022-02-22 Haizhou Du , Ryan Yang , Yijian Chen , Qiao Xiang , Andre Wibisono , Wei Huang

We introduce a new approach to prediction in graphical models with latent-shift adaptation, i.e., where source and target environments differ in the distribution of an unobserved confounding latent variable. Previous work has shown that as…

Machine Learning · Statistics 2023-06-26 William I. Walker , Arthur Gretton , Maneesh Sahani

We propose Deep Residual Mixture Models (DRMMs), a novel deep generative model architecture. Compared to other deep models, DRMMs allow more flexible conditional sampling: The model can be trained once with all variables, and then used for…

Machine Learning · Computer Science 2021-07-22 Perttu Hämäläinen , Martin Trapp , Tuure Saloheimo , Arno Solin

This work develops a Bayesian non-parametric approach to signal separation where the signals may vary according to latent variables. Our key contribution is to augment Gaussian Process Latent Variable Models (GPLVMs) for the case where each…

Machine Learning · Statistics 2025-03-20 James Odgers , Ruby Sedgwick , Chrysoula Kappatou , Ruth Misener , Sarah Filippi

Gaussian processes (GP) for machine learning have been studied systematically over the past two decades and they are by now widely used in a number of diverse applications. However, GP kernel design and the associated hyper-parameter…

Machine Learning · Computer Science 2020-10-28 Feng Yin , Lishuo Pan , Xinwei He , Tianshi Chen , Sergios Theodoridis , Zhi-Quan , Luo

The Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) has been used widely as a natural Bayesian nonparametric extension of the classical Hidden Markov Model for learning from sequential and time-series data. A sticky extension…

Machine Learning · Statistics 2020-06-23 Ding Zhou , Yuanjun Gao , Liam Paninski

Hidden Markov Model (HMM) combined with Gaussian Process (GP) emission can be effectively used to estimate the hidden state with a sequence of complex input-output relational observations. Especially when the spectral mixture (SM) kernel is…

Machine Learning · Computer Science 2020-01-08 Yohan Jung , Jinkyoo Park

In this paper, we showed that the no-arbitrage condition holds if the market follows the mixture of the geometric Brownian motion (GBM). The mixture of GBM can incorporate heavy-tail behavior of the market. It automatically leads us to…

Methodology · Statistics 2018-05-02 Sourish Das , Aritra Halder , Ananya Lahiri , Dipak K Dey

We present a mixed multinomial logit (MNL) model, which leverages the truncated stick-breaking process representation of the Dirichlet process as a flexible nonparametric mixing distribution. The proposed model is a Dirichlet process…

Applications · Statistics 2018-01-22 Rico Krueger , Akshay Vij , Taha H. Rashidi

Time Series Alignment is a critical task in signal processing with numerous real-world applications. In practice, signals often exhibit temporal shifts and scaling, making classification on raw data prone to errors. This paper introduces a…

Machine Learning · Computer Science 2025-02-27 Alireza Nourbakhsh , Hoda Mohammadzade

In many cases it makes sense to model a relationship symmetrically, not implying any particular directionality. Consider the classical example of a recommendation system where the rating of an item by a user should symmetrically be…

Artificial Intelligence · Computer Science 2012-07-02 Zhao Xu , Volker Tresp , Kai Yu , Hans-Peter Kriegel

Time series data may exhibit clustering over time and, in a multiple time series context, the clustering behavior may differ across the series. This paper is motivated by the Bayesian non--parametric modeling of the dependence between the…

Statistics Theory · Mathematics 2011-09-23 Federico Bassetti , Roberto Casarin , Fabrizio Leisen

Probabilistic time series forecasting is crucial for quantifying future uncertainty, with significant applications in fields such as energy and finance. However, existing methods often rely on computationally expensive sampling or…

Machine Learning · Computer Science 2026-01-21 Lei Liu , Tengyuan Liu , Hongwei Zhao , Jiahui Huang , Ruibo Guo , Bin Li

The Linear Parameter Varying Dynamical System (LPV-DS) is an effective approach that learns stable, time-invariant motion policies using statistical modeling and semi-definite optimization to encode complex motions for reactive robot…

Robotics · Computer Science 2024-03-26 Sunan Sun , Haihui Gao , Tianyu Li , Nadia Figueroa

We develop deep Poisson-gamma dynamical systems (DPGDS) to model sequentially observed multivariate count data, improving previously proposed models by not only mining deep hierarchical latent structure from the data, but also capturing…

Machine Learning · Statistics 2019-01-03 Dandan Guo , Bo Chen , Hao Zhang , Mingyuan Zhou

Gaussian Process Latent Variable Model (GPLVM) is a flexible framework to handle uncertain inputs in Gaussian Processes (GPs) and incorporate GPs as components of larger graphical models. Nonetheless, the standard GPLVM variational…