English
Related papers

Related papers: Dirichlet Fragmentation Processes

200 papers

In this paper we offer a new perspective on the well established agglomerative clustering algorithm, focusing on recovery of hierarchical structure. We recommend a simple variant of the standard algorithm, in which clusters are merged by…

Machine Learning · Statistics 2024-03-04 Annie Gray , Alexander Modell , Patrick Rubin-Delanchy , Nick Whiteley

Dirichlet process mixtures are flexible non-parametric models, particularly suited to density estimation and probabilistic clustering. In this work we study the posterior distribution induced by Dirichlet process mixtures as the sample size…

Statistics Theory · Mathematics 2022-11-29 Filippo Ascolani , Antonio Lijoi , Giovanni Rebaudo , Giacomo Zanella

We establish scaling limit theorems for the up-down ordered Chinese restaurant processes (oCRPs) of Rogers and Winkel as processes in a space of interval partitions. As previously conjectured, the limits are self-similar diffusions…

Probability · Mathematics 2025-12-09 Quan Shi , Matthias Winkel

We propose dynamical systems trees (DSTs) as a flexible class of models for describing multiple processes that interact via a hierarchy of aggregating parent chains. DSTs extend Kalman filters, hidden Markov models and nonlinear dynamical…

Machine Learning · Computer Science 2012-07-19 Andrew Howard , Tony S. Jebara

Dependent Dirichlet processes (DDP) have been widely applied to model data from distributions over collections of measures which are correlated in some way. On the other hand, in recent years, increasing research efforts in machine learning…

Machine Learning · Computer Science 2021-06-17 Xiaoli Li

Bayesian nonparametric mixtures and random partition models are powerful tools for probabilistic clustering. However, standard independent mixture models can be restrictive in some applications such as inference on cell lineage due to the…

Methodology · Statistics 2025-07-15 Giovanni Rebaudo , Peter Mueller

Deep kernel processes are a recently introduced class of deep Bayesian models that have the flexibility of neural networks, but work entirely with Gram matrices. They operate by alternately sampling a Gram matrix from a distribution over…

Machine Learning · Statistics 2023-05-25 Sebastian Ober , Ben Anson , Edward Milsom , Laurence Aitchison

We formulate the statistics of the discrete multicomponent fragmentation event using a methodology borrowed from statistical mechanics. We generate the ensemble of all feasible distributions that can be formed when a single integer…

Statistical Mechanics · Physics 2020-07-03 Themis Matsoukas

Probabilistic, hierarchically coherent forecasting is a key problem in many practical forecasting applications -- the goal is to obtain coherent probabilistic predictions for a large number of time series arranged in a pre-specified tree…

Machine Learning · Computer Science 2023-03-02 Abhimanyu Das , Weihao Kong , Biswajit Paria , Rajat Sen

We present a new way to summarize and select mixture models via the hierarchical clustering tree (dendrogram) constructed from an overfitted latent mixing measure. Our proposed method bridges agglomerative hierarchical clustering and…

Methodology · Statistics 2024-03-11 Dat Do , Linh Do , Scott A. McKinley , Jonathan Terhorst , XuanLong Nguyen

Label distribution learning (LDL) is a general learning framework, which assigns to an instance a distribution over a set of labels rather than a single label or multiple labels. Current LDL methods have either restricted assumptions on the…

Machine Learning · Computer Science 2017-10-18 Wei Shen , Kai Zhao , Yilu Guo , Alan Yuille

The Dirichlet Process Gaussian Mixture Model (DPGMM) is often used to cluster data when the number of clusters is unknown. One main DPGMM inference paradigm relies on sampling. Here we consider a known state-of-art sampler (proposed by…

Machine Learning · Computer Science 2022-03-28 Vlad Winter , Or Dinari , Oren Freifeld

We consider a discrete-time Markov chain, called fragmentation process, that describes a specific way of successively removing objects from a linear arrangement. The process arises in population genetics and describes the ancestry of the…

Probability · Mathematics 2020-03-17 Ellen Baake , Mareike Esser

Neural network approaches for meta-learning distributions over functions have desirable properties such as increased flexibility and a reduced complexity of inference. Building on the successes of denoising diffusion models for generative…

Machine Learning · Statistics 2023-06-08 Vincent Dutordoir , Alan Saul , Zoubin Ghahramani , Fergus Simpson

Images are composed as a hierarchy of object parts. We use this insight to create a generative graphical model that defines a hierarchical distribution over image parts. Typically, this leads to intractable inference due to loops in the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Sebastian Kaltwang , Sina Samangooei , John Redford , Andrew Blake

The distance dependent Chinese Restaurant Process (ddCRP) provides a flexible prior distribution for clustering observations, incorporating covariate information through pairwise distances and accommodating a rich variety of cluster…

Methodology · Statistics 2026-05-18 Joseph Marsh , Theodore Kypraios , Rowland G. Seymour

We give a Large Deviation Principle (LDP) with explicit rate function for the distribution of vertex degrees in plane trees, a combinatorial model of RNA secondary structures. We calculate the typical degree distributions based on nearest…

Biomolecules · Quantitative Biology 2008-03-28 Yuri Bakhtin , Christine E. Heitsch

Clustered Federated Learning (CFL) improves performance under non-IID client heterogeneity by clustering clients and training one model per cluster, thereby balancing between a global model and fully personalized models. However, most CFL…

Machine Learning · Computer Science 2026-01-30 Mariona Jaramillo-Civill , Peng Wu , Pau Closas

When analyzing data from multiple sources, it is often convenient to strike a careful balance between two goals: capturing the heterogeneity of the samples and sharing information across them. We introduce a novel framework to model a…

Methodology · Statistics 2026-03-02 Laura D'Angelo , Bernardo Nipoti , Andrea Ongaro

We study estimation of the conditional law $P(Y|X=x)$ and continuous functionals $\Psi(P(Y|X=x))$ when $Y$ takes values in a locally compact Polish space, $X \in \mathbb{R}^p$, and the observations arise from a complex survey design. We…

Methodology · Statistics 2026-01-07 Yating Zou , Marcos Matabuena , Michael R. Kosorok