English
Related papers

Related papers: Nested Hierarchical Dirichlet Processes for Multi-…

200 papers

The Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) is a natural Bayesian nonparametric extension of the classical Hidden Markov Model for learning from (spatio-)temporal data. A sticky HDP-HMM has been proposed to strengthen…

Machine Learning · Computer Science 2024-11-08 Mikołaj Słupiński , Piotr Lipiński

Edge inference techniques partition and distribute Deep Neural Network (DNN) inference tasks among multiple edge nodes for low latency inference, without considering the core-level heterogeneity of edge nodes. Further, default DNN inference…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Zain Taufique , Aman Vyas , Antonio Miele , Pasi Liljeberg , Anil Kanduri

We consider the estimation of Dirichlet Process Mixture Models (DPMMs) in distributed environments, where data are distributed across multiple computing nodes. A key advantage of Bayesian nonparametric models such as DPMMs is that they…

Machine Learning · Statistics 2017-09-20 Ruohui Wang , Dahua Lin

In science and engineering, intelligent processing of complex signals such as images, sound or language is often performed by a parameterized hierarchy of nonlinear processing layers, sometimes biologically inspired. Hierarchical systems…

Machine Learning · Computer Science 2012-12-27 Miguel Á. Carreira-Perpiñán , Weiran Wang

We introduce a new method based on nonnegative matrix factorization, Neural NMF, for detecting latent hierarchical structure in data. Datasets with hierarchical structure arise in a wide variety of fields, such as document classification,…

Machine Learning · Computer Science 2023-03-02 Tyler Will , Runyu Zhang , Eli Sadovnik , Mengdi Gao , Joshua Vendrow , Jamie Haddock , Denali Molitor , Deanna Needell

Statistical modelling in the presence of data organized in groups is a crucial task in Bayesian statistics. The present paper conceives a mixture model based on a novel family of Bayesian priors designed for multilevel data and obtained by…

Methodology · Statistics 2024-07-01 Alessandro Colombi , Raffaele Argiento , Federico Camerlenghi , Lucia Paci

Dyadic Data Prediction (DDP) is an important problem in many research areas. This paper develops a novel fully Bayesian nonparametric framework which integrates two popular and complementary approaches, discrete mixed membership modeling…

Machine Learning · Computer Science 2016-01-15 Guangyong Chen , Fengyuan Zhu , Pheng Ann Heng

We propose an effective method to solve the event sequence clustering problems based on a novel Dirichlet mixture model of a special but significant type of point processes --- Hawkes process. In this model, each event sequence belonging to…

Machine Learning · Computer Science 2017-09-22 Hongteng Xu , Hongyuan Zha

Statistical depths have been well studied for multivariate and functional data over the past few decades, but remain under-explored for point processes. A first attempt on the notion of point process depth was conducted recently where the…

Methodology · Statistics 2019-09-17 Kai Qi , Yang Chen , Wei Wu

In many real life problems, objects are described by large number of binary features. For instance, documents are characterized by presence or absence of certain keywords; cancer patients are characterized by presence or absence of certain…

Applications · Statistics 2016-03-09 Tapesh Santra

The perennial problem of "how many clusters?" remains an issue of substantial interest in data mining and machine learning communities, and becomes particularly salient in large data sets such as populational genomic data where the number…

Machine Learning · Statistics 2009-08-20 Kyung-Ah Sohn , Eric P. Xing

Decision-making in robotics using denoising diffusion processes has increasingly become a hot research topic, but end-to-end policies perform poorly in tasks with rich contact and have limited controllability. This paper proposes…

Robotics · Computer Science 2024-11-21 Dexin Wang , Chunsheng Liu , Faliang Chang , Yichen Xu

Nonequispaced discrete Fourier transformation (NDFT) is widely applied in all aspects of computational science and engineering. The computational efficiency and accuracy of NDFT has always been a critical issue in hindering its…

Mathematical Software · Computer Science 2020-08-06 Sheng-Chun Yang , Yong-Lei Wang

Modern recommendation models have increased to trillions of parameters. As cluster scales expand to O(1k), distributed training bottlenecks shift from computation and memory to data movement, especially lookup and communication latency…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Zhida Jiang , Zhaolong Xing , Huichao Chai , Tianxing Sun , Qiang Peng , Baopeng Yuan , Jiaxing Wang , Hua Du , Zhixin Wu , Xuemiao Li , Yikui Cao , Xinyu Liu , Yongxiang Feng , Zhen Chen , Ke Zhang

One of the focal points of the modern literature on Bayesian nonparametrics has been the problem of clustering, or partitioning, where each data point is modeled as being associated with one and only one of some collection of groups called…

Statistics Theory · Mathematics 2013-10-02 Tamara Broderick , Michael I. Jordan , Jim Pitman

The Dirichlet process mixture (DPM) is a ubiquitous, flexible Bayesian nonparametric statistical model. However, full probabilistic inference in this model is analytically intractable, so that computationally intensive techniques such as…

Machine Learning · Statistics 2014-11-05 Yordan P. Raykov , Alexis Boukouvalas , Max A. Little

Using nonparametric methods has been increasingly explored in Bayesian hierarchical modeling as a way to increase model flexibility. Although the field shows a lot of promise, inference in many models, including Hierachical Dirichlet…

Machine Learning · Statistics 2015-01-19 Alexander Spangher

We introduce a new nonlinear model for classification, in which we model the joint distribution of response variable, y, and covariates, x, non-parametrically using Dirichlet process mixtures. We keep the relationship between y and x linear…

Statistics Theory · Mathematics 2007-05-23 Babak Shahbaba , Radford M. Neal

At present, attention mechanism has been widely applied to the fields of deep learning models. Structural models that based on attention mechanism can not only record the relationships between features position, but also can measure the…

Machine Learning · Computer Science 2021-05-12 Xiaolong Wei , LiFang Yang , Xianglin Huang , Gang Cao , Tao Zhulin , Zhengyang Du , Jing An

Nonsmooth Nonnegative Matrix Factorization (nsNMF) is capable of producing more localized, less overlapped feature representations than other variants of NMF while keeping satisfactory fit to data. However, nsNMF as well as other existing…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Jinshi Yu , Guoxu Zhou , Andrzej Cichocki , Shengli Xie