English
Related papers

Related papers: Network EM Algorithm for Gaussian Mixture Model in…

200 papers

Clustering mixed data presents numerous challenges inherent to the very heterogeneous nature of the variables. A clustering algorithm should be able, despite of this heterogeneity, to extract discriminant pieces of information from the…

Machine Learning · Computer Science 2022-05-10 Robin Fuchs , Denys Pommeret , Cinzia Viroli

To accelerate learning process with few samples, meta-learning resorts to prior knowledge from previous tasks. However, the inconsistent task distribution and heterogeneity is hard to be handled through a global sharing model…

Machine Learning · Computer Science 2022-06-22 Geng Li , Boyuan Ren , Hongzhi Wang

Processing high-volume, streaming data is increasingly common in modern statistics and machine learning, where batch-mode algorithms are often impractical because they require repeated passes over the full dataset. This has motivated…

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang

We consider the problem of breakpoint detection in a regression modeling framework. To that end, we introduce a novel method, the max-EM algorithm which combines a constrained Hidden Markov Model with the Classification-EM (CEM) algorithm.…

Computation · Statistics 2024-10-14 Modibo Diabaté , Grégory Nuel , Olivier Bouaziz

Pairwise network models such as the Gaussian Graphical Model (GGM) are a powerful and intuitive way to analyze dependencies in multivariate data. A key assumption of the GGM is that each pairwise interaction is independent of the values of…

Methodology · Statistics 2020-02-14 Jonas Haslbeck , Denny Borsboom , Lourens Waldorp

Since real-world objects and their interactions are often multi-modal and multi-typed, heterogeneous networks have been widely used as a more powerful, realistic, and generic superclass of traditional homogeneous networks (graphs).…

Social and Information Networks · Computer Science 2020-12-18 Carl Yang , Yuxin Xiao , Yu Zhang , Yizhou Sun , Jiawei Han

In this paper, we consider the problem of automatic modulation classification with multiple sensors in the presence of unknown time offset, phase offset and received signal amplitude. We develop a novel hybrid maximum likelihood (HML)…

Other Computer Science · Computer Science 2015-02-05 O. Ozdemir , T. Wimalajeewa , B. Dulek , P. K. Varshney , W. Su

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

Deep directed generative models have attracted much attention recently due to their expressive representation power and the ability of ancestral sampling. One major difficulty of learning directed models with many latent variables is the…

Machine Learning · Computer Science 2015-06-16 Siqi Nie , Qiang Ji

Federated learning faces significant challenges in scenarios with heterogeneous data distributions and adverse network conditions, such as delays, packet loss, and data poisoning attacks. This paper proposes a novel method based on the…

Machine Learning · Computer Science 2025-01-28 Mohammad Ghabel Rahmat , Majid Khalilian

In this paper, we consider the problem of distributed parameter estimation in sensor networks. Each sensor makes successive observations of an unknown $d$-dimensional parameter, which might be subject to Gaussian random noises. They aim to…

Systems and Control · Electrical Eng. & Systems 2023-03-22 Jiaqi Yan , Hideaki Ishii

Efficient learning and model compression algorithm for deep neural network (DNN) is a key workhorse behind the rise of deep learning (DL). In this work, we propose a message passing based Bayesian deep learning algorithm called EM-TDAMP to…

Machine Learning · Computer Science 2024-06-11 Wei Xu , An Liu , Yiting Zhang , Vincent Lau

This paper addresses the problem of estimating the modes of an observed non-stationary mixture signal in the presence of an arbitrary distributed noise. A novel Bayesian model is introduced to estimate the model parameters from the…

Signal Processing · Electrical Eng. & Systems 2022-03-31 Quentin Legros , Dominique Fourer , Sylvain Meignen , Marcelo A. Colominas

We investigated the use of Empirical Mode Decomposition (EMD) combined with Gaussian Mixture Models (GMM), feature engineering and machine learning algorithms to optimize trading decisions. We used five, two, and one year samples of hourly…

Methodology · Statistics 2025-03-27 Gabriel R. Palma , Mariusz Skoczeń , Phil Maguire

Federated learning (FL) is an emerging paradigm for decentralized training of machine learning models on distributed clients, without revealing the data to the central server. The learning scheme may be horizontal, vertical or hybrid (both…

Machine Learning · Computer Science 2024-01-11 Fanfei Meng , Lele Zhang , Yu Chen , Yuxin Wang

Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle…

Machine Learning · Computer Science 2021-06-22 Jing Xu , Sen Wang , Liwei Wang , Andrew Chi-Chih Yao

Clustering algorithms are a cornerstone of machine learning applications. Recently, a quantum algorithm for clustering based on the k-means algorithm has been proposed by Kerenidis, Landman, Luongo and Prakash. Based on their work, we…

Quantum Physics · Physics 2020-01-23 Hideyuki Miyahara , Kazuyuki Aihara , Wolfgang Lechner

In this paper, Bayesian parameter estimation through the consideration of the Maximum A Posteriori (MAP) criterion is revisited under the prism of the Expectation-Maximization (EM) algorithm. By incorporating a sparsity-promoting penalty…

Systems and Control · Computer Science 2015-08-06 Rodrigo Carvajal , Juan C. Agüero , Boris I. Godoy , Dimitrios Katselis

We study Sinkhorn EM (sEM), a variant of the expectation maximization (EM) algorithm for mixtures based on entropic optimal transport. sEM differs from the classic EM algorithm in the way responsibilities are computed during the expectation…

Machine Learning · Statistics 2020-07-01 Gonzalo Mena , Amin Nejatbakhsh , Erdem Varol , Jonathan Niles-Weed