English
Related papers

Related papers: Distributed Bayesian Matrix Decomposition for Big …

200 papers

Clustering mixed-type data remains a major challenge in biomedical research to uncover clinically meaningful subgroups within heterogeneous patient populations. Most existing clustering methods impose restrictive assumptions like local…

Applications · Statistics 2026-04-23 Yueting Wang , Shu Wang , Jonathan G. Yabes , Chung-Chou H. Chang

This paper considers the problem of distributed source coding for a large network. A major obstacle that poses an existential threat to practical deployment of conventional approaches to distributed coding is the exponential growth of the…

Information Theory · Computer Science 2013-01-08 Kumar Viswanatha , Sharadh Ramaswamy , Ankur Saxena , Emrah Akyol , Kenneth Rose

Recently, there is a growing interest in the study of median-based algorithms for distributed non-convex optimization. Two prominent such algorithms include signSGD with majority vote, an effective approach for communication reduction via…

Machine Learning · Computer Science 2019-06-07 Xiangyi Chen , Tiancong Chen , Haoran Sun , Zhiwei Steven Wu , Mingyi Hong

We propose a MAP Bayesian approach to perform and evaluate a co-clustering of mixed-type data tables. The proposed model infers an optimal segmentation of all variables then performs a co-clustering by minimizing a Bayesian model selection…

Machine Learning · Statistics 2019-02-07 Aichetou Bouchareb , Marc Boullé , Fabrice Rossi , Fabrice Clérot

Background: Mendelian randomization (MR) is a useful approach to causal inference from observational studies when randomised controlled trials are not feasible. However, study heterogeneity of two association studies required in MR is often…

Methodology · Statistics 2021-12-16 Linyi Zou , Hui Guo , Carlo Berzuini

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

Dirichlet Process Mixture Models (DPMMs) are widely used to address clustering problems. Their main advantage lies in their ability to automatically estimate the number of clusters during the inference process through the Bayesian…

Machine Learning · Statistics 2023-12-19 Reda Khoufache , Mustapha Lebbah , Hanene Azzag , Etienne Goffinet , Djamel Bouchaffra

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

Machine Learning · Statistics 2020-11-30 Junhao Hua , Chunguang Li

Deep Feedforward Neural Networks' (DFNNs) weights estimation relies on the solution of a very large nonconvex optimization problem that may have many local (no global) minimizers, saddle points and large plateaus. As a consequence,…

Optimization and Control · Mathematics 2020-06-16 Laura Palagi , Ruggiero Seccia

Hybrid algorithms, which combine black-box machine learning methods with experience from traditional numerical methods and domain expertise from diverse application areas, are progressively gaining importance in scientific machine learning…

Numerical Analysis · Mathematics 2023-12-22 Axel Klawonn , Martin Lanser , Janine Weber

Generative Adversarial Networks (GANs) are proficient at generating synthetic data but continue to suffer from mode collapse, where the generator produces a narrow range of outputs that fool the discriminator but fail to capture the full…

Machine Learning · Computer Science 2025-11-03 Mahsa Valizadeh , Rui Tuo , James Caverlee

Biclustering is an unsupervised machine-learning approach aiming to cluster rows and columns simultaneously in a data matrix. Several biclustering algorithms have been proposed for handling numeric datasets. However, real-world data mining…

Machine Learning · Computer Science 2024-08-26 Adán José-García , Julie Jacques , Clément Chauvet , Vincent Sobanski , Clarisse Dhaenens

Deep feedforward neural networks (DFNNs) are a powerful tool for functional approximation. We describe flexible versions of generalized linear and generalized linear mixed models incorporating basis functions formed by a DFNN. The…

Computation · Statistics 2018-05-28 Minh-Ngoc Tran , Nghia Nguyen , David Nott , Robert Kohn

We propose a novel method for multiple clustering that assumes a co-clustering structure (partitions in both rows and columns of the data matrix) in each view. The new method is applicable to high-dimensional data. It is based on a…

Deep learning and especially the use of Deep Neural Networks (DNNs) provides impressive results in various regression and classification tasks. However, to achieve these results, there is a high demand for computing and storing resources.…

Machine Learning · Computer Science 2021-07-21 Erion-Vasilis Pikoulis , Christos Mavrokefalidis , Aris S. Lalos

There has been considerable interest in making Bayesian inference more scalable. In big data settings, most literature focuses on reducing the computing time per iteration, with less focused on reducing the number of iterations needed in…

Methodology · Statistics 2017-09-28 Leo L. Duan , James E. Johndrow , David B. Dunson

We investigate a general matrix factorization for deviance-based data losses, extending the ubiquitous singular value decomposition beyond squared error loss. While similar approaches have been explored before, our method leverages…

Machine Learning · Statistics 2023-07-04 Liang Wang , Luis Carvalho

Datasets for training crowd counting deep networks are typically heavy-tailed in count distribution and exhibit discontinuities across the count range. As a result, the de facto statistical measures (MSE, MAE) exhibit large variance and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Sravya Vardhani Shivapuja , Mansi Pradeep Khamkar , Divij Bajaj , Ganesh Ramakrishnan , Ravi Kiran Sarvadevabhatla

One of the fundamental steps toward understanding a complex system is identifying variation at the scale of the system's components that is most relevant to behavior on a macroscopic scale. Mutual information provides a natural means of…

Machine Learning · Computer Science 2024-03-20 Kieran A. Murphy , Dani S. Bassett

We present an approach to model-based hierarchical clustering by formulating an objective function based on a Bayesian analysis. This model organizes the data into a cluster hierarchy while specifying a complex feature-set partitioning that…

Machine Learning · Computer Science 2013-01-18 Shivakumar Vaithyanathan , Byron E Dom