English
Related papers

Related papers: A Divide and Conquer Strategy for High Dimensional…

200 papers

Divide-and-conquer based methods for Bayesian inference provide a general approach for tractable posterior inference when the sample size is large. These methods divide the data into smaller subsets, sample from the posterior distribution…

Methodology · Statistics 2018-06-21 Sanvesh Srivastava , Cheng Li , David B. Dunson

Large-scale optimization problems that involve thousands of decision variables have extensively arisen from various industrial areas. As a powerful optimization tool for many real-world applications, evolutionary algorithms (EAs) fail to…

Neural and Evolutionary Computing · Computer Science 2023-09-26 Peng Yang , Ke Tang , Xin Yao

Dynamic Bayesian Networks (DBNs), renowned for their interpretability, have become increasingly vital in representing complex stochastic processes in various domains such as gene expression analysis, healthcare, and traffic prediction.…

Machine Learning · Computer Science 2023-12-05 Hui Ouyang , Cheng Chen , Ke Tang

We extensively describe our recently established "divide-and-conquer" semiclassical method [M. Ceotto, G. Di Liberto and R. Conte, Phys. Rev. Lett. 119, 010401 (2017)] and propose a new implementation of it to increase the accuracy of…

Chemical Physics · Physics 2018-01-15 Giovanni Di Liberto , Riccardo Conte , Michele Ceotto

The current Poisson factor models often assume that the factors are unknown, which overlooks the explanatory potential of certain observable covariates. This study focuses on high dimensional settings, where the number of the count response…

Methodology · Statistics 2024-02-26 Wei Liu , Qingzhi Zhong

Spectral clustering is one of the most popular clustering methods. However, how to balance the efficiency and effectiveness of the large-scale spectral clustering with limited computing resources has not been properly solved for a long…

Machine Learning · Computer Science 2022-07-12 Hongmin Li , Xiucai Ye , Akira Imakura , Tetsuya Sakurai

This paper presents a unified framework for supervised learning and inference procedures using the divide-and-conquer approach for high-dimensional correlated outcomes. We propose a general class of estimators that can be implemented in a…

Statistics Theory · Mathematics 2020-09-22 Emily C. Hector , Peter X. -K. Song

This study presents a divide-and-conquer (DC) approach based on feature space decomposition for classification. When large-scale datasets are present, typical approaches usually employed truncated kernel methods on the feature space or DC…

Machine Learning · Computer Science 2018-07-30 Qi Guo , Bo-Wei Chen , Feng Jiang , Xiangyang Ji , Sun-Yuan Kung

We propose a three-step divide-and-conquer strategy within the Bayesian paradigm that delivers massive scalability for any spatial process model. We partition the data into a large number of subsets, apply a readily available Bayesian…

Methodology · Statistics 2019-06-13 Rajarshi Guhaniyogi , Cheng Li , Terrance D. Savitsky , Sanvesh Srivastava

Factors models are routinely used to analyze high-dimensional data in both single-study and multi-study settings. Bayesian inference for such models relies on Markov Chain Monte Carlo (MCMC) methods which scale poorly as the number of…

Methodology · Statistics 2025-04-29 Blake Hansen , Alejandra Avalos-Pacheco , Massimiliano Russo , Roberta De Vito

Factor analysis for high-dimensional data is a canonical problem in statistics and has a wide range of applications. However, there is currently no factor model tailored to effectively analyze high-dimensional count responses with…

Methodology · Statistics 2024-08-21 Wei Liu , Qingzhi Zhong

For Bayesian computation in big data contexts, the divide-and-conquer MCMC concept splits the whole data set into batches, runs MCMC algorithms separately over each batch to produce samples of parameters, and combines them to produce an…

Computation · Statistics 2019-11-25 Wu Changye , Christian P. Robert

Bayesian matrix factorization (BMF) is a powerful tool for producing low-rank representations of matrices and for predicting missing values and providing confidence intervals. Scaling up the posterior inference for massive-scale matrices is…

Machine Learning · Statistics 2019-02-28 Xiangju Qin , Paul Blomstedt , Eemeli Leppäaho , Pekka Parviainen , Samuel Kaski

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

This paper presents a class of new algorithms for distributed statistical estimation that exploit divide-and-conquer approach. We show that one of the key benefits of the divide-and-conquer strategy is robustness, an important…

Statistics Theory · Mathematics 2018-08-29 Stanislav Minsker , Nate Strawn

In the presence of modeling errors, the mainstream Bayesian methods seldom give a realistic account of uncertainties as they commonly underestimate the inherent variability of parameters. This problem is not due to any misconception in the…

Applications · Statistics 2020-05-19 Omid Sedehi , Costas Papadimitriou , Lambros S. Katafygiotis

Data sets for statistical analysis become extremely large even with some difficulty of being stored on one single machine. Even when the data can be stored in one machine, the computational cost would still be intimidating. We propose a…

Methodology · Statistics 2020-02-18 Ya Su

Combinatorial optimization is considered a promising class of problems in which quantum computers can show significant advantages. However, problems of practical relevance typically have more variables than current or foreseeable quantum…

Quantum Physics · Physics 2025-12-23 Mathias Schmid , Naeimeh Mohseni , Michael J. Hartmann

Divide and conquer is an established algorithm design paradigm that has proven itself to solve a variety of problems efficiently. However, it is yet to be fully explored in solving problems with a neural network, particularly the problem of…

Image and Video Processing · Electrical Eng. & Systems 2020-10-08 Vikram Singh , Anurag Mittal

In high-dimensional classification problems, a commonly used approach is to first project the high-dimensional features into a lower dimensional space, and base the classification on the resulting lower dimensional projections. In this…

Statistics Theory · Mathematics 2025-08-05 Xin Bing , Marten Wegkamp